-- Logs begin at Wed 2022-09-21 11:39:24 UTC, end at Wed 2022-09-21 12:44:23 UTC. -- Sep 21 12:05:27.256250 dv-cinder-858678-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 21 12:05:27.263625 dv-cinder-858678-1-smb devstack@keystone.service[81367]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 21 12:05:27.266115 dv-cinder-858678-1-smb devstack@keystone.service[81367]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 21 12:05:27 2022] *** Sep 21 12:05:27.266115 dv-cinder-858678-1-smb devstack@keystone.service[81367]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 21 12:05:27.266115 dv-cinder-858678-1-smb devstack@keystone.service[81367]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 21 12:05:27.266115 dv-cinder-858678-1-smb devstack@keystone.service[81367]: nodename: dv-cinder-858678-1-smb Sep 21 12:05:27.266115 dv-cinder-858678-1-smb devstack@keystone.service[81367]: machine: x86_64 Sep 21 12:05:27.266115 dv-cinder-858678-1-smb devstack@keystone.service[81367]: clock source: unix Sep 21 12:05:27.266115 dv-cinder-858678-1-smb devstack@keystone.service[81367]: pcre jit disabled Sep 21 12:05:27.266857 dv-cinder-858678-1-smb devstack@keystone.service[81367]: detected number of CPU cores: 4 Sep 21 12:05:27.266857 dv-cinder-858678-1-smb devstack@keystone.service[81367]: current working directory: / Sep 21 12:05:27.266857 dv-cinder-858678-1-smb devstack@keystone.service[81367]: detected binary path: /usr/bin/uwsgi-core Sep 21 12:05:27.266857 dv-cinder-858678-1-smb devstack@keystone.service[81367]: your processes number limit is 47680 Sep 21 12:05:27.266857 dv-cinder-858678-1-smb devstack@keystone.service[81367]: your memory page size is 4096 bytes Sep 21 12:05:27.266857 dv-cinder-858678-1-smb devstack@keystone.service[81367]: detected max file descriptor number: 2048 Sep 21 12:05:27.266857 dv-cinder-858678-1-smb devstack@keystone.service[81367]: lock engine: pthread robust mutexes Sep 21 12:05:27.266857 dv-cinder-858678-1-smb devstack@keystone.service[81367]: thunder lock: enabled Sep 21 12:05:27.269176 dv-cinder-858678-1-smb devstack@keystone.service[81367]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 21 12:05:27.269176 dv-cinder-858678-1-smb devstack@keystone.service[81367]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 21 12:05:27.307036 dv-cinder-858678-1-smb devstack@keystone.service[81367]: Python main interpreter initialized at 0x55f5380bd9c0 Sep 21 12:05:27.307036 dv-cinder-858678-1-smb devstack@keystone.service[81367]: python threads support enabled Sep 21 12:05:27.307036 dv-cinder-858678-1-smb devstack@keystone.service[81367]: your server socket listen backlog is limited to 100 connections Sep 21 12:05:27.307036 dv-cinder-858678-1-smb devstack@keystone.service[81367]: your mercy for graceful operations on workers is 90 seconds Sep 21 12:05:27.307427 dv-cinder-858678-1-smb devstack@keystone.service[81367]: mapped 403077 bytes (393 KB) for 2 cores Sep 21 12:05:27.307510 dv-cinder-858678-1-smb devstack@keystone.service[81367]: *** Operational MODE: preforking *** Sep 21 12:05:27.307731 dv-cinder-858678-1-smb devstack@keystone.service[81367]: *** uWSGI is running in multiple interpreter mode *** Sep 21 12:05:27.307731 dv-cinder-858678-1-smb devstack@keystone.service[81367]: spawned uWSGI master process (pid: 81367) Sep 21 12:05:27.307935 dv-cinder-858678-1-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 21 12:05:27.308921 dv-cinder-858678-1-smb devstack@keystone.service[81367]: spawned uWSGI worker 1 (pid: 81377, cores: 1) Sep 21 12:05:27.309251 dv-cinder-858678-1-smb devstack@keystone.service[81367]: spawned uWSGI worker 2 (pid: 81378, cores: 1) Sep 21 12:05:27.310394 dv-cinder-858678-1-smb devstack@keystone.service[81367]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 21 12:05:31.716238 dv-cinder-858678-1-smb devstack@keystone.service[81378]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 21 12:05:31.716238 dv-cinder-858678-1-smb devstack@keystone.service[81378]: from cryptography.utils import int_from_bytes Sep 21 12:05:31.717711 dv-cinder-858678-1-smb devstack@keystone.service[81378]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 21 12:05:31.717711 dv-cinder-858678-1-smb devstack@keystone.service[81378]: from cryptography.utils import int_from_bytes Sep 21 12:05:31.727018 dv-cinder-858678-1-smb devstack@keystone.service[81377]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 21 12:05:31.727018 dv-cinder-858678-1-smb devstack@keystone.service[81377]: from cryptography.utils import int_from_bytes Sep 21 12:05:31.727523 dv-cinder-858678-1-smb devstack@keystone.service[81377]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 21 12:05:31.727523 dv-cinder-858678-1-smb devstack@keystone.service[81377]: from cryptography.utils import int_from_bytes Sep 21 12:05:31.770803 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 21 12:05:31.771003 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 21 12:05:31.771181 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] command line args: [] {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 21 12:05:31.771453 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 21 12:05:31.771633 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ================================================================================ {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 21 12:05:31.771889 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] admin_token = **** {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.772135 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] config_dir = [] {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.772325 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.772511 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] config_source = [] {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.772694 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] debug = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.772896 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.773400 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.773517 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.773697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.773943 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.774181 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] list_limit = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.774385 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] log_config_append = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.774572 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.774799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] log_dir = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.774934 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] log_file = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.775173 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.775422 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.775671 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.775921 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.776053 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 21 12:05:31.776138 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.776220 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 21 12:05:31.776345 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.776430 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] command line args: [] {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 21 12:05:31.776503 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.776624 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 21 12:05:31.776699 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ================================================================================ {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 21 12:05:31.776814 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.776945 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] admin_token = **** {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.777025 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.777177 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.777262 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] config_dir = [] {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.777385 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.777460 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.777582 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] config_source = [] {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.777658 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.777772 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] debug = True {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.777876 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.777961 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.778109 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.778189 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.778305 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.778402 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.778551 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.778796 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.778885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.779588 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] list_limit = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.779710 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] publish_errors = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.779852 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] log_config_append = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.779937 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.780055 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.780141 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] log_dir = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.780213 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.780353 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] log_file = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.780474 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.780597 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.780679 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.780752 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.780867 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.780956 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.781035 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] standard_threads = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.781165 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.781254 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.781325 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.781402 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.781503 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.781584 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.781736 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] use_journal = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.781821 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.781917 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] use_json = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.782000 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.782095 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] use_stderr = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.782179 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.782261 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] use_syslog = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.782427 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.782511 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.782659 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.782748 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.782888 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.782994 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.783131 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.783260 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.783373 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.783505 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.783642 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.783757 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.784001 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.784132 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.784264 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.784341 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] publish_errors = False {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.784479 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.784558 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.784729 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.784819 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.784893 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.784967 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.785212 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.785308 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.785389 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.785514 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.785598 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] standard_threads = False {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.785670 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.785790 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.785944 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.786018 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.786146 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.786227 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.786349 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] use_journal = False {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.786441 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.786552 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] use_json = False {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.786633 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.786717 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] use_stderr = False {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.786889 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] use_syslog = False {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.786973 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.787118 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 21 12:05:31.787201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.787369 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.787456 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.787606 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.787683 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.787858 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.787935 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.788095 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.788192 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.788339 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.788418 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.788574 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.788659 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.788817 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.788907 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.789049 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.789127 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.789283 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.789366 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.789525 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.789600 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.789756 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.789841 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.789988 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.790072 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.790226 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.790305 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.790482 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.790564 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.790726 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.790811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.790970 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.791056 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.791204 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.791289 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.791454 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.791532 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.791690 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.791771 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.791931 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.792016 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.792162 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.792240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.792394 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.792473 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.792628 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.792707 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.792862 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.792947 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.793096 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.793176 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.793335 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.793419 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.793564 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.793643 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.793792 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.793872 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.794025 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.794108 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.794256 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.794333 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.794552 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.794635 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.794790 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.794869 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.795021 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.795106 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.795258 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.795333 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.795494 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.795644 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.795721 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.795791 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.795958 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.796039 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.796188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.796273 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.796421 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.796500 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.796652 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.796738 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.796878 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.796956 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.797107 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.797185 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.797335 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.797418 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.797561 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.797668 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.797797 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.797909 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.798043 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.798126 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.798272 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.798410 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.798525 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.798624 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.798750 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.798863 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.798983 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.799089 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.799334 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.799431 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.799514 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.799589 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.799708 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.799790 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.799895 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.800033 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.800118 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.800207 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.800358 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.800488 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.800600 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.800722 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.800802 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.800886 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.801021 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.801122 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.801266 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.801344 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.801508 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.801624 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.801732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.801870 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.802003 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.802139 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.802266 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.802423 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.802549 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.802677 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.802811 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.802947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.803072 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.803222 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.803347 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.803429 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.803550 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.803628 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.803745 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.803832 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.803906 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.804023 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.804105 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.804178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.804294 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.804377 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.804476 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.804557 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.804709 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.804801 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.804955 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.805043 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.805190 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.805270 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.805423 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.805503 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.805653 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.805743 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.805884 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.805963 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.806114 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.806210 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.806348 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.806567 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.806645 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.806717 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.806822 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.806902 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.807055 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.807144 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.807286 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.807367 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.807542 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.807622 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.807779 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.807859 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.808009 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] auth.external = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.808089 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.808242 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.808322 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.808473 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.808551 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.808713 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.808795 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.808947 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.809026 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] auth.password = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.809179 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.809259 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] auth.token = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.809411 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.809499 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.809638 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.809719 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.809865 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.809944 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.810092 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.810181 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.810347 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.810450 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.810595 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.810675 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.810834 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.810914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.811070 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.811153 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] credential.caching = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.811315 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.811395 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.811550 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.811638 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.811805 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.811886 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.812051 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.812132 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.812288 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.812419 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.812507 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] auth.external = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.812583 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.812734 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.812816 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.812998 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.813077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.813236 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.813318 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.813463 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] auth.password = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.813541 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.813693 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] auth.token = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.813773 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.813929 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.814012 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.814167 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.814247 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.814434 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.814520 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.814665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.814748 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.814909 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.814990 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] federation.caching = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.815152 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.815232 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.815379 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.815460 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.815610 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] credential.caching = True {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.815690 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.815853 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.815937 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.816098 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.816180 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.816341 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.816421 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.816588 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.816676 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.816825 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.816904 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.817054 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.817133 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.817295 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.817386 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.817542 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.817621 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.817773 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.817853 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] identity.caching = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.818022 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.818113 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.818271 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.818375 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.818532 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.818614 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.818770 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.818863 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.819025 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.819105 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.819258 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.819337 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.819494 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] federation.caching = True {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.819586 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.819728 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.819809 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.819970 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.820051 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.820204 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.820366 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.820443 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.820514 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.820660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.820740 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.820891 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.820978 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.821139 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.821220 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.821370 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.821451 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.821621 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.821710 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.821855 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.821935 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.822099 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.822179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.822333 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] identity.caching = True {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.822494 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.822602 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.822683 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.822836 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.822915 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.823069 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.823159 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.823300 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.823380 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.823538 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.823618 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.823765 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.823853 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.824044 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.824132 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.824249 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.824329 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.824484 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.824574 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.824711 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.824792 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.824941 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.825021 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.825170 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.825258 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.825411 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.825493 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.825655 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.825735 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.826440 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.826539 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.826687 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.826767 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.826925 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.827059 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.827205 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.827337 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.827468 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.827599 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.827730 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.827872 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.828012 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.828143 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.828143 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.828390 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.828520 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.828651 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.828790 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.828940 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.829068 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.829194 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.829320 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.829445 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.829579 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.829717 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.829844 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.829969 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.830101 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.830227 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.830443 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.830526 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.830600 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.830671 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.830743 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.830815 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.user = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.830894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.830969 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.831041 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.831041 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.831170 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.831242 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.831326 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.831429 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.831511 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.831664 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.831744 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.831903 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.831992 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.832138 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.832219 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.832370 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.832451 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.832610 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.832699 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.832851 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.832931 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.833077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.833156 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.833305 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.833393 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.833550 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.833631 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.833796 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.833876 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.834026 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.834113 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.834259 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.834340 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.834521 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.834606 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.834751 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.user = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.834843 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.834986 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.835068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.835225 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.835304 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.835456 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.835543 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.835692 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.835772 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.835934 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.836014 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.836174 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.836261 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.836407 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.836483 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.836633 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.836713 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.836863 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.836951 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.837094 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.837175 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.837326 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.837409 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.837552 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.837641 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.837792 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.837872 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.838034 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.838115 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.838273 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.838412 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.838547 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.838628 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.838781 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.838861 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.839006 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.839093 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.839248 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.839328 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] resource.caching = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.839482 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.839562 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.839715 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.839803 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.839948 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.840029 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.840180 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.840261 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.840422 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.840511 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.840666 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.840768 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.840915 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.840996 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.841185 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.841327 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.841490 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.842125 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.842253 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] role.caching = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.842415 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.842553 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] role.driver = sql {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.842681 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.842806 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.842889 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.843065 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.843191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.843284 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.843408 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.843532 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.843658 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.843658 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.843897 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.844093 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.844227 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.844354 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] resource.caching = True {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.844479 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.844614 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.844742 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.844897 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.845023 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.845149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.845275 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.845402 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.845528 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.845619 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.845738 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.845823 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.845990 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.846116 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.846241 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.846423 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.846423 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.846624 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.846706 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] role.caching = True {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.846813 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.846893 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] role.driver = sql {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.846975 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.847051 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.847122 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.847194 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.847265 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.847338 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.847418 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.847493 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.847565 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.847702 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.847783 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.847945 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.848035 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.848187 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.848269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.848430 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.848510 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.848673 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.848761 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.848903 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.848983 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.849146 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.849226 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.849389 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.849472 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.849631 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.849712 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.849869 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.849949 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.850107 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.850259 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.850340 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.850516 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.850661 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] token.caching = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.850762 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.850902 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.851009 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.851153 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.851254 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.851394 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.851501 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.851654 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.851738 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.851907 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.851987 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.852149 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.852229 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.852395 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.852477 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.852636 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.852716 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.852865 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.852946 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.853093 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.853176 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.853338 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.853418 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.853577 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.853656 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.853817 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.853898 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.854049 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.854129 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.854281 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.854378 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.854536 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.854631 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.854768 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] token.caching = True {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.854849 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.855001 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.855081 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] database.connection = **** {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.855244 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.855332 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.855478 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.855558 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.855729 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.855809 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.855984 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.856076 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.856220 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.856300 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.856458 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.856539 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.856696 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.856788 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.856934 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.857035 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.857228 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.857315 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.857468 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.857557 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.857716 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.857797 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.857954 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.858035 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.858204 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.858293 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.858470 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.858555 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.858710 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.858800 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.858941 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.859021 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.859185 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.859274 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] database.connection = **** {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.859423 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.859505 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.859601 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81378) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 21 12:05:31.859682 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.859894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.860134 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.860366 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.860600 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.860832 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.861063 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.861305 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.861538 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.861776 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.862009 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.862253 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.862509 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.862752 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.862980 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.863217 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.863449 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 21 12:05:31.863617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81377) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 21 12:05:31.890091 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:31.890320 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:31.890586 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:31.892692 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:31.892925 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:31.893152 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:31.899351 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:31.901450 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:31.930651 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:31.930874 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:31.931566 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:31.931806 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:31.984410 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:31.985237 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.032602 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.032832 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.034067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.034305 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.189630 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.189803 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.189932 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.190022 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.190116 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.190194 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.190262 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.190416 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.190504 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.190634 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.190720 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.190930 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.213659 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.213888 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.213972 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.214115 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.214199 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.214337 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.214446 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.214580 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.214674 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.214795 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.214877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.215009 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.215088 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.215232 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.226912 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.227304 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.240275 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.240465 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.240579 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.240702 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.240786 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.240923 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.241006 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.241143 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.241235 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.241364 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.241447 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.241580 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.241663 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81377) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.241805 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81378) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 21 12:05:32.258427 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.258637 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 21 12:05:32.258981 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.259068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.259215 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 21 12:05:32.259330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 21 12:05:32.259492 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.259589 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.259706 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.259791 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 21 12:05:32.259967 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.260060 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.260224 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.260316 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.260556 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.260818 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.270065 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.270347 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.270643 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.270782 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.270925 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.271073 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.271351 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.271643 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.277911 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 12:05:32.278697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 12:05:32.281367 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 12:05:32.281654 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.281938 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.282203 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 12:05:32.282287 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.282515 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.282612 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.282778 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.282863 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.283045 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.283127 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.283316 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.283400 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.283584 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.283667 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.283855 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.283945 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.284122 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.284204 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.284394 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.284674 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.284947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.307418 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.308545 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.308877 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 12:05:32.309178 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.310063 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 12:05:32.310892 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.314413 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 12:05:32.314699 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.314978 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.315633 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 12:05:32.315925 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.316210 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.321307 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 12:05:32.321592 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.322671 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 12:05:32.322966 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.327978 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 12:05:32.328280 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.328573 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.328862 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.329137 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.329409 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.329496 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 12:05:32.329676 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.329758 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.329942 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.330031 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.330302 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.330613 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.330898 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.331175 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.331449 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.345503 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.345782 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.347111 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.347393 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.349644 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 12:05:32.351606 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 12:05:32.352907 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.353200 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.354856 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.355158 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.357463 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 12:05:32.359450 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 12:05:32.360618 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 12:05:32.362578 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 12:05:32.363853 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.364145 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.364428 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.364711 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.365002 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.365289 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.365780 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.366082 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.366392 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.366682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.366969 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.367256 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.383251 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 12:05:32.383547 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.383815 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.384081 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.384863 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 12:05:32.385175 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.385438 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.385704 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.391800 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.393333 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.393548 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.394891 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.395142 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.395228 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.396683 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.396965 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.397806 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 12:05:32.398094 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.398396 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.398681 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.399082 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.399664 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 12:05:32.399957 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.400267 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.400532 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.400947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.410279 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 12:05:32.410591 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.410873 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.411155 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.411536 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.411824 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.412102 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.412323 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 12:05:32.412617 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.412902 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.413219 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.413569 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.413855 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.414149 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.427563 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 12:05:32.429769 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 12:05:32.430475 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 12:05:32.432747 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 12:05:32.433447 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.434912 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.436255 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.436895 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 12:05:32.437186 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.437658 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.437756 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.439221 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 12:05:32.439525 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.439985 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.443960 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.445414 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 12:05:32.446392 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.447873 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 12:05:32.448334 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.448730 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.449016 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.449291 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.451440 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.451849 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.452139 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.452423 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.457662 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 12:05:32.457964 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.458245 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.460343 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 12:05:32.460647 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.460933 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.465110 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81377) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 12:05:32.465511 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.465997 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.466529 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.466867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.467144 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.467424 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.467703 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.467984 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.468282 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.468596 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.468805 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81378) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 21 12:05:32.468939 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.469098 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.469230 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.469353 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81377) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.469489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.469641 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.469916 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.470192 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.470495 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.470790 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.471064 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.471357 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.471653 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.471919 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.472186 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.472459 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81378) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 21 12:05:32.504379 dv-cinder-858678-1-smb devstack@keystone.service[81377]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f5380bd9c0 pid: 81377 (default app) Sep 21 12:05:32.507803 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194697c6-cbcf-45fb-86ca-1ac7c0d8ef38 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:32.507907 dv-cinder-858678-1-smb devstack@keystone.service[81378]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f5380bd9c0 pid: 81378 (default app) Sep 21 12:05:32.508084 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194697c6-cbcf-45fb-86ca-1ac7c0d8ef38 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:32.508359 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194697c6-cbcf-45fb-86ca-1ac7c0d8ef38 None None] PATH_INFO: `/v3` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:32.512458 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 791 bytes} [Wed Sep 21 12:05:32 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:05:39.371241 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d4e8e-3707-4a87-bf2d-d042c272cba5 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:39.371784 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d4e8e-3707-4a87-bf2d-d042c272cba5 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:39.371784 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d4e8e-3707-4a87-bf2d-d042c272cba5 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:39.376617 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1/2] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:05:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:05:39.381950 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687be3b-ac32-4922-95ba-b45d13667901 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:39.382503 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687be3b-ac32-4922-95ba-b45d13667901 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:39.382503 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687be3b-ac32-4922-95ba-b45d13667901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:39.464771 dv-cinder-858678-1-smb devstack@keystone.service[81377]: INFO dbcounter [None req-2687be3b-ac32-4922-95ba-b45d13667901 None None] Registered counter for database keystone Sep 21 12:05:39.492794 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG oslo_db.sqlalchemy.engines [None req-2687be3b-ac32-4922-95ba-b45d13667901 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81377) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 21 12:05:39.502245 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writer thread running {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 21 12:05:39.682671 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG passlib.handlers.bcrypt [None req-2687be3b-ac32-4922-95ba-b45d13667901 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81377) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 21 12:05:39.682977 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG passlib.handlers.bcrypt [None req-2687be3b-ac32-4922-95ba-b45d13667901 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81377) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 21 12:05:39.741484 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-2687be3b-ac32-4922-95ba-b45d13667901 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:05:39.743137 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-2687be3b-ac32-4922-95ba-b45d13667901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:05:39.876638 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 2/3] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:05:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 496 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 21 12:05:40.337782 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d4e8e-3707-4a87-bf2d-d042c272cba5 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:05:40.408852 dv-cinder-858678-1-smb devstack@keystone.service[81378]: INFO dbcounter [None req-fd8d4e8e-3707-4a87-bf2d-d042c272cba5 None None] Registered counter for database keystone Sep 21 12:05:40.430434 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG oslo_db.sqlalchemy.engines [None req-fd8d4e8e-3707-4a87-bf2d-d042c272cba5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81378) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 21 12:05:40.437336 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writer thread running {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 21 12:05:40.557186 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d4e8e-3707-4a87-bf2d-d042c272cba5 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:05:40.562123 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bda6cf-8858-4659-b3d0-d98ffb52d889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:05:40.562789 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bda6cf-8858-4659-b3d0-d98ffb52d889 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:40.563073 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bda6cf-8858-4659-b3d0-d98ffb52d889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:40.563348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bda6cf-8858-4659-b3d0-d98ffb52d889 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:40.572007 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bda6cf-8858-4659-b3d0-d98ffb52d889 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:05:40.624888 dv-cinder-858678-1-smb devstack@keystone.service[81378]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c1bda6cf-8858-4659-b3d0-d98ffb52d889 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 21 12:05:40.625172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bda6cf-8858-4659-b3d0-d98ffb52d889 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:05:40.635078 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 2/4] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Sep 21 12:05:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 12:05:40.641819 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687be3b-ac32-4922-95ba-b45d13667901 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:05:40.659252 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687be3b-ac32-4922-95ba-b45d13667901 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:05:40.663757 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591440e-9179-49be-bb65-298a4b36381f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:05:40.664877 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591440e-9179-49be-bb65-298a4b36381f admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:40.665159 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591440e-9179-49be-bb65-298a4b36381f admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:40.665439 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591440e-9179-49be-bb65-298a4b36381f admin admin] PATH_INFO: `/v3/projects/1600cabcba2e4465b53f5a73f9b91b11` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:40.667072 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6591440e-9179-49be-bb65-298a4b36381f admin admin] RBAC: Authorizing `identity:get_project(project_id=1600cabcba2e4465b53f5a73f9b91b11)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:05:40.720167 dv-cinder-858678-1-smb devstack@keystone.service[81377]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6591440e-9179-49be-bb65-298a4b36381f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 21 12:05:40.720506 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6591440e-9179-49be-bb65-298a4b36381f admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:05:40.725074 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 3/5] 10.222.0.60 () {56 vars in 1207 bytes} [Wed Sep 21 12:05:40 2022] GET /identity/v3/projects/1600cabcba2e4465b53f5a73f9b91b11 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:05:42.867384 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48aadd5-ebb9-47bf-8882-4994b00472ce None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:42.867898 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48aadd5-ebb9-47bf-8882-4994b00472ce None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:42.867898 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48aadd5-ebb9-47bf-8882-4994b00472ce None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:42.871881 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 3/6] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:05:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:05:42.878054 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a5ba1-635d-479f-ba91-bd013fca6286 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:42.878577 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a5ba1-635d-479f-ba91-bd013fca6286 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:42.878793 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a5ba1-635d-479f-ba91-bd013fca6286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:42.899621 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-463a5ba1-635d-479f-ba91-bd013fca6286 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:05:42.901121 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-463a5ba1-635d-479f-ba91-bd013fca6286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:05:42.909630 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 4/7] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:05:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 21 12:05:43.187888 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48aadd5-ebb9-47bf-8882-4994b00472ce None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:05:43.199999 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48aadd5-ebb9-47bf-8882-4994b00472ce None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:05:43.204849 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f9622-dbcb-466e-805b-405e603e186b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:05:43.205443 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f9622-dbcb-466e-805b-405e603e186b admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:43.205725 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f9622-dbcb-466e-805b-405e603e186b admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:43.205998 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f9622-dbcb-466e-805b-405e603e186b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:43.213699 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f9622-dbcb-466e-805b-405e603e186b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:05:43.215502 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f9622-dbcb-466e-805b-405e603e186b admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:05:43.224931 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 4/8] 10.222.0.60 () {58 vars in 1324 bytes} [Wed Sep 21 12:05:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 21 12:05:43.230333 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a5ba1-635d-479f-ba91-bd013fca6286 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:05:43.239551 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a5ba1-635d-479f-ba91-bd013fca6286 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:05:43.243986 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312989c-4460-4fa5-a55b-5d933e6bc931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:05:43.244607 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312989c-4460-4fa5-a55b-5d933e6bc931 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:43.244886 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312989c-4460-4fa5-a55b-5d933e6bc931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:43.245161 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312989c-4460-4fa5-a55b-5d933e6bc931 admin admin] PATH_INFO: `/v3/users/5ede9eacb91d469ab92c14848276a5bb` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:43.246501 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312989c-4460-4fa5-a55b-5d933e6bc931 admin admin] RBAC: Authorizing `identity:get_user(user_id=5ede9eacb91d469ab92c14848276a5bb)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:05:43.248379 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312989c-4460-4fa5-a55b-5d933e6bc931 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:05:43.249885 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 5/9] 10.222.0.60 () {56 vars in 1198 bytes} [Wed Sep 21 12:05:43 2022] GET /identity/v3/users/5ede9eacb91d469ab92c14848276a5bb => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:05:45.469255 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b85ca-f0ab-4e7e-a538-4aa6f64ef801 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:45.469815 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b85ca-f0ab-4e7e-a538-4aa6f64ef801 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:45.469815 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b85ca-f0ab-4e7e-a538-4aa6f64ef801 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:45.471161 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 5/10] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:05:45.476695 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5d68e-bc83-4f2b-b627-659e7843e428 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:45.477090 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5d68e-bc83-4f2b-b627-659e7843e428 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:45.477355 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5d68e-bc83-4f2b-b627-659e7843e428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:45.495683 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-f4e5d68e-bc83-4f2b-b627-659e7843e428 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:05:45.496846 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-f4e5d68e-bc83-4f2b-b627-659e7843e428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:05:45.548521 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4650a9-1ea6-49fb-b0ee-3a4da057e9b6 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:45.548802 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4650a9-1ea6-49fb-b0ee-3a4da057e9b6 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:45.549077 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4650a9-1ea6-49fb-b0ee-3a4da057e9b6 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:45.550434 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 6/11] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:05:45.555450 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ce1d5-7ff8-4388-82e5-4b6a94b8b4c6 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:45.555739 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ce1d5-7ff8-4388-82e5-4b6a94b8b4c6 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:45.556146 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ce1d5-7ff8-4388-82e5-4b6a94b8b4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:45.581100 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 6/12] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:05:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:05:45.599360 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG passlib.handlers.bcrypt [None req-7c5ce1d5-7ff8-4388-82e5-4b6a94b8b4c6 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81378) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 21 12:05:45.599746 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG passlib.handlers.bcrypt [None req-7c5ce1d5-7ff8-4388-82e5-4b6a94b8b4c6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81378) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 21 12:05:45.649919 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-7c5ce1d5-7ff8-4388-82e5-4b6a94b8b4c6 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:05:45.651566 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7c5ce1d5-7ff8-4388-82e5-4b6a94b8b4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:05:45.751434 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 7/13] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:05:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 12:05:45.849896 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5d68e-bc83-4f2b-b627-659e7843e428 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:05:45.874307 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:05:45.957735 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5d68e-bc83-4f2b-b627-659e7843e428 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:05:45.992932 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e909e-1db1-4e71-a24c-a8549150af18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:05:45.993652 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e909e-1db1-4e71-a24c-a8549150af18 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:45.993848 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e909e-1db1-4e71-a24c-a8549150af18 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:45.994123 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e909e-1db1-4e71-a24c-a8549150af18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:46.006394 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e909e-1db1-4e71-a24c-a8549150af18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:05:46.015262 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-4a5e909e-1db1-4e71-a24c-a8549150af18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:05:46.015262 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:05:46.015262 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:05:46.015262 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:05:46.015262 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:05:46.015262 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:05:46.015262 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:05:46.015262 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:05:46.015262 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:05:46.015262 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:05:46.015262 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:05:46.015262 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:05:46.015262 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:05:46.015262 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:05:46.015262 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:05:46.015262 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:05:46.016700 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:05:46.016700 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:05:46.016700 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:05:46.016700 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:05:46.016700 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:05:46.016700 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:05:46.016700 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:05:46.016700 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:05:46.016700 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:05:46.016700 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:05:46.016700 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:05:46.016700 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:05:46.016700 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:05:46.016700 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:05:46.016700 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:05:46.016700 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:05:46.017525 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:05:46.017525 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:05:46.017525 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:05:46.017525 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:05:46.017525 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:05:46.017525 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:05:46.017525 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:05:46.017525 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:05:46.017525 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:05:46.017525 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:05:46.017525 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:05:46.017525 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:05:46.017525 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 7/14] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Sep 21 12:05:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:05:46.022635 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ce1d5-7ff8-4388-82e5-4b6a94b8b4c6 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:05:46.024245 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e909e-1db1-4e71-a24c-a8549150af18 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:05:46.106452 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:05:46.125734 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e909e-1db1-4e71-a24c-a8549150af18 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:05:46.126185 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ce1d5-7ff8-4388-82e5-4b6a94b8b4c6 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:05:46.128580 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:05:46.161720 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531167b-a2cb-4bf2-8f08-1fad77e0e927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:05:46.162332 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531167b-a2cb-4bf2-8f08-1fad77e0e927 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:46.162641 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531167b-a2cb-4bf2-8f08-1fad77e0e927 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:46.162914 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531167b-a2cb-4bf2-8f08-1fad77e0e927 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:46.166056 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7d3c2-324e-43d1-96d7-6f3df4d1bf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:05:46.166957 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7d3c2-324e-43d1-96d7-6f3df4d1bf64 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:46.167241 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7d3c2-324e-43d1-96d7-6f3df4d1bf64 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:46.167514 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7d3c2-324e-43d1-96d7-6f3df4d1bf64 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:46.168356 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7d3c2-324e-43d1-96d7-6f3df4d1bf64 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:05:46.168661 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7d3c2-324e-43d1-96d7-6f3df4d1bf64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:05:46.170129 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7d3c2-324e-43d1-96d7-6f3df4d1bf64 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:05:46.182158 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 8/15] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:05:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:05:46.188165 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7d3c2-324e-43d1-96d7-6f3df4d1bf64 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:05:46.230353 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531167b-a2cb-4bf2-8f08-1fad77e0e927 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:05:46.231919 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531167b-a2cb-4bf2-8f08-1fad77e0e927 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:05:46.289039 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7d3c2-324e-43d1-96d7-6f3df4d1bf64 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:05:46.312974 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:05:46.324458 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4a2ca-a183-49a2-acd6-156ddaf0cb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:05:46.325342 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4a2ca-a183-49a2-acd6-156ddaf0cb2a None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:46.325623 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4a2ca-a183-49a2-acd6-156ddaf0cb2a None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:46.325901 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4a2ca-a183-49a2-acd6-156ddaf0cb2a None admin] PATH_INFO: `/v3/users/5ede9eacb91d469ab92c14848276a5bb` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:46.328007 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d4a2ca-a183-49a2-acd6-156ddaf0cb2a None admin] RBAC: Authorizing `identity:get_user(user_id=5ede9eacb91d469ab92c14848276a5bb)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:05:46.329467 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d4a2ca-a183-49a2-acd6-156ddaf0cb2a None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:05:46.331116 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 9/16] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:05:46 2022] GET /identity/v3/users/5ede9eacb91d469ab92c14848276a5bb => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:05:46.332598 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 8/17] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:05:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 21 12:05:46.336482 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4a2ca-a183-49a2-acd6-156ddaf0cb2a None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:05:46.338015 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531167b-a2cb-4bf2-8f08-1fad77e0e927 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:05:46.370377 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:05:46.434782 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531167b-a2cb-4bf2-8f08-1fad77e0e927 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:05:46.437551 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4a2ca-a183-49a2-acd6-156ddaf0cb2a None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:05:46.468919 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a022a-c58e-4e2f-a953-db6fa0e5145e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:05:46.469549 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a022a-c58e-4e2f-a953-db6fa0e5145e None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:46.469831 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a022a-c58e-4e2f-a953-db6fa0e5145e None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:46.470105 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a022a-c58e-4e2f-a953-db6fa0e5145e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:46.471241 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c70ea-128d-4aa5-bfe9-f6d7c12017a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:05:46.471868 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c70ea-128d-4aa5-bfe9-f6d7c12017a1 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:46.472145 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c70ea-128d-4aa5-bfe9-f6d7c12017a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:46.472413 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c70ea-128d-4aa5-bfe9-f6d7c12017a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:46.473523 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c70ea-128d-4aa5-bfe9-f6d7c12017a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:05:46.475005 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c70ea-128d-4aa5-bfe9-f6d7c12017a1 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:05:46.476531 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 10/18] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:05:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:05:46.482597 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c70ea-128d-4aa5-bfe9-f6d7c12017a1 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:05:46.482741 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957a022a-c58e-4e2f-a953-db6fa0e5145e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:05:46.484072 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957a022a-c58e-4e2f-a953-db6fa0e5145e None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:05:46.501617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-957a022a-c58e-4e2f-a953-db6fa0e5145e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:05:46.501617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:05:46.501617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:05:46.501617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:05:46.501617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:05:46.501617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:05:46.501617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:05:46.501617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:05:46.501617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:05:46.501617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:05:46.501617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:05:46.501617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:05:46.501617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:05:46.501617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:05:46.501617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:05:46.501617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:05:46.502650 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:05:46.502650 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:05:46.502650 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:05:46.502650 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:05:46.502650 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:05:46.502650 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:05:46.502650 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:05:46.502650 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:05:46.502650 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:05:46.502650 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:05:46.502650 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:05:46.502650 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:05:46.502650 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:05:46.502650 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:05:46.502650 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:05:46.502650 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:05:46.502650 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:05:46.503436 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:05:46.503436 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:05:46.503436 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:05:46.503436 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 9/19] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:05:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 12:05:46.512905 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a022a-c58e-4e2f-a953-db6fa0e5145e None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:05:46.550749 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:05:46.596640 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c70ea-128d-4aa5-bfe9-f6d7c12017a1 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:05:46.598185 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:05:46.619068 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a022a-c58e-4e2f-a953-db6fa0e5145e None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:05:46.632838 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78bfa9d-de1c-4e6d-9466-5aa090ea7a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:05:46.633447 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bfa9d-de1c-4e6d-9466-5aa090ea7a63 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:46.633725 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bfa9d-de1c-4e6d-9466-5aa090ea7a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:46.633994 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78bfa9d-de1c-4e6d-9466-5aa090ea7a63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:46.634738 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78bfa9d-de1c-4e6d-9466-5aa090ea7a63 None admin] RBAC: Adding query filter params (role.id=72c80b472acb462ebadd86463efe91f7, scope.domain.id=default, user.id=5ede9eacb91d469ab92c14848276a5bb) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:05:46.635043 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78bfa9d-de1c-4e6d-9466-5aa090ea7a63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:05:46.636479 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78bfa9d-de1c-4e6d-9466-5aa090ea7a63 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:05:46.645360 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 11/20] 10.222.0.60 () {56 vars in 1322 bytes} [Wed Sep 21 12:05:46 2022] GET /identity/v3/role_assignments?user.id=5ede9eacb91d469ab92c14848276a5bb&scope.domain.id=default&role.id=72c80b472acb462ebadd86463efe91f7 => generated 233 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:05:46.653725 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeae46d-8974-4845-a9b8-7a4198c42bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:05:46.654430 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeae46d-8974-4845-a9b8-7a4198c42bc1 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:46.654718 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeae46d-8974-4845-a9b8-7a4198c42bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:46.654994 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeae46d-8974-4845-a9b8-7a4198c42bc1 None admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:46.655673 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeae46d-8974-4845-a9b8-7a4198c42bc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:05:46.655980 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeae46d-8974-4845-a9b8-7a4198c42bc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:05:46.657425 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeae46d-8974-4845-a9b8-7a4198c42bc1 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:05:46.677685 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 10/21] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:05:49.029379 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e5bc4-d605-48d9-9f82-40c405370c02 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:49.030250 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e5bc4-d605-48d9-9f82-40c405370c02 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:49.030686 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e5bc4-d605-48d9-9f82-40c405370c02 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:49.032194 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 12/22] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:05:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:05:49.037823 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c62f24-5725-4d87-be2c-dbd2abb12e6e None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:49.038658 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c62f24-5725-4d87-be2c-dbd2abb12e6e None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:49.039088 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c62f24-5725-4d87-be2c-dbd2abb12e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:49.067432 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-d5c62f24-5725-4d87-be2c-dbd2abb12e6e None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:05:49.068912 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-d5c62f24-5725-4d87-be2c-dbd2abb12e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:05:49.152732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 11/23] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:05:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:05:49.216272 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaee5aa-60ad-4c7e-9731-4e6c5bde5c40 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:49.216850 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaee5aa-60ad-4c7e-9731-4e6c5bde5c40 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:49.217271 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaee5aa-60ad-4c7e-9731-4e6c5bde5c40 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:49.219117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 13/24] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:05:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:05:49.224539 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c307540-24c0-4c7a-b131-ea5d8f2ad8ba None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:49.225163 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c307540-24c0-4c7a-b131-ea5d8f2ad8ba None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:49.225585 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c307540-24c0-4c7a-b131-ea5d8f2ad8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:49.259243 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-1c307540-24c0-4c7a-b131-ea5d8f2ad8ba None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:05:49.260699 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-1c307540-24c0-4c7a-b131-ea5d8f2ad8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:05:49.286158 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:05:49.353194 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 12/25] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:05:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:05:49.756779 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99562e10-7a9a-4c56-a975-c16d9328a509 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:49.757060 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99562e10-7a9a-4c56-a975-c16d9328a509 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:49.757569 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99562e10-7a9a-4c56-a975-c16d9328a509 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:49.759601 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 14/26] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:05:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:05:49.765766 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5086b-ad3e-4955-b65d-45d68a36db0a None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:49.766389 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5086b-ad3e-4955-b65d-45d68a36db0a None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:49.766867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c5086b-ad3e-4955-b65d-45d68a36db0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:49.783688 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99562e10-7a9a-4c56-a975-c16d9328a509 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:05:49.801740 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-63c5086b-ad3e-4955-b65d-45d68a36db0a None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:05:49.803997 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-63c5086b-ad3e-4955-b65d-45d68a36db0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:05:49.933253 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 13/27] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:05:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:05:49.934519 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5086b-ad3e-4955-b65d-45d68a36db0a None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:05:49.964386 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99562e10-7a9a-4c56-a975-c16d9328a509 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:05:50.038190 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac67abe-cfb4-4f0a-862b-fa38716ee72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:05:50.038874 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac67abe-cfb4-4f0a-862b-fa38716ee72a None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:50.039290 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac67abe-cfb4-4f0a-862b-fa38716ee72a None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:50.039779 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac67abe-cfb4-4f0a-862b-fa38716ee72a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:50.067317 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac67abe-cfb4-4f0a-862b-fa38716ee72a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:05:50.082190 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-4ac67abe-cfb4-4f0a-862b-fa38716ee72a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:05:50.082190 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:05:50.082190 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:05:50.082190 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:05:50.082190 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:05:50.082190 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:05:50.082190 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:05:50.082190 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:05:50.082190 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:05:50.082190 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:05:50.082190 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:05:50.082190 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:05:50.082190 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:05:50.082190 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:05:50.082190 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:05:50.082190 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:05:50.083101 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:05:50.083101 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:05:50.083101 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:05:50.083101 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:05:50.083101 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:05:50.083101 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:05:50.083101 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:05:50.083101 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:05:50.083101 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:05:50.083101 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:05:50.083101 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:05:50.083101 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:05:50.083101 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:05:50.083101 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:05:50.083101 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:05:50.083101 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:05:50.083851 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:05:50.083851 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:05:50.083851 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:05:50.083851 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:05:50.083851 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:05:50.083851 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:05:50.083851 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:05:50.083851 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:05:50.083851 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:05:50.083851 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:05:50.083851 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:05:50.083851 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:05:50.083851 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 15/28] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Sep 21 12:05:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:05:50.085318 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0c50c-8e38-4835-af12-e61f3348d2a8 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:50.085318 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0c50c-8e38-4835-af12-e61f3348d2a8 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:50.085318 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0c50c-8e38-4835-af12-e61f3348d2a8 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:50.086512 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 16/29] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:05:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:05:50.098715 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:05:50.099183 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0c50c-8e38-4835-af12-e61f3348d2a8 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:05:50.125975 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c5086b-ad3e-4955-b65d-45d68a36db0a None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:05:50.155572 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:05:50.165005 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4dd20-357d-489f-a6d0-bb4322078022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:05:50.165647 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4dd20-357d-489f-a6d0-bb4322078022 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:50.165928 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4dd20-357d-489f-a6d0-bb4322078022 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:50.166203 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4dd20-357d-489f-a6d0-bb4322078022 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:50.177189 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4dd20-357d-489f-a6d0-bb4322078022 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:05:50.178703 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4dd20-357d-489f-a6d0-bb4322078022 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:05:50.195364 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-bfc4dd20-357d-489f-a6d0-bb4322078022 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:05:50.195364 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:05:50.195364 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:05:50.195364 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:05:50.195364 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:05:50.195364 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:05:50.195364 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:05:50.195364 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:05:50.195364 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:05:50.195364 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:05:50.195364 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:05:50.195364 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:05:50.195364 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:05:50.195364 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:05:50.195364 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:05:50.195364 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:05:50.197637 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:05:50.197637 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:05:50.197637 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:05:50.197637 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:05:50.197637 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:05:50.197637 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:05:50.197637 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:05:50.197637 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:05:50.197637 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:05:50.197637 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:05:50.197637 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:05:50.197637 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:05:50.197637 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:05:50.197637 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:05:50.197637 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:05:50.197637 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:05:50.197637 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:05:50.199762 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:05:50.199762 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:05:50.199762 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:05:50.199762 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 14/30] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:05:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:05:50.199762 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a921ad-b110-4ec9-b04c-d5b6e23aecbb None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:50.199762 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a921ad-b110-4ec9-b04c-d5b6e23aecbb None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:50.199762 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a921ad-b110-4ec9-b04c-d5b6e23aecbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:50.216957 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-b0a921ad-b110-4ec9-b04c-d5b6e23aecbb None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:05:50.218280 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-b0a921ad-b110-4ec9-b04c-d5b6e23aecbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:05:50.291366 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0c50c-8e38-4835-af12-e61f3348d2a8 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:05:50.294302 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 15/31] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:05:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:05:50.295245 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a921ad-b110-4ec9-b04c-d5b6e23aecbb None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:05:50.327498 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd73613-ab0e-4902-9332-4a20cb5dcdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:05:50.328156 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd73613-ab0e-4902-9332-4a20cb5dcdb7 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:50.328434 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd73613-ab0e-4902-9332-4a20cb5dcdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:50.328705 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd73613-ab0e-4902-9332-4a20cb5dcdb7 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:50.329370 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd73613-ab0e-4902-9332-4a20cb5dcdb7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:05:50.329668 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd73613-ab0e-4902-9332-4a20cb5dcdb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:05:50.331117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd73613-ab0e-4902-9332-4a20cb5dcdb7 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:05:50.339977 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 17/32] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:05:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:05:50.340802 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd73613-ab0e-4902-9332-4a20cb5dcdb7 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:05:50.430728 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:05:50.446907 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:05:50.467999 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd73613-ab0e-4902-9332-4a20cb5dcdb7 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:05:50.491395 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a921ad-b110-4ec9-b04c-d5b6e23aecbb None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:05:50.537645 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536fafc5-2c80-4feb-8de7-81ab3cb081a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:05:50.538253 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fafc5-2c80-4feb-8de7-81ab3cb081a6 None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:50.538561 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fafc5-2c80-4feb-8de7-81ab3cb081a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:50.538831 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fafc5-2c80-4feb-8de7-81ab3cb081a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:50.540597 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536fafc5-2c80-4feb-8de7-81ab3cb081a6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:05:50.541979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536fafc5-2c80-4feb-8de7-81ab3cb081a6 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:05:50.561695 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee8902-ff36-4ac9-85e1-a87b4ab3dcc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:05:50.562201 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee8902-ff36-4ac9-85e1-a87b4ab3dcc3 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:50.562509 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee8902-ff36-4ac9-85e1-a87b4ab3dcc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:50.562779 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee8902-ff36-4ac9-85e1-a87b4ab3dcc3 None admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:50.563425 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ee8902-ff36-4ac9-85e1-a87b4ab3dcc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:05:50.563724 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ee8902-ff36-4ac9-85e1-a87b4ab3dcc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:05:50.565097 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ee8902-ff36-4ac9-85e1-a87b4ab3dcc3 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:05:50.598726 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 16/33] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:05:50.599683 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee8902-ff36-4ac9-85e1-a87b4ab3dcc3 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:05:50.751379 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee8902-ff36-4ac9-85e1-a87b4ab3dcc3 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:05:50.755962 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 18/34] 10.222.0.60 () {60 vars in 1131 bytes} [Wed Sep 21 12:05:50 2022] POST /identity/v3/roles => generated 219 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:05:50.756668 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536fafc5-2c80-4feb-8de7-81ab3cb081a6 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:05:50.803347 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:05:50.822003 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdac25-edca-4e2a-b8ca-28cb7806416f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:05:50.827328 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdac25-edca-4e2a-b8ca-28cb7806416f None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:50.827838 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdac25-edca-4e2a-b8ca-28cb7806416f None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:50.828364 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdac25-edca-4e2a-b8ca-28cb7806416f None admin] PATH_INFO: `/v3/users/5ede9eacb91d469ab92c14848276a5bb` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:50.830746 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bdac25-edca-4e2a-b8ca-28cb7806416f None admin] RBAC: Authorizing `identity:get_user(user_id=5ede9eacb91d469ab92c14848276a5bb)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:05:50.832645 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bdac25-edca-4e2a-b8ca-28cb7806416f None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:05:50.834612 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 17/35] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:05:50 2022] GET /identity/v3/users/5ede9eacb91d469ab92c14848276a5bb => generated 247 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:05:50.837776 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdac25-edca-4e2a-b8ca-28cb7806416f None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:05:50.945412 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536fafc5-2c80-4feb-8de7-81ab3cb081a6 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:05:50.987592 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3fda5-e7cc-43a3-bb20-4ff822d0ed39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:05:50.988223 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3fda5-e7cc-43a3-bb20-4ff822d0ed39 None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:50.988505 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3fda5-e7cc-43a3-bb20-4ff822d0ed39 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:50.988782 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3fda5-e7cc-43a3-bb20-4ff822d0ed39 None admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:50.989448 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a3fda5-e7cc-43a3-bb20-4ff822d0ed39 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:05:50.991097 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a3fda5-e7cc-43a3-bb20-4ff822d0ed39 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:05:51.000796 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdac25-edca-4e2a-b8ca-28cb7806416f None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:05:51.026754 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:05:51.042791 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 19/36] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Sep 21 12:05:50 2022] POST /identity/v3/projects => generated 301 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:05:51.043641 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3fda5-e7cc-43a3-bb20-4ff822d0ed39 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:05:51.045817 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881fbca0-d44c-48c3-a37d-aa9e6006ca94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:05:51.046660 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881fbca0-d44c-48c3-a37d-aa9e6006ca94 None admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:51.047127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881fbca0-d44c-48c3-a37d-aa9e6006ca94 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:51.047604 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881fbca0-d44c-48c3-a37d-aa9e6006ca94 None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:51.048611 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881fbca0-d44c-48c3-a37d-aa9e6006ca94 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:05:51.050709 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881fbca0-d44c-48c3-a37d-aa9e6006ca94 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:05:51.161831 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3fda5-e7cc-43a3-bb20-4ff822d0ed39 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:05:51.180579 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 18/37] 10.222.0.60 () {60 vars in 1131 bytes} [Wed Sep 21 12:05:50 2022] POST /identity/v3/roles => generated 225 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:05:51.182088 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882b6f4-17c8-4233-baef-85c1673dfd3a None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:51.182431 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882b6f4-17c8-4233-baef-85c1673dfd3a None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:51.182723 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882b6f4-17c8-4233-baef-85c1673dfd3a None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:51.184240 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 19/38] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:05:51.190114 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cded779-41ee-4e87-ad13-68b73753224d None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:51.190461 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cded779-41ee-4e87-ad13-68b73753224d None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:51.190713 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cded779-41ee-4e87-ad13-68b73753224d None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:51.192160 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 20/39] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:05:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:05:51.193542 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c42ac-8a2b-4eb0-b1e3-2780d66f3cbf None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:51.193836 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c42ac-8a2b-4eb0-b1e3-2780d66f3cbf None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:51.194116 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c42ac-8a2b-4eb0-b1e3-2780d66f3cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:51.210509 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3860d2f2-f2c1-44ce-bd44-7860d8c63472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:05:51.211608 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860d2f2-f2c1-44ce-bd44-7860d8c63472 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:51.212124 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860d2f2-f2c1-44ce-bd44-7860d8c63472 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:51.212619 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3860d2f2-f2c1-44ce-bd44-7860d8c63472 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:51.214021 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3860d2f2-f2c1-44ce-bd44-7860d8c63472 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:05:51.215625 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3860d2f2-f2c1-44ce-bd44-7860d8c63472 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:05:51.218186 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 20/40] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:05:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:05:51.219539 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda457e0-1e53-4c12-95a5-984bf182a09d None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:51.219826 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda457e0-1e53-4c12-95a5-984bf182a09d None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:51.220103 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda457e0-1e53-4c12-95a5-984bf182a09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:51.241469 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-fda457e0-1e53-4c12-95a5-984bf182a09d None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:05:51.243186 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-fda457e0-1e53-4c12-95a5-984bf182a09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:05:51.321352 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:05:51.329611 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 21/41] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:05:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:05:51.330217 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda457e0-1e53-4c12-95a5-984bf182a09d None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:05:51.336689 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-ff6c42ac-8a2b-4eb0-b1e3-2780d66f3cbf None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:05:51.338351 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-ff6c42ac-8a2b-4eb0-b1e3-2780d66f3cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:05:51.400955 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:05:51.425713 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 21/42] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:05:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:05:51.462561 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda457e0-1e53-4c12-95a5-984bf182a09d None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:05:51.500315 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f954654-816f-4a90-bc2c-2b903a15e76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:05:51.500980 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f954654-816f-4a90-bc2c-2b903a15e76d None admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:51.501258 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f954654-816f-4a90-bc2c-2b903a15e76d None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:51.501556 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f954654-816f-4a90-bc2c-2b903a15e76d None admin] PATH_INFO: `/v3/domains/default/users/5ede9eacb91d469ab92c14848276a5bb/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:51.503550 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f954654-816f-4a90-bc2c-2b903a15e76d None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=5ede9eacb91d469ab92c14848276a5bb, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:05:51.504993 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f954654-816f-4a90-bc2c-2b903a15e76d None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:05:51.521527 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 22/43] 10.222.0.60 () {58 vars in 1361 bytes} [Wed Sep 21 12:05:51 2022] PUT /identity/v3/domains/default/users/5ede9eacb91d469ab92c14848276a5bb/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:05:51.603002 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c42ac-8a2b-4eb0-b1e3-2780d66f3cbf None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:05:51.705378 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f954654-816f-4a90-bc2c-2b903a15e76d None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:05:51.721998 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c42ac-8a2b-4eb0-b1e3-2780d66f3cbf None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:05:51.760504 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce47a0-a6ea-4b0f-8145-ec78e669862a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:05:51.761472 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce47a0-a6ea-4b0f-8145-ec78e669862a None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:51.761907 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce47a0-a6ea-4b0f-8145-ec78e669862a None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:51.762319 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce47a0-a6ea-4b0f-8145-ec78e669862a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:51.764233 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce47a0-a6ea-4b0f-8145-ec78e669862a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:05:51.766485 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce47a0-a6ea-4b0f-8145-ec78e669862a None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:05:51.768295 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 22/44] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:05:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:05:51.773555 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce47a0-a6ea-4b0f-8145-ec78e669862a None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:05:51.778229 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:05:51.828093 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f954654-816f-4a90-bc2c-2b903a15e76d None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:05:51.831878 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:05:51.865116 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf2ae9-d351-4fe4-9990-4c2673361b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:05:51.865734 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf2ae9-d351-4fe4-9990-4c2673361b14 None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:51.866018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf2ae9-d351-4fe4-9990-4c2673361b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:51.866295 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf2ae9-d351-4fe4-9990-4c2673361b14 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:51.867011 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bf2ae9-d351-4fe4-9990-4c2673361b14 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:05:51.868409 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bf2ae9-d351-4fe4-9990-4c2673361b14 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:05:51.883573 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce47a0-a6ea-4b0f-8145-ec78e669862a None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:05:51.884928 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 23/45] 10.222.0.60 () {60 vars in 1131 bytes} [Wed Sep 21 12:05:51 2022] POST /identity/v3/roles => generated 223 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:05:51.926463 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5314c90-3cd0-47f9-b34b-30f3f076326b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:05:51.927109 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5314c90-3cd0-47f9-b34b-30f3f076326b None admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:51.927405 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5314c90-3cd0-47f9-b34b-30f3f076326b None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:51.927673 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5314c90-3cd0-47f9-b34b-30f3f076326b None admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:51.928343 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5314c90-3cd0-47f9-b34b-30f3f076326b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:05:51.929832 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5314c90-3cd0-47f9-b34b-30f3f076326b None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:05:51.970390 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 23/46] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Sep 21 12:05:51 2022] POST /identity/v3/projects => generated 312 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:05:53.697133 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a320a9-6489-490a-adcb-eae9c5210792 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:53.697655 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a320a9-6489-490a-adcb-eae9c5210792 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:53.697739 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a320a9-6489-490a-adcb-eae9c5210792 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:53.699070 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 24/47] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:05:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:05:53.705024 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749504d2-a56c-440c-8539-6d5a6246fb1d None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:53.705457 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749504d2-a56c-440c-8539-6d5a6246fb1d None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:53.705592 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749504d2-a56c-440c-8539-6d5a6246fb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:53.724434 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-749504d2-a56c-440c-8539-6d5a6246fb1d None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:05:53.725642 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-749504d2-a56c-440c-8539-6d5a6246fb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:05:53.793438 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 24/48] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:05:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:05:54.065364 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a320a9-6489-490a-adcb-eae9c5210792 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:05:54.127349 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4339231-5f8e-483b-bce0-f161e0c96644 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:54.127627 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4339231-5f8e-483b-bce0-f161e0c96644 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:54.127899 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4339231-5f8e-483b-bce0-f161e0c96644 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:54.129231 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 25/49] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:05:54.133998 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d643d-964c-4d5b-973f-643b6272812a None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:54.134284 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d643d-964c-4d5b-973f-643b6272812a None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:54.134589 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d643d-964c-4d5b-973f-643b6272812a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:54.152659 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-438d643d-964c-4d5b-973f-643b6272812a None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:05:54.154414 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-438d643d-964c-4d5b-973f-643b6272812a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:05:54.172564 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a320a9-6489-490a-adcb-eae9c5210792 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:05:54.182089 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:05:54.191167 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:05:54.209284 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe69be-e9db-4248-af7a-d558b81a2baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:05:54.209909 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe69be-e9db-4248-af7a-d558b81a2baf None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:54.210189 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe69be-e9db-4248-af7a-d558b81a2baf None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:54.210499 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe69be-e9db-4248-af7a-d558b81a2baf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:54.221431 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe69be-e9db-4248-af7a-d558b81a2baf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:05:54.224271 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 26/50] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:05:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:05:54.226512 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-68fe69be-e9db-4248-af7a-d558b81a2baf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:05:54.226512 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:05:54.226512 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:05:54.226512 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:05:54.226512 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:05:54.226512 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:05:54.226512 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:05:54.226512 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:05:54.226512 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:05:54.226512 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:05:54.226512 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:05:54.226512 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:05:54.226512 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:05:54.226512 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:05:54.226512 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:05:54.226512 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:05:54.227374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:05:54.227374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:05:54.227374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:05:54.227374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:05:54.227374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:05:54.227374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:05:54.227374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:05:54.227374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:05:54.227374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:05:54.227374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:05:54.227374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:05:54.227374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:05:54.227374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:05:54.227374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:05:54.227374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:05:54.227374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:05:54.228145 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:05:54.228145 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:05:54.228145 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:05:54.228145 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:05:54.228145 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:05:54.228145 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:05:54.228145 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:05:54.228145 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:05:54.228145 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:05:54.228145 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:05:54.228145 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:05:54.228145 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:05:54.228145 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 25/51] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Sep 21 12:05:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:05:54.235159 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d643d-964c-4d5b-973f-643b6272812a None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:05:54.332557 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d643d-964c-4d5b-973f-643b6272812a None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:05:54.365905 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab008e0-b5ac-4e78-a311-dbb00a4a0a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:05:54.366549 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab008e0-b5ac-4e78-a311-dbb00a4a0a67 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:54.366836 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab008e0-b5ac-4e78-a311-dbb00a4a0a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:54.367115 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab008e0-b5ac-4e78-a311-dbb00a4a0a67 None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:54.367778 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab008e0-b5ac-4e78-a311-dbb00a4a0a67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:05:54.368084 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab008e0-b5ac-4e78-a311-dbb00a4a0a67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:05:54.369472 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab008e0-b5ac-4e78-a311-dbb00a4a0a67 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:05:54.386210 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 27/52] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:05:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:05:54.392235 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe69be-e9db-4248-af7a-d558b81a2baf None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:05:54.493702 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab008e0-b5ac-4e78-a311-dbb00a4a0a67 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:05:54.494069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe69be-e9db-4248-af7a-d558b81a2baf None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:05:54.521231 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:05:54.530495 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea86bc-1695-4217-8a31-7ea03c51ddef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:05:54.531128 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea86bc-1695-4217-8a31-7ea03c51ddef None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:54.531443 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea86bc-1695-4217-8a31-7ea03c51ddef None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:54.531724 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea86bc-1695-4217-8a31-7ea03c51ddef None admin] PATH_INFO: `/v3/users/5ede9eacb91d469ab92c14848276a5bb` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:54.532866 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea86bc-1695-4217-8a31-7ea03c51ddef None admin] RBAC: Authorizing `identity:get_user(user_id=5ede9eacb91d469ab92c14848276a5bb)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:05:54.534330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea86bc-1695-4217-8a31-7ea03c51ddef None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:05:54.536147 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 26/53] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:05:54 2022] GET /identity/v3/users/5ede9eacb91d469ab92c14848276a5bb => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:05:54.541414 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea86bc-1695-4217-8a31-7ea03c51ddef None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:05:54.590187 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:05:54.598709 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab008e0-b5ac-4e78-a311-dbb00a4a0a67 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:05:54.632718 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c5d38-5e96-4c1d-9181-769cda94f76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:05:54.633353 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c5d38-5e96-4c1d-9181-769cda94f76e None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:54.633635 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c5d38-5e96-4c1d-9181-769cda94f76e None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:54.634009 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c5d38-5e96-4c1d-9181-769cda94f76e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:54.635078 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0c5d38-5e96-4c1d-9181-769cda94f76e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:05:54.636534 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0c5d38-5e96-4c1d-9181-769cda94f76e None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:05:54.638099 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 28/54] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:05:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:05:54.643844 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c5d38-5e96-4c1d-9181-769cda94f76e None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:05:54.645421 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea86bc-1695-4217-8a31-7ea03c51ddef None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:05:54.686039 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7b0f1-0aa4-44b6-abec-d88ae0da9d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:05:54.686699 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7b0f1-0aa4-44b6-abec-d88ae0da9d76 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:54.686983 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7b0f1-0aa4-44b6-abec-d88ae0da9d76 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:54.687260 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7b0f1-0aa4-44b6-abec-d88ae0da9d76 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:54.688425 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d7b0f1-0aa4-44b6-abec-d88ae0da9d76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:05:54.689892 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d7b0f1-0aa4-44b6-abec-d88ae0da9d76 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:05:54.691490 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 27/55] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:05:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:05:54.697233 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7b0f1-0aa4-44b6-abec-d88ae0da9d76 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:05:54.744530 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:05:54.752372 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c5d38-5e96-4c1d-9181-769cda94f76e None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:05:54.787330 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec3a14-b091-4d4d-bda0-ad4b5264d041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:05:54.787971 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec3a14-b091-4d4d-bda0-ad4b5264d041 None admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:54.788256 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec3a14-b091-4d4d-bda0-ad4b5264d041 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:54.788531 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec3a14-b091-4d4d-bda0-ad4b5264d041 None admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:54.789205 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec3a14-b091-4d4d-bda0-ad4b5264d041 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:05:54.790735 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec3a14-b091-4d4d-bda0-ad4b5264d041 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:05:54.819723 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 29/56] 10.222.0.60 () {60 vars in 1140 bytes} [Wed Sep 21 12:05:54 2022] POST /identity/v3/projects => generated 298 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:05:54.909421 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7b0f1-0aa4-44b6-abec-d88ae0da9d76 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:05:54.926013 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:05:54.948898 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be340ec-5807-472c-973d-ed713f012915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:05:54.949521 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be340ec-5807-472c-973d-ed713f012915 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:54.949805 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be340ec-5807-472c-973d-ed713f012915 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:54.950084 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be340ec-5807-472c-973d-ed713f012915 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:54.951413 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be340ec-5807-472c-973d-ed713f012915 None admin] RBAC: Adding query filter params (role.id=72c80b472acb462ebadd86463efe91f7, scope.domain.id=default, user.id=5ede9eacb91d469ab92c14848276a5bb) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:05:54.951729 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be340ec-5807-472c-973d-ed713f012915 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:05:54.953228 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be340ec-5807-472c-973d-ed713f012915 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:05:54.960168 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 28/57] 10.222.0.60 () {56 vars in 1322 bytes} [Wed Sep 21 12:05:54 2022] GET /identity/v3/role_assignments?user.id=5ede9eacb91d469ab92c14848276a5bb&scope.domain.id=default&role.id=72c80b472acb462ebadd86463efe91f7 => generated 530 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:05:57.011889 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710772c4-5623-44d5-86f2-7eabe6b790bd None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:57.012383 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710772c4-5623-44d5-86f2-7eabe6b790bd None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:57.012383 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710772c4-5623-44d5-86f2-7eabe6b790bd None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:57.014312 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 30/58] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:05:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:05:57.019777 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8db6bc-1768-45f9-a3f6-a06a2068a71f None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:57.020198 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8db6bc-1768-45f9-a3f6-a06a2068a71f None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:57.020338 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8db6bc-1768-45f9-a3f6-a06a2068a71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:57.038003 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-9d8db6bc-1768-45f9-a3f6-a06a2068a71f None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:05:57.039252 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-9d8db6bc-1768-45f9-a3f6-a06a2068a71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:05:57.103732 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 29/59] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:05:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:05:57.372159 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710772c4-5623-44d5-86f2-7eabe6b790bd None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:05:57.471099 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710772c4-5623-44d5-86f2-7eabe6b790bd None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:05:57.503911 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2892d-7058-44e7-bce8-ac0a77dcb5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:05:57.504528 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2892d-7058-44e7-bce8-ac0a77dcb5ea None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:57.504803 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2892d-7058-44e7-bce8-ac0a77dcb5ea None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:57.505072 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2892d-7058-44e7-bce8-ac0a77dcb5ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:57.506158 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a2892d-7058-44e7-bce8-ac0a77dcb5ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:05:57.507617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a2892d-7058-44e7-bce8-ac0a77dcb5ea None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:05:57.509165 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 31/60] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:05:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:05:57.514756 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8db6bc-1768-45f9-a3f6-a06a2068a71f None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:05:57.613325 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8db6bc-1768-45f9-a3f6-a06a2068a71f None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:05:57.622281 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:05:57.647543 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a8d23-fdf2-438e-801c-303ed6ccc097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:05:57.648152 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a8d23-fdf2-438e-801c-303ed6ccc097 None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:05:57.648435 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a8d23-fdf2-438e-801c-303ed6ccc097 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:05:57.648712 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a8d23-fdf2-438e-801c-303ed6ccc097 None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:05:57.649370 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a8d23-fdf2-438e-801c-303ed6ccc097 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:05:57.650848 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a8d23-fdf2-438e-801c-303ed6ccc097 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:05:57.677757 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 30/61] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Sep 21 12:05:57 2022] POST /identity/v3/users => generated 275 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:06:00.955403 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd0eac-46ea-4ac7-9cb8-899644a0eb24 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:00.955403 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd0eac-46ea-4ac7-9cb8-899644a0eb24 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:00.955403 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd0eac-46ea-4ac7-9cb8-899644a0eb24 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:00.955403 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 32/62] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:00.960843 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd547509-8606-4c30-9923-285a2c2a9dad None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:00.961671 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd547509-8606-4c30-9923-285a2c2a9dad None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:00.962150 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd547509-8606-4c30-9923-285a2c2a9dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:00.986537 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-fd547509-8606-4c30-9923-285a2c2a9dad None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:00.988134 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-fd547509-8606-4c30-9923-285a2c2a9dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:01.082166 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 31/63] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:06:01.218125 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f8c38-e804-4f64-a4aa-2a13262f9b5b None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:01.218734 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f8c38-e804-4f64-a4aa-2a13262f9b5b None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:01.219227 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f8c38-e804-4f64-a4aa-2a13262f9b5b None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:01.220782 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 33/64] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:01.237031 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f8d90-9b62-4a41-8702-28ed2f9cefc3 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:01.237615 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f8d90-9b62-4a41-8702-28ed2f9cefc3 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:01.238083 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f8d90-9b62-4a41-8702-28ed2f9cefc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:01.263902 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa6f9a-28d9-449f-9ada-b0bf02b8b6fc None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:01.264512 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa6f9a-28d9-449f-9ada-b0bf02b8b6fc None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:01.265226 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa6f9a-28d9-449f-9ada-b0bf02b8b6fc None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:01.266790 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 34/65] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:06:01.268246 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-b91f8d90-9b62-4a41-8702-28ed2f9cefc3 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:01.269644 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b91f8d90-9b62-4a41-8702-28ed2f9cefc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:01.272092 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b20a60-9600-4718-bd44-518c531cd14a None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:01.272592 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b20a60-9600-4718-bd44-518c531cd14a None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:01.273091 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b20a60-9600-4718-bd44-518c531cd14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:01.293517 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-f1b20a60-9600-4718-bd44-518c531cd14a None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:01.296825 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-f1b20a60-9600-4718-bd44-518c531cd14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:01.313253 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:01.393736 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 32/66] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:06:01.422475 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 35/67] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 12:06:01.427233 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f8d90-9b62-4a41-8702-28ed2f9cefc3 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:01.464597 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:01.542159 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f8d90-9b62-4a41-8702-28ed2f9cefc3 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:01.582248 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad6828-65f0-4acb-89e1-4fd527aa89a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:01.582998 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad6828-65f0-4acb-89e1-4fd527aa89a6 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:01.583283 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad6828-65f0-4acb-89e1-4fd527aa89a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:01.583553 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad6828-65f0-4acb-89e1-4fd527aa89a6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:01.596107 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad6828-65f0-4acb-89e1-4fd527aa89a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:01.600941 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-40ad6828-65f0-4acb-89e1-4fd527aa89a6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 12:06:01.600941 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:01.600941 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:01.600941 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:01.600941 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:01.600941 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:01.600941 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:01.600941 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:01.600941 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:01.600941 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:01.600941 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:01.600941 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:01.600941 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:01.600941 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:01.600941 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:01.600941 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:01.601770 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:01.601770 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:01.601770 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:01.601770 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:01.601770 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:01.601770 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:01.601770 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:01.601770 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:01.601770 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:01.601770 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:01.601770 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:01.601770 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:01.601770 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:01.601770 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:01.601770 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:01.601770 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:01.602604 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:01.602604 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:01.602604 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:01.602604 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:01.602604 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:01.602604 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:01.602604 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:01.602604 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:01.602604 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:01.602604 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:01.602604 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 12:06:01.602604 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:06:01.602604 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 33/68] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:06:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:06:01.610523 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b20a60-9600-4718-bd44-518c531cd14a None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:01.685894 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210556c-7366-48e9-a341-58f7b749b634 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:01.686253 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210556c-7366-48e9-a341-58f7b749b634 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:01.686518 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210556c-7366-48e9-a341-58f7b749b634 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:01.688009 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 34/69] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:06:01.692232 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b210556c-7366-48e9-a341-58f7b749b634 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:01.755241 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b20a60-9600-4718-bd44-518c531cd14a None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:01.794156 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:01.797473 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf884f-76d7-4a14-b43d-d1e2c52bc92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:01.798354 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf884f-76d7-4a14-b43d-d1e2c52bc92d None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:01.798354 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf884f-76d7-4a14-b43d-d1e2c52bc92d None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:01.798660 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf884f-76d7-4a14-b43d-d1e2c52bc92d None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:01.799351 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf884f-76d7-4a14-b43d-d1e2c52bc92d None admin] RBAC: Adding query filter params (name=member) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:01.799632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf884f-76d7-4a14-b43d-d1e2c52bc92d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:01.801005 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf884f-76d7-4a14-b43d-d1e2c52bc92d None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:01.814404 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 36/70] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Sep 21 12:06:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:01.814404 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e8e81-94b2-4113-943d-e47c653b6c0e None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:01.814404 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e8e81-94b2-4113-943d-e47c653b6c0e None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:01.814404 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e8e81-94b2-4113-943d-e47c653b6c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:01.818262 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b210556c-7366-48e9-a341-58f7b749b634 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:01.825963 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:01.831834 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-0e9e8e81-94b2-4113-943d-e47c653b6c0e None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:01.833030 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-0e9e8e81-94b2-4113-943d-e47c653b6c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:01.856521 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe3e01-72cd-42f7-8885-23a5ff4b6b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:01.857153 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe3e01-72cd-42f7-8885-23a5ff4b6b5b None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:01.857431 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe3e01-72cd-42f7-8885-23a5ff4b6b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:01.857708 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe3e01-72cd-42f7-8885-23a5ff4b6b5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:01.867809 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe3e01-72cd-42f7-8885-23a5ff4b6b5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:01.873172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-99fe3e01-72cd-42f7-8885-23a5ff4b6b5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:06:01.873172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:01.873172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:01.873172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:01.873172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:01.873172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:01.873172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:01.873172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:01.873172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:01.873172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:01.873172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:01.873172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:01.873172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:01.873172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:01.873172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:01.873172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:01.874117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:01.874117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:01.874117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:01.874117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:01.874117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:01.874117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:01.874117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:01.874117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:01.874117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:01.874117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:01.874117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:01.874117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:01.874117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:01.874117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:01.874117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:01.874117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:01.874933 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:01.874933 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:01.874933 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:01.874933 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:01.874933 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:01.874933 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:01.874933 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:01.874933 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:01.874933 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:01.874933 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:01.874933 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:06:01.874933 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:06:01.874933 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 35/71] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Sep 21 12:06:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 12:06:01.875546 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe3e01-72cd-42f7-8885-23a5ff4b6b5b None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:01.904779 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 37/72] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:06:01.907318 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e8e81-94b2-4113-943d-e47c653b6c0e None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:01.982853 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe3e01-72cd-42f7-8885-23a5ff4b6b5b None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:02.010849 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e8e81-94b2-4113-943d-e47c653b6c0e None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:02.020557 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512dc84d-bb5b-44fc-b0d4-cf1bafeb9a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:02.021197 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512dc84d-bb5b-44fc-b0d4-cf1bafeb9a54 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:02.021470 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512dc84d-bb5b-44fc-b0d4-cf1bafeb9a54 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:02.021753 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512dc84d-bb5b-44fc-b0d4-cf1bafeb9a54 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:02.032986 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512dc84d-bb5b-44fc-b0d4-cf1bafeb9a54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:02.037907 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-512dc84d-bb5b-44fc-b0d4-cf1bafeb9a54 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 12:06:02.037907 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:02.037907 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:02.037907 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:02.037907 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:02.037907 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:02.037907 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:02.037907 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:02.037907 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:02.037907 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:02.037907 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:02.037907 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:02.037907 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:02.037907 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:02.037907 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:02.037907 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:02.038991 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:02.038991 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:02.038991 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:02.038991 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:02.038991 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:02.038991 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:02.038991 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:02.038991 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:02.038991 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:02.038991 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:02.038991 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:02.038991 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:02.038991 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:02.038991 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:02.038991 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:02.038991 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:02.039928 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:02.039928 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:02.039928 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:02.039928 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:02.039928 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:02.039928 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:02.039928 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:02.039928 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:02.039928 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:02.039928 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:02.039928 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 12:06:02.039928 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:06:02.039928 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 36/73] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Sep 21 12:06:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:06:02.040718 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655afa55-4692-49ef-9222-8c1d93bfb799 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:02.040718 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655afa55-4692-49ef-9222-8c1d93bfb799 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:02.041115 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655afa55-4692-49ef-9222-8c1d93bfb799 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:02.042909 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 37/74] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:02.048335 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655afa55-4692-49ef-9222-8c1d93bfb799 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:02.052769 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:02.056893 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2575e5-a7c7-430c-877e-aed3557cea3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:02.057543 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2575e5-a7c7-430c-877e-aed3557cea3c None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:02.057841 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2575e5-a7c7-430c-877e-aed3557cea3c None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:02.058159 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2575e5-a7c7-430c-877e-aed3557cea3c None admin] PATH_INFO: `/v3/users/96c3d608c85140b1bcd4f716a3c47b7a` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:02.061436 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:02.074438 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2575e5-a7c7-430c-877e-aed3557cea3c None admin] RBAC: Authorizing `identity:get_user(user_id=96c3d608c85140b1bcd4f716a3c47b7a)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:02.076010 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2575e5-a7c7-430c-877e-aed3557cea3c None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:02.077723 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 38/75] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:06:01 2022] GET /identity/v3/users/96c3d608c85140b1bcd4f716a3c47b7a => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:02.083265 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2575e5-a7c7-430c-877e-aed3557cea3c None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:02.172812 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655afa55-4692-49ef-9222-8c1d93bfb799 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:02.197051 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2575e5-a7c7-430c-877e-aed3557cea3c None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:02.208540 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d760a-3b73-4b27-bb5e-da2640b87180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:02.209152 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d760a-3b73-4b27-bb5e-da2640b87180 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:02.209435 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d760a-3b73-4b27-bb5e-da2640b87180 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:02.209712 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d760a-3b73-4b27-bb5e-da2640b87180 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:02.210404 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d760a-3b73-4b27-bb5e-da2640b87180 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:02.210712 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d760a-3b73-4b27-bb5e-da2640b87180 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:02.212113 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d760a-3b73-4b27-bb5e-da2640b87180 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:02.220968 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 38/76] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:06:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:02.223750 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3fb35-e7c7-4199-9298-32383705ca49 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:02.224043 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3fb35-e7c7-4199-9298-32383705ca49 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:02.224442 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3fb35-e7c7-4199-9298-32383705ca49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:02.233200 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8b466-c269-4120-8f35-c1bd536f6d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:02.233816 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8b466-c269-4120-8f35-c1bd536f6d76 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:02.234102 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8b466-c269-4120-8f35-c1bd536f6d76 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:02.234405 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8b466-c269-4120-8f35-c1bd536f6d76 None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:02.235075 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8b466-c269-4120-8f35-c1bd536f6d76 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:02.235382 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8b466-c269-4120-8f35-c1bd536f6d76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:02.236754 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8b466-c269-4120-8f35-c1bd536f6d76 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:02.243465 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-14b3fb35-e7c7-4199-9298-32383705ca49 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:02.244686 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 39/77] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:06:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:02.244783 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-14b3fb35-e7c7-4199-9298-32383705ca49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:02.245484 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8b466-c269-4120-8f35-c1bd536f6d76 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:02.304935 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:02.306471 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:02.312785 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 39/78] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:06:02.313599 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3fb35-e7c7-4199-9298-32383705ca49 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:02.363153 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8b466-c269-4120-8f35-c1bd536f6d76 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:02.404169 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c5006c-574d-4b1f-a2d0-e993dc1e6ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:02.405117 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c5006c-574d-4b1f-a2d0-e993dc1e6ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:02.405570 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c5006c-574d-4b1f-a2d0-e993dc1e6ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:02.405849 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c5006c-574d-4b1f-a2d0-e993dc1e6ab9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:02.415640 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3fb35-e7c7-4199-9298-32383705ca49 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:02.451651 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad6a52d-1006-4310-97d5-f2a117dffc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:02.452350 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6a52d-1006-4310-97d5-f2a117dffc8f None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:02.452638 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6a52d-1006-4310-97d5-f2a117dffc8f None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:02.452916 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6a52d-1006-4310-97d5-f2a117dffc8f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:02.454038 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad6a52d-1006-4310-97d5-f2a117dffc8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:02.455518 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad6a52d-1006-4310-97d5-f2a117dffc8f None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:02.457273 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 40/79] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:06:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:02.462557 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad6a52d-1006-4310-97d5-f2a117dffc8f None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:02.477718 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c5006c-574d-4b1f-a2d0-e993dc1e6ab9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:02.479228 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c5006c-574d-4b1f-a2d0-e993dc1e6ab9 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:02.536972 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:02.545402 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:02.584430 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad6a52d-1006-4310-97d5-f2a117dffc8f None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:02.595169 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 40/80] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:06:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 12:06:02.596122 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c5006c-574d-4b1f-a2d0-e993dc1e6ab9 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:02.620245 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e03bc-fb42-4e0a-bbd7-f1fcd1a3ab00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:02.620880 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e03bc-fb42-4e0a-bbd7-f1fcd1a3ab00 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:02.621159 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e03bc-fb42-4e0a-bbd7-f1fcd1a3ab00 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:02.621440 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e03bc-fb42-4e0a-bbd7-f1fcd1a3ab00 None admin] PATH_INFO: `/v3/users/5ede9eacb91d469ab92c14848276a5bb` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:02.623179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e03bc-fb42-4e0a-bbd7-f1fcd1a3ab00 None admin] RBAC: Authorizing `identity:get_user(user_id=5ede9eacb91d469ab92c14848276a5bb)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:02.624643 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e03bc-fb42-4e0a-bbd7-f1fcd1a3ab00 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:02.626218 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 41/81] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:06:02 2022] GET /identity/v3/users/5ede9eacb91d469ab92c14848276a5bb => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:02.626996 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e03bc-fb42-4e0a-bbd7-f1fcd1a3ab00 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:02.698633 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c5006c-574d-4b1f-a2d0-e993dc1e6ab9 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:02.726983 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e03bc-fb42-4e0a-bbd7-f1fcd1a3ab00 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:02.732626 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d1d0b-435d-4551-bc0a-c365ea05dbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:02.733262 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d1d0b-435d-4551-bc0a-c365ea05dbed None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:02.733542 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d1d0b-435d-4551-bc0a-c365ea05dbed None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:02.733817 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d1d0b-435d-4551-bc0a-c365ea05dbed None admin] PATH_INFO: `/v3/users/96c3d608c85140b1bcd4f716a3c47b7a` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:02.734966 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d1d0b-435d-4551-bc0a-c365ea05dbed None admin] RBAC: Authorizing `identity:get_user(user_id=96c3d608c85140b1bcd4f716a3c47b7a)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:02.736418 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d1d0b-435d-4551-bc0a-c365ea05dbed None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:02.737988 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 41/82] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:06:02 2022] GET /identity/v3/users/96c3d608c85140b1bcd4f716a3c47b7a => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:02.737988 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d1d0b-435d-4551-bc0a-c365ea05dbed None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:02.757123 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:02.763778 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4bdc2-effb-4fc7-b4aa-3fb4a05eae34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:02.763946 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:02.765045 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4bdc2-effb-4fc7-b4aa-3fb4a05eae34 None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:02.765586 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4bdc2-effb-4fc7-b4aa-3fb4a05eae34 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:02.765911 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4bdc2-effb-4fc7-b4aa-3fb4a05eae34 None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:02.766591 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee4bdc2-effb-4fc7-b4aa-3fb4a05eae34 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:02.768056 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee4bdc2-effb-4fc7-b4aa-3fb4a05eae34 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:02.789306 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 42/83] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Sep 21 12:06:02 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:06:02.790111 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4bdc2-effb-4fc7-b4aa-3fb4a05eae34 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:02.855721 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d1d0b-435d-4551-bc0a-c365ea05dbed None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:02.893428 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e2139-23dd-4a50-b64d-4fea90b9ffdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:02.894240 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e2139-23dd-4a50-b64d-4fea90b9ffdc None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:02.894624 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e2139-23dd-4a50-b64d-4fea90b9ffdc None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:02.894962 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e2139-23dd-4a50-b64d-4fea90b9ffdc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:02.907162 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e2139-23dd-4a50-b64d-4fea90b9ffdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:02.912346 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-bd2e2139-23dd-4a50-b64d-4fea90b9ffdc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 12:06:02.912346 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:02.912346 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:02.912346 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:02.912346 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:02.912346 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:02.912346 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:02.912346 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:02.912346 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:02.912346 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:02.912346 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:02.912346 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:02.912346 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:02.912346 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:02.912346 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:02.912346 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:02.913290 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:02.913290 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:02.913290 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:02.913290 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:02.913290 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:02.913290 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:02.913290 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:02.913290 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:02.913290 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:02.913290 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:02.913290 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:02.913290 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:02.913290 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:02.913290 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:02.913290 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:02.913290 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:02.914060 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:02.914060 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:02.914060 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:02.914060 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:02.914060 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:02.914060 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:02.914060 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:02.914060 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:02.914060 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:02.914060 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:02.914060 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 12:06:02.914060 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:06:02.914060 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 42/84] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:06:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:06:02.915200 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e2139-23dd-4a50-b64d-4fea90b9ffdc None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:02.928002 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4bdc2-effb-4fc7-b4aa-3fb4a05eae34 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:02.966656 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725d86b-2703-4edd-90bb-81770820e2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:02.967403 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725d86b-2703-4edd-90bb-81770820e2de None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:02.967755 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725d86b-2703-4edd-90bb-81770820e2de None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:02.968103 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725d86b-2703-4edd-90bb-81770820e2de None admin] PATH_INFO: `/v3/projects/39342ea2ea9b45c8817058e7bed7c739` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:02.969377 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3725d86b-2703-4edd-90bb-81770820e2de None admin] RBAC: Authorizing `identity:get_project(project_id=39342ea2ea9b45c8817058e7bed7c739)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:02.971033 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3725d86b-2703-4edd-90bb-81770820e2de None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:02.972827 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 43/85] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:06:02 2022] GET /identity/v3/projects/39342ea2ea9b45c8817058e7bed7c739 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:02.974198 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725d86b-2703-4edd-90bb-81770820e2de None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:03.023217 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:03.041041 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e2139-23dd-4a50-b64d-4fea90b9ffdc None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:03.042726 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:03.082672 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2736a7-f809-4465-b2d4-ad696bb3497f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:03.083745 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2736a7-f809-4465-b2d4-ad696bb3497f None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:03.083745 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2736a7-f809-4465-b2d4-ad696bb3497f None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:03.083906 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2736a7-f809-4465-b2d4-ad696bb3497f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:03.108269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725d86b-2703-4edd-90bb-81770820e2de None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:03.150812 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e825e9-252f-4ae2-93dd-517f3e96b8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:03.151427 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e825e9-252f-4ae2-93dd-517f3e96b8fe None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:03.151765 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e825e9-252f-4ae2-93dd-517f3e96b8fe None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:03.152034 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e825e9-252f-4ae2-93dd-517f3e96b8fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:03.180961 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2736a7-f809-4465-b2d4-ad696bb3497f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:03.182843 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2736a7-f809-4465-b2d4-ad696bb3497f None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:03.235847 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e825e9-252f-4ae2-93dd-517f3e96b8fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:03.237457 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e825e9-252f-4ae2-93dd-517f3e96b8fe None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:03.276404 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:03.294814 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 43/86] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:06:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 12:06:03.295827 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2736a7-f809-4465-b2d4-ad696bb3497f None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:03.300361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:03.349568 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 44/87] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:06:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 12:06:03.350438 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e825e9-252f-4ae2-93dd-517f3e96b8fe None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:03.412839 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2736a7-f809-4465-b2d4-ad696bb3497f None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:03.451417 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da473d-a205-4573-93c9-34f37707e7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:03.452128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da473d-a205-4573-93c9-34f37707e7fd None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:03.452404 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da473d-a205-4573-93c9-34f37707e7fd None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:03.452680 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da473d-a205-4573-93c9-34f37707e7fd None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:03.453445 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50da473d-a205-4573-93c9-34f37707e7fd None admin] RBAC: Adding query filter params (name=member) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:03.453750 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50da473d-a205-4573-93c9-34f37707e7fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:03.455271 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50da473d-a205-4573-93c9-34f37707e7fd None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:03.460221 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e825e9-252f-4ae2-93dd-517f3e96b8fe None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:03.466084 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 44/88] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Sep 21 12:06:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:03.466903 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da473d-a205-4573-93c9-34f37707e7fd None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:03.499979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2afbe-3892-4e2d-a358-84f61e59249e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:03.500591 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2afbe-3892-4e2d-a358-84f61e59249e None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:03.500876 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2afbe-3892-4e2d-a358-84f61e59249e None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:03.501148 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2afbe-3892-4e2d-a358-84f61e59249e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:03.502010 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e2afbe-3892-4e2d-a358-84f61e59249e None admin] RBAC: Adding query filter params (role.id=9712f7b332bf484689b3706721ab6311, scope.project.id=39342ea2ea9b45c8817058e7bed7c739, user.id=96c3d608c85140b1bcd4f716a3c47b7a) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:03.502402 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e2afbe-3892-4e2d-a358-84f61e59249e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:03.503858 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e2afbe-3892-4e2d-a358-84f61e59249e None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:03.510239 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 45/89] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:06:03 2022] GET /identity/v3/role_assignments?user.id=96c3d608c85140b1bcd4f716a3c47b7a&scope.project.id=39342ea2ea9b45c8817058e7bed7c739&role.id=9712f7b332bf484689b3706721ab6311 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:03.519356 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2afbe-3892-4e2d-a358-84f61e59249e None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:03.524151 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:03.573340 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:03.601477 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da473d-a205-4573-93c9-34f37707e7fd None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:03.681264 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b90f9c-5fce-4bc7-ba54-d5ee5489e6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:03.681842 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b90f9c-5fce-4bc7-ba54-d5ee5489e6d2 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:03.682128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b90f9c-5fce-4bc7-ba54-d5ee5489e6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:03.682431 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b90f9c-5fce-4bc7-ba54-d5ee5489e6d2 None admin] PATH_INFO: `/v3/projects/39342ea2ea9b45c8817058e7bed7c739` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:03.685339 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b90f9c-5fce-4bc7-ba54-d5ee5489e6d2 None admin] RBAC: Authorizing `identity:get_project(project_id=39342ea2ea9b45c8817058e7bed7c739)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:03.686873 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b90f9c-5fce-4bc7-ba54-d5ee5489e6d2 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:03.688798 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 45/90] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:06:03 2022] GET /identity/v3/projects/39342ea2ea9b45c8817058e7bed7c739 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:03.689411 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b90f9c-5fce-4bc7-ba54-d5ee5489e6d2 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:03.761272 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2afbe-3892-4e2d-a358-84f61e59249e None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:03.809747 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a69b25-8b66-412d-92e5-a198efe031d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:03.810416 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a69b25-8b66-412d-92e5-a198efe031d0 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:03.810704 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a69b25-8b66-412d-92e5-a198efe031d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:03.810975 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a69b25-8b66-412d-92e5-a198efe031d0 None admin] PATH_INFO: `/v3/projects/39342ea2ea9b45c8817058e7bed7c739` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:03.812134 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a69b25-8b66-412d-92e5-a198efe031d0 None admin] RBAC: Authorizing `identity:get_project(project_id=39342ea2ea9b45c8817058e7bed7c739)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:03.813578 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a69b25-8b66-412d-92e5-a198efe031d0 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:03.815429 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 46/91] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:06:03 2022] GET /identity/v3/projects/39342ea2ea9b45c8817058e7bed7c739 => generated 298 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:03.816091 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a69b25-8b66-412d-92e5-a198efe031d0 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:03.910215 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b90f9c-5fce-4bc7-ba54-d5ee5489e6d2 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:03.919003 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:03.933812 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a69b25-8b66-412d-92e5-a198efe031d0 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:03.947928 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:03.976916 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae492a-b85e-48c0-8bf1-81c09fd7f1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:03.978108 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae492a-b85e-48c0-8bf1-81c09fd7f1e2 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:03.978622 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae492a-b85e-48c0-8bf1-81c09fd7f1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:03.979172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae492a-b85e-48c0-8bf1-81c09fd7f1e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:03.980110 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdae492a-b85e-48c0-8bf1-81c09fd7f1e2 None admin] RBAC: Adding query filter params (role.id=72c80b472acb462ebadd86463efe91f7, scope.project.id=39342ea2ea9b45c8817058e7bed7c739, user.id=5ede9eacb91d469ab92c14848276a5bb) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:03.980621 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdae492a-b85e-48c0-8bf1-81c09fd7f1e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:03.982848 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdae492a-b85e-48c0-8bf1-81c09fd7f1e2 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:03.989320 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 47/92] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:06:03 2022] GET /identity/v3/role_assignments?user.id=5ede9eacb91d469ab92c14848276a5bb&scope.project.id=39342ea2ea9b45c8817058e7bed7c739&role.id=72c80b472acb462ebadd86463efe91f7 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:03.990457 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae492a-b85e-48c0-8bf1-81c09fd7f1e2 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:04.015457 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa4120-b23f-42d9-951e-6a955695be02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:04.016136 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa4120-b23f-42d9-951e-6a955695be02 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:04.016424 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa4120-b23f-42d9-951e-6a955695be02 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:04.016706 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa4120-b23f-42d9-951e-6a955695be02 None admin] PATH_INFO: `/v3/users/96c3d608c85140b1bcd4f716a3c47b7a` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:04.018051 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa4120-b23f-42d9-951e-6a955695be02 None admin] RBAC: Authorizing `identity:get_user(user_id=96c3d608c85140b1bcd4f716a3c47b7a)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:04.019563 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa4120-b23f-42d9-951e-6a955695be02 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:04.021497 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 46/93] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:06:03 2022] GET /identity/v3/users/96c3d608c85140b1bcd4f716a3c47b7a => generated 275 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:04.026654 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa4120-b23f-42d9-951e-6a955695be02 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:04.114385 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae492a-b85e-48c0-8bf1-81c09fd7f1e2 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:04.156109 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f1466-d6d6-41f0-acab-8583f6deb341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:04.157084 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f1466-d6d6-41f0-acab-8583f6deb341 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:04.157564 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f1466-d6d6-41f0-acab-8583f6deb341 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:04.158151 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f1466-d6d6-41f0-acab-8583f6deb341 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:04.159298 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f1466-d6d6-41f0-acab-8583f6deb341 None admin] RBAC: Adding query filter params (role.id=173d0e93641b4882934b75f256b38534, scope.project.id=39342ea2ea9b45c8817058e7bed7c739, user.id=96c3d608c85140b1bcd4f716a3c47b7a) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:04.159859 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f1466-d6d6-41f0-acab-8583f6deb341 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:04.162203 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f1466-d6d6-41f0-acab-8583f6deb341 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:04.169434 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 48/94] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:06:03 2022] GET /identity/v3/role_assignments?user.id=96c3d608c85140b1bcd4f716a3c47b7a&scope.project.id=39342ea2ea9b45c8817058e7bed7c739&role.id=173d0e93641b4882934b75f256b38534 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:04.277004 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa4120-b23f-42d9-951e-6a955695be02 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:04.322746 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494c3d5-cd64-4b92-9195-ca6833d1a13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:04.323376 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494c3d5-cd64-4b92-9195-ca6833d1a13e None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:04.323658 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494c3d5-cd64-4b92-9195-ca6833d1a13e None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:04.323928 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494c3d5-cd64-4b92-9195-ca6833d1a13e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:04.386257 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:04.414478 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494c3d5-cd64-4b92-9195-ca6833d1a13e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:04.415973 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494c3d5-cd64-4b92-9195-ca6833d1a13e None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:04.551292 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 47/95] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:06:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 21 12:06:04.558802 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f1466-d6d6-41f0-acab-8583f6deb341 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:04.580242 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:04.667523 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f1466-d6d6-41f0-acab-8583f6deb341 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:04.708028 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e59b5-8844-4c37-bbf8-5e873aff4391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:04.708670 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e59b5-8844-4c37-bbf8-5e873aff4391 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:04.708955 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e59b5-8844-4c37-bbf8-5e873aff4391 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:04.709296 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e59b5-8844-4c37-bbf8-5e873aff4391 None admin] PATH_INFO: `/v3/projects/4d0a523bbdb54af1b51ed783457ec0d1` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:04.710486 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4e59b5-8844-4c37-bbf8-5e873aff4391 None admin] RBAC: Authorizing `identity:get_project(project_id=4d0a523bbdb54af1b51ed783457ec0d1)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:04.711932 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4e59b5-8844-4c37-bbf8-5e873aff4391 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:04.713883 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 49/96] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:06:04 2022] GET /identity/v3/projects/4d0a523bbdb54af1b51ed783457ec0d1 => generated 312 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:04.720106 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494c3d5-cd64-4b92-9195-ca6833d1a13e None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:04.837725 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:04.858085 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494c3d5-cd64-4b92-9195-ca6833d1a13e None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:04.914422 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b63fd2a-b13c-41ad-8ac1-4b1ed36f5de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:04.915328 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63fd2a-b13c-41ad-8ac1-4b1ed36f5de3 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:04.915755 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63fd2a-b13c-41ad-8ac1-4b1ed36f5de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:04.916175 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63fd2a-b13c-41ad-8ac1-4b1ed36f5de3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:04.917328 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b63fd2a-b13c-41ad-8ac1-4b1ed36f5de3 None admin] RBAC: Adding query filter params (role.id=9712f7b332bf484689b3706721ab6311, scope.project.id=4d0a523bbdb54af1b51ed783457ec0d1, user.id=96c3d608c85140b1bcd4f716a3c47b7a) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:04.917807 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b63fd2a-b13c-41ad-8ac1-4b1ed36f5de3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:04.920826 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b63fd2a-b13c-41ad-8ac1-4b1ed36f5de3 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:04.936805 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 48/97] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:06:04 2022] GET /identity/v3/role_assignments?user.id=96c3d608c85140b1bcd4f716a3c47b7a&scope.project.id=4d0a523bbdb54af1b51ed783457ec0d1&role.id=9712f7b332bf484689b3706721ab6311 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:05.422540 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85070f86-e72f-4baf-9e72-1c39dc86633f None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:05.423559 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85070f86-e72f-4baf-9e72-1c39dc86633f None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:05.424046 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85070f86-e72f-4baf-9e72-1c39dc86633f None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:05.425606 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 50/98] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:05.431167 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ff0b7-32cd-4ff0-ba01-97f0d5c90a61 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:05.432034 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ff0b7-32cd-4ff0-ba01-97f0d5c90a61 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:05.432546 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ff0b7-32cd-4ff0-ba01-97f0d5c90a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:05.455357 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-8e9ff0b7-32cd-4ff0-ba01-97f0d5c90a61 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:05.456903 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-8e9ff0b7-32cd-4ff0-ba01-97f0d5c90a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:05.530477 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 49/99] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:06:06.079052 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85070f86-e72f-4baf-9e72-1c39dc86633f None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:06.100942 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2e313-cf09-49f7-9c95-541af8f86fe7 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:06.101571 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2e313-cf09-49f7-9c95-541af8f86fe7 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:06.102045 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2e313-cf09-49f7-9c95-541af8f86fe7 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:06.103680 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 50/100] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:06.109767 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd97733-202e-498b-ac50-9838aff0b68d None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:06.110312 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd97733-202e-498b-ac50-9838aff0b68d None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:06.110848 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd97733-202e-498b-ac50-9838aff0b68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:06.154074 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-cfd97733-202e-498b-ac50-9838aff0b68d None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:06.157064 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-cfd97733-202e-498b-ac50-9838aff0b68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:06.274414 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:06.303155 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 51/101] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 12:06:06.309953 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85070f86-e72f-4baf-9e72-1c39dc86633f None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:06.349855 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b117386-3196-48a6-ae3f-2ac7121ce2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:06.350462 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b117386-3196-48a6-ae3f-2ac7121ce2b8 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:06.350756 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b117386-3196-48a6-ae3f-2ac7121ce2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:06.351034 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b117386-3196-48a6-ae3f-2ac7121ce2b8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:06.366268 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b117386-3196-48a6-ae3f-2ac7121ce2b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:06.371236 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-6b117386-3196-48a6-ae3f-2ac7121ce2b8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 12:06:06.371236 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:06.371236 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:06.371236 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:06.371236 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:06.371236 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:06.371236 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:06.371236 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:06.371236 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:06.371236 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:06.371236 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:06.371236 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:06.371236 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:06.371236 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:06.371236 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:06.371236 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:06.372665 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:06.372665 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:06.372665 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:06.372665 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:06.372665 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:06.372665 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:06.372665 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:06.372665 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:06.372665 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:06.372665 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:06.372665 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:06.372665 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:06.372665 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:06.372665 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:06.372665 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:06.372665 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:06.373785 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:06.373785 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:06.373785 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:06.373785 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:06.373785 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:06.373785 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:06.373785 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:06.373785 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:06.373785 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:06.373785 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:06.373785 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 12:06:06.373785 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:06:06.373785 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 51/102] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:06:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:06:06.378993 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd97733-202e-498b-ac50-9838aff0b68d None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:06.390106 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:06.532533 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd97733-202e-498b-ac50-9838aff0b68d None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:06.576529 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915ffee-d392-48a3-8655-6e5161add6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:06.577155 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915ffee-d392-48a3-8655-6e5161add6f8 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:06.577438 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915ffee-d392-48a3-8655-6e5161add6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:06.577706 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915ffee-d392-48a3-8655-6e5161add6f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:06.578395 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0915ffee-d392-48a3-8655-6e5161add6f8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:06.578695 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0915ffee-d392-48a3-8655-6e5161add6f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:06.580089 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0915ffee-d392-48a3-8655-6e5161add6f8 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:06.594737 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 52/103] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Sep 21 12:06:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:06.600457 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b117386-3196-48a6-ae3f-2ac7121ce2b8 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:06.742316 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915ffee-d392-48a3-8655-6e5161add6f8 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:06.762303 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b117386-3196-48a6-ae3f-2ac7121ce2b8 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:06.850859 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:06.851169 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542b116-fffa-45a8-a940-755e3f422af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:06.851770 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542b116-fffa-45a8-a940-755e3f422af0 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:06.852052 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542b116-fffa-45a8-a940-755e3f422af0 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:06.852461 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542b116-fffa-45a8-a940-755e3f422af0 None admin] PATH_INFO: `/v3/users/b0b8b1d40af040b4908e003f6da65064` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:06.887662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d542b116-fffa-45a8-a940-755e3f422af0 None admin] RBAC: Authorizing `identity:get_user(user_id=b0b8b1d40af040b4908e003f6da65064)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:06.889159 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d542b116-fffa-45a8-a940-755e3f422af0 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:06.891320 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 52/104] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:06:06 2022] GET /identity/v3/users/b0b8b1d40af040b4908e003f6da65064 => generated 289 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:06.891924 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915ffee-d392-48a3-8655-6e5161add6f8 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:06.892334 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a222b-b2b5-4d4d-91c0-10f8974d148b None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:06.892615 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a222b-b2b5-4d4d-91c0-10f8974d148b None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:06.892889 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a222b-b2b5-4d4d-91c0-10f8974d148b None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:06.894197 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 53/105] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:06.898020 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a222b-b2b5-4d4d-91c0-10f8974d148b None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:06.905092 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:06.936818 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56577a83-55bd-4df5-96de-7a47fe8cb027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:06.937454 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56577a83-55bd-4df5-96de-7a47fe8cb027 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:06.937733 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56577a83-55bd-4df5-96de-7a47fe8cb027 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:06.937989 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56577a83-55bd-4df5-96de-7a47fe8cb027 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:06.939145 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56577a83-55bd-4df5-96de-7a47fe8cb027 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:06.940849 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56577a83-55bd-4df5-96de-7a47fe8cb027 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:06.942841 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 53/106] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:06:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:06.944218 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e34ed-b875-4701-9eab-8a93dc073d95 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:06.944498 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e34ed-b875-4701-9eab-8a93dc073d95 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:06.944791 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e34ed-b875-4701-9eab-8a93dc073d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:06.971163 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-3a8e34ed-b875-4701-9eab-8a93dc073d95 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:06.972389 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-3a8e34ed-b875-4701-9eab-8a93dc073d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:07.056823 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a222b-b2b5-4d4d-91c0-10f8974d148b None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:07.096874 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89adbb55-8aa0-4f49-8d02-52539df10e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:07.097501 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89adbb55-8aa0-4f49-8d02-52539df10e3a None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:07.098154 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89adbb55-8aa0-4f49-8d02-52539df10e3a None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:07.098675 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89adbb55-8aa0-4f49-8d02-52539df10e3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:07.147864 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 54/107] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:06:07.153115 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e34ed-b875-4701-9eab-8a93dc073d95 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:07.201965 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89adbb55-8aa0-4f49-8d02-52539df10e3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:07.204788 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89adbb55-8aa0-4f49-8d02-52539df10e3a None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:07.208248 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:07.329526 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:07.359086 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 54/108] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:06:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 12:06:07.361070 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2013928-e53e-4219-9641-b5a5d5807594 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:07.361589 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2013928-e53e-4219-9641-b5a5d5807594 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:07.362057 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2013928-e53e-4219-9641-b5a5d5807594 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:07.363584 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 55/109] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:07.372087 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c1680-ef8a-4cef-a219-4fc21b82a7ac None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:07.372659 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c1680-ef8a-4cef-a219-4fc21b82a7ac None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:07.373346 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c1680-ef8a-4cef-a219-4fc21b82a7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:07.395191 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-900c1680-ef8a-4cef-a219-4fc21b82a7ac None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:07.396729 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-900c1680-ef8a-4cef-a219-4fc21b82a7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:07.407139 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e34ed-b875-4701-9eab-8a93dc073d95 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:07.443504 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f80ffa-67d1-437a-9902-7985cc7ad7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:07.444113 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f80ffa-67d1-437a-9902-7985cc7ad7b5 None admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:07.444391 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f80ffa-67d1-437a-9902-7985cc7ad7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:07.444660 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f80ffa-67d1-437a-9902-7985cc7ad7b5 None admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:07.445306 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f80ffa-67d1-437a-9902-7985cc7ad7b5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:07.446768 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f80ffa-67d1-437a-9902-7985cc7ad7b5 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:07.478707 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 55/110] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Sep 21 12:06:07 2022] POST /identity/v3/projects => generated 302 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:06:07.479671 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f80ffa-67d1-437a-9902-7985cc7ad7b5 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:07.479775 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 56/111] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:06:07.487227 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167a08a-82e9-4024-8dfa-320a500cae87 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:07.487537 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167a08a-82e9-4024-8dfa-320a500cae87 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:07.487787 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167a08a-82e9-4024-8dfa-320a500cae87 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:07.489220 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 57/112] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:07 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:07.495095 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef7b5b-e9f5-433b-8b1c-a24658946816 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:07.495407 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef7b5b-e9f5-433b-8b1c-a24658946816 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:07.495651 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef7b5b-e9f5-433b-8b1c-a24658946816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:07.536863 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-58ef7b5b-e9f5-433b-8b1c-a24658946816 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:07.538380 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-58ef7b5b-e9f5-433b-8b1c-a24658946816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:07.589312 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:07.671024 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f80ffa-67d1-437a-9902-7985cc7ad7b5 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:07.702174 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 58/113] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 12:06:07.702861 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:07.703497 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef7b5b-e9f5-433b-8b1c-a24658946816 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:07.741453 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713803c0-a6d9-4ad2-87bf-73573e0097b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:07.743083 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713803c0-a6d9-4ad2-87bf-73573e0097b3 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:07.743728 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713803c0-a6d9-4ad2-87bf-73573e0097b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:07.744223 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713803c0-a6d9-4ad2-87bf-73573e0097b3 None admin] PATH_INFO: `/v3/projects/39342ea2ea9b45c8817058e7bed7c739` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:07.745663 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713803c0-a6d9-4ad2-87bf-73573e0097b3 None admin] RBAC: Authorizing `identity:get_project(project_id=39342ea2ea9b45c8817058e7bed7c739)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:07.748231 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713803c0-a6d9-4ad2-87bf-73573e0097b3 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:07.750223 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 56/114] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:06:07 2022] GET /identity/v3/projects/39342ea2ea9b45c8817058e7bed7c739 => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:07.757021 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713803c0-a6d9-4ad2-87bf-73573e0097b3 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:07.910258 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713803c0-a6d9-4ad2-87bf-73573e0097b3 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:07.924323 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef7b5b-e9f5-433b-8b1c-a24658946816 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:07.950240 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bed838-d559-48d6-aa4d-c7d950a0a97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:07.951427 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bed838-d559-48d6-aa4d-c7d950a0a97c None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:07.951967 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bed838-d559-48d6-aa4d-c7d950a0a97c None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:07.952451 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bed838-d559-48d6-aa4d-c7d950a0a97c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:07.953392 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bed838-d559-48d6-aa4d-c7d950a0a97c None admin] RBAC: Adding query filter params (role.id=65ae44a45ff2443eb03c2802be0453c9, scope.project.id=39342ea2ea9b45c8817058e7bed7c739, user.id=b0b8b1d40af040b4908e003f6da65064) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:07.953948 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bed838-d559-48d6-aa4d-c7d950a0a97c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:07.955733 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bed838-d559-48d6-aa4d-c7d950a0a97c None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:07.961999 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 57/115] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:06:07 2022] GET /identity/v3/role_assignments?user.id=b0b8b1d40af040b4908e003f6da65064&scope.project.id=39342ea2ea9b45c8817058e7bed7c739&role.id=65ae44a45ff2443eb03c2802be0453c9 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:07.962138 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804da4f0-08c8-4267-bd35-63e44ab049d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:07.962798 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804da4f0-08c8-4267-bd35-63e44ab049d4 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:07.963077 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804da4f0-08c8-4267-bd35-63e44ab049d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:07.963410 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804da4f0-08c8-4267-bd35-63e44ab049d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:07.963830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bed838-d559-48d6-aa4d-c7d950a0a97c None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:07.981957 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804da4f0-08c8-4267-bd35-63e44ab049d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:07.984059 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-804da4f0-08c8-4267-bd35-63e44ab049d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 12:06:07.984059 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:07.984059 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:07.984059 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:07.984059 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:07.984059 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:07.984059 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:07.984059 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:07.984059 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:07.984059 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:07.984059 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:07.984059 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:07.984059 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:07.984059 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:07.984059 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:07.984059 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:07.984927 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:07.984927 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:07.984927 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:07.984927 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:07.984927 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:07.984927 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:07.984927 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:07.984927 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:07.984927 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:07.984927 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:07.984927 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:07.984927 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:07.984927 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:07.984927 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:07.984927 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:07.984927 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:07.985676 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:07.985676 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:07.985676 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:07.985676 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:07.985676 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:07.985676 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:07.985676 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:07.985676 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:07.985676 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:07.985676 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:07.985676 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 12:06:07.985676 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:06:07.985676 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 59/116] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:06:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:06:07.995076 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804da4f0-08c8-4267-bd35-63e44ab049d4 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:08.048238 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:08.074208 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:08.187023 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bed838-d559-48d6-aa4d-c7d950a0a97c None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:08.199062 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804da4f0-08c8-4267-bd35-63e44ab049d4 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:08.238227 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e297876-005f-47bc-a2af-e896fc3a2adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:08.239307 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e297876-005f-47bc-a2af-e896fc3a2adc None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:08.239798 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e297876-005f-47bc-a2af-e896fc3a2adc None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:08.240327 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e297876-005f-47bc-a2af-e896fc3a2adc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:08.258724 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e297876-005f-47bc-a2af-e896fc3a2adc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:08.266154 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-9e297876-005f-47bc-a2af-e896fc3a2adc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:06:08.266154 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:08.266154 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:08.266154 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:08.266154 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:08.266154 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:08.266154 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:08.266154 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:08.266154 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:08.266154 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:08.266154 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:08.266154 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:08.266154 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:08.266154 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:08.266154 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:08.266154 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:08.267185 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:08.267185 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:08.267185 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:08.267185 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:08.267185 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:08.267185 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:08.267185 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:08.267185 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:08.267185 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:08.267185 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:08.267185 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:08.267185 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:08.267185 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:08.267185 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:08.267185 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:08.267185 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:08.267937 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:08.267937 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:08.267937 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:08.267937 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:08.267937 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:08.267937 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:08.267937 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:08.267937 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:08.267937 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:08.267937 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:08.267937 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:06:08.267937 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:06:08.272267 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 58/117] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Sep 21 12:06:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:06:08.273660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a395799-9859-4e6e-b8e5-b2fe5c4f4251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:08.278778 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a395799-9859-4e6e-b8e5-b2fe5c4f4251 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:08.279297 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a395799-9859-4e6e-b8e5-b2fe5c4f4251 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:08.279854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a395799-9859-4e6e-b8e5-b2fe5c4f4251 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:08.280756 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a395799-9859-4e6e-b8e5-b2fe5c4f4251 None admin] RBAC: Adding query filter params (name=member) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:08.281287 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a395799-9859-4e6e-b8e5-b2fe5c4f4251 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:08.283294 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e297876-005f-47bc-a2af-e896fc3a2adc None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:08.284082 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a395799-9859-4e6e-b8e5-b2fe5c4f4251 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:08.308007 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 60/118] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Sep 21 12:06:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:06:08.309735 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a395799-9859-4e6e-b8e5-b2fe5c4f4251 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:08.424320 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:08.437713 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e297876-005f-47bc-a2af-e896fc3a2adc None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:08.445732 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a395799-9859-4e6e-b8e5-b2fe5c4f4251 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:08.454599 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:08.484171 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe256415-ae67-4bbb-8023-0b5111a57a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:08.485150 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe256415-ae67-4bbb-8023-0b5111a57a3e None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:08.485499 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe256415-ae67-4bbb-8023-0b5111a57a3e None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:08.486224 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe256415-ae67-4bbb-8023-0b5111a57a3e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:08.491244 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d216c0f-b3e0-4263-858d-c06126a4c6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:08.492091 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d216c0f-b3e0-4263-858d-c06126a4c6eb None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:08.492549 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d216c0f-b3e0-4263-858d-c06126a4c6eb None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:08.493005 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d216c0f-b3e0-4263-858d-c06126a4c6eb None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:08.493896 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d216c0f-b3e0-4263-858d-c06126a4c6eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:08.494577 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d216c0f-b3e0-4263-858d-c06126a4c6eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:08.497022 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d216c0f-b3e0-4263-858d-c06126a4c6eb None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:08.499479 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe256415-ae67-4bbb-8023-0b5111a57a3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:08.506149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-fe256415-ae67-4bbb-8023-0b5111a57a3e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 12:06:08.506149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:08.506149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:08.506149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:08.506149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:08.506149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:08.506149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:08.506149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:08.506149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:08.506149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:08.506149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:08.506149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:08.506149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:08.506149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:08.506149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:08.506149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:08.507063 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:08.507063 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:08.507063 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:08.507063 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:08.507063 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:08.507063 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:08.507063 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:08.507063 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:08.507063 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:08.507063 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:08.507063 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:08.507063 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:08.507063 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:08.507063 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:08.507063 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:08.507063 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:08.507830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:08.507830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:08.507830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:08.507830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:08.507830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:08.507830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:08.507830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:08.507830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:08.507830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:08.507830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:08.507830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 12:06:08.507830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:06:08.507830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 59/119] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Sep 21 12:06:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:06:08.508458 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe256415-ae67-4bbb-8023-0b5111a57a3e None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:08.509616 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 61/120] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:06:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:08.511300 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ee673-269a-4184-9300-309dfbfad8ca None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:08.511949 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ee673-269a-4184-9300-309dfbfad8ca None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:08.512746 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ee673-269a-4184-9300-309dfbfad8ca None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:08.514828 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 62/121] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:08.516089 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ee673-269a-4184-9300-309dfbfad8ca None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:08.644005 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe256415-ae67-4bbb-8023-0b5111a57a3e None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:08.645535 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ee673-269a-4184-9300-309dfbfad8ca None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:08.682901 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2470e33-7c57-4262-ac06-04b5e70d92f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:08.684821 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2470e33-7c57-4262-ac06-04b5e70d92f2 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:08.685313 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2470e33-7c57-4262-ac06-04b5e70d92f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:08.685817 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2470e33-7c57-4262-ac06-04b5e70d92f2 None admin] PATH_INFO: `/v3/users/96c3d608c85140b1bcd4f716a3c47b7a` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:08.687510 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2470e33-7c57-4262-ac06-04b5e70d92f2 None admin] RBAC: Authorizing `identity:get_user(user_id=96c3d608c85140b1bcd4f716a3c47b7a)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:08.689378 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2470e33-7c57-4262-ac06-04b5e70d92f2 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:08.690404 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4cd9fc-2360-49ed-9cde-3456294b9c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:08.691039 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4cd9fc-2360-49ed-9cde-3456294b9c15 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:08.691328 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4cd9fc-2360-49ed-9cde-3456294b9c15 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:08.691598 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4cd9fc-2360-49ed-9cde-3456294b9c15 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:08.692297 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4cd9fc-2360-49ed-9cde-3456294b9c15 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:08.692582 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4cd9fc-2360-49ed-9cde-3456294b9c15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:08.692829 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 60/122] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:06:08 2022] GET /identity/v3/users/96c3d608c85140b1bcd4f716a3c47b7a => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:08.693960 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2470e33-7c57-4262-ac06-04b5e70d92f2 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:08.694065 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4cd9fc-2360-49ed-9cde-3456294b9c15 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:08.705594 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 63/123] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:06:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:08.706958 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3841911-f20d-44f3-9dd6-a7c230c42566 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:08.707245 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3841911-f20d-44f3-9dd6-a7c230c42566 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:08.707519 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3841911-f20d-44f3-9dd6-a7c230c42566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:08.731984 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-e3841911-f20d-44f3-9dd6-a7c230c42566 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:08.733916 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-e3841911-f20d-44f3-9dd6-a7c230c42566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:08.736058 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:08.745345 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:08.817921 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2470e33-7c57-4262-ac06-04b5e70d92f2 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:08.833223 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 64/124] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:06:08.834582 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3841911-f20d-44f3-9dd6-a7c230c42566 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:08.858859 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504fe877-d996-445a-9a0b-6d20bb7061f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:08.859933 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fe877-d996-445a-9a0b-6d20bb7061f1 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:08.860421 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fe877-d996-445a-9a0b-6d20bb7061f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:08.860940 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fe877-d996-445a-9a0b-6d20bb7061f1 None admin] PATH_INFO: `/v3/users/5ede9eacb91d469ab92c14848276a5bb` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:08.862463 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504fe877-d996-445a-9a0b-6d20bb7061f1 None admin] RBAC: Authorizing `identity:get_user(user_id=5ede9eacb91d469ab92c14848276a5bb)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:08.864147 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504fe877-d996-445a-9a0b-6d20bb7061f1 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:08.866437 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 61/125] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:06:08 2022] GET /identity/v3/users/5ede9eacb91d469ab92c14848276a5bb => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:08.867480 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504fe877-d996-445a-9a0b-6d20bb7061f1 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:08.962949 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3841911-f20d-44f3-9dd6-a7c230c42566 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:09.008022 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561bb167-ffef-4e48-8b20-71462e784b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:09.008661 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561bb167-ffef-4e48-8b20-71462e784b25 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:09.008943 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561bb167-ffef-4e48-8b20-71462e784b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:09.009506 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561bb167-ffef-4e48-8b20-71462e784b25 None admin] PATH_INFO: `/v3/projects/39342ea2ea9b45c8817058e7bed7c739` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:09.010845 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561bb167-ffef-4e48-8b20-71462e784b25 None admin] RBAC: Authorizing `identity:get_project(project_id=39342ea2ea9b45c8817058e7bed7c739)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:09.025801 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561bb167-ffef-4e48-8b20-71462e784b25 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:09.025801 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 65/126] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:06:08 2022] GET /identity/v3/projects/39342ea2ea9b45c8817058e7bed7c739 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:09.025801 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561bb167-ffef-4e48-8b20-71462e784b25 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:09.031929 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:09.056240 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504fe877-d996-445a-9a0b-6d20bb7061f1 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:09.071680 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:09.139856 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6dffc-7564-4d67-a8e2-00de1def316e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:09.142400 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6dffc-7564-4d67-a8e2-00de1def316e None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:09.143851 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6dffc-7564-4d67-a8e2-00de1def316e None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:09.144308 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6dffc-7564-4d67-a8e2-00de1def316e None admin] PATH_INFO: `/v3/users/96c3d608c85140b1bcd4f716a3c47b7a` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:09.146577 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a6dffc-7564-4d67-a8e2-00de1def316e None admin] RBAC: Authorizing `identity:get_user(user_id=96c3d608c85140b1bcd4f716a3c47b7a)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:09.150088 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a6dffc-7564-4d67-a8e2-00de1def316e None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:09.156152 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561bb167-ffef-4e48-8b20-71462e784b25 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:09.157377 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 62/127] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:06:08 2022] GET /identity/v3/users/96c3d608c85140b1bcd4f716a3c47b7a => generated 275 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:09.158392 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6dffc-7564-4d67-a8e2-00de1def316e None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:09.204478 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629e411-5e36-42af-a628-4850358fbe05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:09.205407 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629e411-5e36-42af-a628-4850358fbe05 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:09.205862 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629e411-5e36-42af-a628-4850358fbe05 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:09.206307 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629e411-5e36-42af-a628-4850358fbe05 None admin] PATH_INFO: `/v3/projects/39342ea2ea9b45c8817058e7bed7c739` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:09.212027 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6629e411-5e36-42af-a628-4850358fbe05 None admin] RBAC: Authorizing `identity:get_project(project_id=39342ea2ea9b45c8817058e7bed7c739)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:09.214168 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6629e411-5e36-42af-a628-4850358fbe05 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:09.221852 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 66/128] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:06:09 2022] GET /identity/v3/projects/39342ea2ea9b45c8817058e7bed7c739 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:09.222979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629e411-5e36-42af-a628-4850358fbe05 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:09.321119 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6dffc-7564-4d67-a8e2-00de1def316e None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:09.325190 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:09.352941 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629e411-5e36-42af-a628-4850358fbe05 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:09.361671 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e54a2-1010-410b-bb60-bea20f876686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:09.362415 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e54a2-1010-410b-bb60-bea20f876686 None admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:09.362783 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e54a2-1010-410b-bb60-bea20f876686 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:09.363109 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e54a2-1010-410b-bb60-bea20f876686 None admin] PATH_INFO: `/v3/projects/39342ea2ea9b45c8817058e7bed7c739/users/96c3d608c85140b1bcd4f716a3c47b7a/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:09.375079 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e54a2-1010-410b-bb60-bea20f876686 None admin] RBAC: Authorizing `identity:create_grant(project_id=39342ea2ea9b45c8817058e7bed7c739, user_id=96c3d608c85140b1bcd4f716a3c47b7a, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:09.375079 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e54a2-1010-410b-bb60-bea20f876686 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:09.397837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 63/129] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Sep 21 12:06:09 2022] PUT /identity/v3/projects/39342ea2ea9b45c8817058e7bed7c739/users/96c3d608c85140b1bcd4f716a3c47b7a/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:06:09.398781 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e54a2-1010-410b-bb60-bea20f876686 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:09.399782 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a154c0-0707-416c-934b-f098fd9afef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:09.400419 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a154c0-0707-416c-934b-f098fd9afef0 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:09.400698 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a154c0-0707-416c-934b-f098fd9afef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:09.400969 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a154c0-0707-416c-934b-f098fd9afef0 None admin] PATH_INFO: `/v3/projects/39342ea2ea9b45c8817058e7bed7c739` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:09.402134 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a154c0-0707-416c-934b-f098fd9afef0 None admin] RBAC: Authorizing `identity:get_project(project_id=39342ea2ea9b45c8817058e7bed7c739)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:09.404203 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a154c0-0707-416c-934b-f098fd9afef0 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:09.410895 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 67/130] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:06:09 2022] GET /identity/v3/projects/39342ea2ea9b45c8817058e7bed7c739 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:09.411924 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a154c0-0707-416c-934b-f098fd9afef0 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:09.444293 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:09.530222 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e54a2-1010-410b-bb60-bea20f876686 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:09.574203 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fba64-869b-4c41-ad59-e4a7d8f5f3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:09.583029 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fba64-869b-4c41-ad59-e4a7d8f5f3e9 None admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:09.583029 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fba64-869b-4c41-ad59-e4a7d8f5f3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:09.583029 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fba64-869b-4c41-ad59-e4a7d8f5f3e9 None admin] PATH_INFO: `/v3/projects/39342ea2ea9b45c8817058e7bed7c739/users/5ede9eacb91d469ab92c14848276a5bb/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:09.583029 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633fba64-869b-4c41-ad59-e4a7d8f5f3e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=39342ea2ea9b45c8817058e7bed7c739, user_id=5ede9eacb91d469ab92c14848276a5bb, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:09.583670 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633fba64-869b-4c41-ad59-e4a7d8f5f3e9 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:09.607848 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 64/131] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Sep 21 12:06:09 2022] PUT /identity/v3/projects/39342ea2ea9b45c8817058e7bed7c739/users/5ede9eacb91d469ab92c14848276a5bb/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:06:09.608733 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fba64-869b-4c41-ad59-e4a7d8f5f3e9 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:09.668579 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a154c0-0707-416c-934b-f098fd9afef0 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:09.738107 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e3efe-c652-4a0b-a465-fd9e6913c306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:09.740801 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e3efe-c652-4a0b-a465-fd9e6913c306 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:09.741414 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e3efe-c652-4a0b-a465-fd9e6913c306 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:09.742070 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e3efe-c652-4a0b-a465-fd9e6913c306 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:09.766137 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:09.768702 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e3efe-c652-4a0b-a465-fd9e6913c306 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:09.779981 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-0e4e3efe-c652-4a0b-a465-fd9e6913c306 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 12:06:09.779981 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:09.779981 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:09.779981 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:09.779981 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:09.779981 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:09.779981 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:09.779981 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:09.779981 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:09.779981 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:09.779981 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:09.779981 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:09.779981 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:09.779981 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:09.779981 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:09.779981 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:09.780963 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:09.780963 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:09.780963 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:09.780963 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:09.780963 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:09.780963 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:09.780963 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:09.780963 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:09.780963 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:09.780963 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:09.780963 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:09.780963 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:09.780963 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:09.780963 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:09.780963 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:09.780963 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:09.781756 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:09.781756 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:09.781756 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:09.781756 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:09.781756 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:09.781756 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:09.781756 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:09.781756 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:09.781756 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:09.781756 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:09.781756 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 12:06:09.781756 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:06:09.781756 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 68/132] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:06:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:06:09.785329 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fba64-869b-4c41-ad59-e4a7d8f5f3e9 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:09.794973 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e3efe-c652-4a0b-a465-fd9e6913c306 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:09.801867 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:09.867712 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3730bd-8552-484d-b621-1f7520a7bc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:09.868402 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3730bd-8552-484d-b621-1f7520a7bc62 None admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:09.868687 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3730bd-8552-484d-b621-1f7520a7bc62 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:09.868967 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3730bd-8552-484d-b621-1f7520a7bc62 None admin] PATH_INFO: `/v3/projects/39342ea2ea9b45c8817058e7bed7c739/users/96c3d608c85140b1bcd4f716a3c47b7a/roles/173d0e93641b4882934b75f256b38534` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:09.871760 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3730bd-8552-484d-b621-1f7520a7bc62 None admin] RBAC: Authorizing `identity:create_grant(project_id=39342ea2ea9b45c8817058e7bed7c739, user_id=96c3d608c85140b1bcd4f716a3c47b7a, role_id=173d0e93641b4882934b75f256b38534)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:09.873316 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3730bd-8552-484d-b621-1f7520a7bc62 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:09.897957 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 65/133] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Sep 21 12:06:09 2022] PUT /identity/v3/projects/39342ea2ea9b45c8817058e7bed7c739/users/96c3d608c85140b1bcd4f716a3c47b7a/roles/173d0e93641b4882934b75f256b38534 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:06:09.983547 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e3efe-c652-4a0b-a465-fd9e6913c306 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:10.026820 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8e640-1e44-4018-b13f-0486701b675f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:10.028147 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8e640-1e44-4018-b13f-0486701b675f None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:10.028429 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8e640-1e44-4018-b13f-0486701b675f None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:10.028704 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8e640-1e44-4018-b13f-0486701b675f None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:10.029409 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc8e640-1e44-4018-b13f-0486701b675f None admin] RBAC: Adding query filter params (name=member) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:10.029717 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc8e640-1e44-4018-b13f-0486701b675f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:10.031226 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc8e640-1e44-4018-b13f-0486701b675f None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:10.040390 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 69/134] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Sep 21 12:06:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:10.046032 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3730bd-8552-484d-b621-1f7520a7bc62 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:10.212292 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3730bd-8552-484d-b621-1f7520a7bc62 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:10.252874 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0055d6e-8890-473e-829b-c9dac6b637df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:10.253948 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0055d6e-8890-473e-829b-c9dac6b637df None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:10.254492 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0055d6e-8890-473e-829b-c9dac6b637df None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:10.254990 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0055d6e-8890-473e-829b-c9dac6b637df None admin] PATH_INFO: `/v3/users/96c3d608c85140b1bcd4f716a3c47b7a` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:10.256388 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0055d6e-8890-473e-829b-c9dac6b637df None admin] RBAC: Authorizing `identity:get_user(user_id=96c3d608c85140b1bcd4f716a3c47b7a)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:10.258212 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0055d6e-8890-473e-829b-c9dac6b637df None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:10.260366 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 66/135] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:06:10 2022] GET /identity/v3/users/96c3d608c85140b1bcd4f716a3c47b7a => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:10.265914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8e640-1e44-4018-b13f-0486701b675f None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:10.358622 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:10.403260 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8e640-1e44-4018-b13f-0486701b675f None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:10.448758 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19541d-1c13-4282-bbd8-8dea1eedd8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:10.450399 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19541d-1c13-4282-bbd8-8dea1eedd8fb None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:10.450969 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19541d-1c13-4282-bbd8-8dea1eedd8fb None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:10.451465 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19541d-1c13-4282-bbd8-8dea1eedd8fb None admin] PATH_INFO: `/v3/projects/4d0a523bbdb54af1b51ed783457ec0d1` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:10.459238 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19541d-1c13-4282-bbd8-8dea1eedd8fb None admin] RBAC: Authorizing `identity:get_project(project_id=4d0a523bbdb54af1b51ed783457ec0d1)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:10.461052 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19541d-1c13-4282-bbd8-8dea1eedd8fb None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:10.463199 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 70/136] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:06:10 2022] GET /identity/v3/projects/4d0a523bbdb54af1b51ed783457ec0d1 => generated 312 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:10.469112 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0055d6e-8890-473e-829b-c9dac6b637df None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:10.501682 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:10.604191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0055d6e-8890-473e-829b-c9dac6b637df None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:10.633713 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab2e52-2989-42c2-bd0d-af6ebf00b93f None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:10.634328 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab2e52-2989-42c2-bd0d-af6ebf00b93f None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:10.634851 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab2e52-2989-42c2-bd0d-af6ebf00b93f None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:10.637940 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 71/137] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:10.639974 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97cf11f-9774-47b6-9e7e-2ef9918b5dfd None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:10.640469 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97cf11f-9774-47b6-9e7e-2ef9918b5dfd None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:10.641005 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97cf11f-9774-47b6-9e7e-2ef9918b5dfd None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:10.642590 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 72/138] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:10.650026 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1c91a-7a25-43c8-9981-326541bd559a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:10.650689 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1c91a-7a25-43c8-9981-326541bd559a None admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:10.650978 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1c91a-7a25-43c8-9981-326541bd559a None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:10.651260 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1c91a-7a25-43c8-9981-326541bd559a None admin] PATH_INFO: `/v3/projects/4d0a523bbdb54af1b51ed783457ec0d1/users/96c3d608c85140b1bcd4f716a3c47b7a/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:10.652949 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210e87f-c40e-4289-9ab1-c4816c9f19ba None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:10.653454 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210e87f-c40e-4289-9ab1-c4816c9f19ba None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:10.653931 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210e87f-c40e-4289-9ab1-c4816c9f19ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:10.655680 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1c91a-7a25-43c8-9981-326541bd559a None admin] RBAC: Authorizing `identity:create_grant(project_id=4d0a523bbdb54af1b51ed783457ec0d1, user_id=96c3d608c85140b1bcd4f716a3c47b7a, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:10.657158 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1c91a-7a25-43c8-9981-326541bd559a None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:10.681277 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 67/139] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Sep 21 12:06:10 2022] PUT /identity/v3/projects/4d0a523bbdb54af1b51ed783457ec0d1/users/96c3d608c85140b1bcd4f716a3c47b7a/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:06:10.686458 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b8365-4fac-4a7f-943d-55966fdcf30e None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:10.686458 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b8365-4fac-4a7f-943d-55966fdcf30e None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:10.686730 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b8365-4fac-4a7f-943d-55966fdcf30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:10.689573 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-e210e87f-c40e-4289-9ab1-c4816c9f19ba None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:10.692142 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-e210e87f-c40e-4289-9ab1-c4816c9f19ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:10.735346 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-698b8365-4fac-4a7f-943d-55966fdcf30e None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:10.737461 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-698b8365-4fac-4a7f-943d-55966fdcf30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:10.874627 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 73/140] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:06:10.889287 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 68/141] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:06:11.417745 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210e87f-c40e-4289-9ab1-c4816c9f19ba None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:11.446800 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b8365-4fac-4a7f-943d-55966fdcf30e None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:11.474388 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:11.529642 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:11.589015 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210e87f-c40e-4289-9ab1-c4816c9f19ba None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:11.628661 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b8365-4fac-4a7f-943d-55966fdcf30e None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:11.670465 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18301ea3-f426-4e7a-9a74-9c46d5ee702d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:11.670465 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18301ea3-f426-4e7a-9a74-9c46d5ee702d None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:11.670465 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18301ea3-f426-4e7a-9a74-9c46d5ee702d None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:11.670465 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18301ea3-f426-4e7a-9a74-9c46d5ee702d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:11.685374 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be651e8-1ee4-4e4e-a5c5-ed153e31266b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:11.686426 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be651e8-1ee4-4e4e-a5c5-ed153e31266b None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:11.686979 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be651e8-1ee4-4e4e-a5c5-ed153e31266b None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:11.687461 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be651e8-1ee4-4e4e-a5c5-ed153e31266b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:11.688775 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be651e8-1ee4-4e4e-a5c5-ed153e31266b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:11.690502 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be651e8-1ee4-4e4e-a5c5-ed153e31266b None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:11.692929 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 69/142] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:06:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:11.696952 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18301ea3-f426-4e7a-9a74-9c46d5ee702d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:11.699776 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be651e8-1ee4-4e4e-a5c5-ed153e31266b None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:11.700877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-18301ea3-f426-4e7a-9a74-9c46d5ee702d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 12:06:11.700877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:11.700877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:11.700877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:11.700877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:11.700877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:11.700877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:11.700877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:11.700877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:11.700877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:11.700877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:11.700877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:11.700877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:11.700877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:11.700877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:11.700877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:11.701757 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:11.701757 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:11.701757 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:11.701757 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:11.701757 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:11.701757 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:11.701757 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:11.701757 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:11.701757 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:11.701757 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:11.701757 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:11.701757 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:11.701757 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:11.701757 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:11.701757 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:11.701757 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:11.702621 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:11.702621 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:11.702621 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:11.702621 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:11.702621 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:11.702621 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:11.702621 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:11.702621 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:11.702621 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:11.702621 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:11.702621 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 12:06:11.702621 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:06:11.702621 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 74/143] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:06:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:06:11.725086 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18301ea3-f426-4e7a-9a74-9c46d5ee702d None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:11.813096 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:11.850131 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be651e8-1ee4-4e4e-a5c5-ed153e31266b None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:11.906376 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c96a6-0745-4324-ba0f-37dc649f1337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:11.907059 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c96a6-0745-4324-ba0f-37dc649f1337 None admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:11.907294 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c96a6-0745-4324-ba0f-37dc649f1337 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:11.907539 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c96a6-0745-4324-ba0f-37dc649f1337 None admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:11.908206 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c96a6-0745-4324-ba0f-37dc649f1337 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:11.909645 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c96a6-0745-4324-ba0f-37dc649f1337 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:11.941139 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 70/144] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Sep 21 12:06:11 2022] POST /identity/v3/users => generated 283 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:06:11.966960 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18301ea3-f426-4e7a-9a74-9c46d5ee702d None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:11.998067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:12.018666 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ce36d-b76b-4023-aa8a-98d9d9a760ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:12.019299 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ce36d-b76b-4023-aa8a-98d9d9a760ea None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:12.019559 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ce36d-b76b-4023-aa8a-98d9d9a760ea None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:12.019829 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ce36d-b76b-4023-aa8a-98d9d9a760ea None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:12.020506 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ce36d-b76b-4023-aa8a-98d9d9a760ea None admin] RBAC: Adding query filter params (name=reader) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:12.020805 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ce36d-b76b-4023-aa8a-98d9d9a760ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:12.022211 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ce36d-b76b-4023-aa8a-98d9d9a760ea None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:12.032274 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 75/145] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Sep 21 12:06:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:12.038160 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c96a6-0745-4324-ba0f-37dc649f1337 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:12.182667 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c96a6-0745-4324-ba0f-37dc649f1337 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:12.234379 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c234cad-e158-484e-8ebe-e6a483f60fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:12.234976 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c234cad-e158-484e-8ebe-e6a483f60fec None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:12.235251 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c234cad-e158-484e-8ebe-e6a483f60fec None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:12.235519 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c234cad-e158-484e-8ebe-e6a483f60fec None admin] PATH_INFO: `/v3/users/b0b8b1d40af040b4908e003f6da65064` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:12.236754 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c234cad-e158-484e-8ebe-e6a483f60fec None admin] RBAC: Authorizing `identity:get_user(user_id=b0b8b1d40af040b4908e003f6da65064)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:12.238259 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c234cad-e158-484e-8ebe-e6a483f60fec None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:12.239923 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 71/146] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:06:12 2022] GET /identity/v3/users/b0b8b1d40af040b4908e003f6da65064 => generated 289 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:12.246492 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ce36d-b76b-4023-aa8a-98d9d9a760ea None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:12.364834 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ce36d-b76b-4023-aa8a-98d9d9a760ea None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:12.406272 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c939dd-e980-4056-a7bc-46c67a8b849d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:12.406969 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c939dd-e980-4056-a7bc-46c67a8b849d None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:12.407249 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c939dd-e980-4056-a7bc-46c67a8b849d None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:12.407524 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c939dd-e980-4056-a7bc-46c67a8b849d None admin] PATH_INFO: `/v3/projects/39342ea2ea9b45c8817058e7bed7c739` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:12.411144 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c939dd-e980-4056-a7bc-46c67a8b849d None admin] RBAC: Authorizing `identity:get_project(project_id=39342ea2ea9b45c8817058e7bed7c739)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:12.412643 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c939dd-e980-4056-a7bc-46c67a8b849d None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:12.414427 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 76/147] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:06:12 2022] GET /identity/v3/projects/39342ea2ea9b45c8817058e7bed7c739 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:12.421237 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c234cad-e158-484e-8ebe-e6a483f60fec None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:12.430070 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:12.519506 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a69f2-2848-4f5f-b4cc-8023813afdbb None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:12.519778 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a69f2-2848-4f5f-b4cc-8023813afdbb None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:12.519979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a69f2-2848-4f5f-b4cc-8023813afdbb None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:12.521580 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 77/148] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:12.532501 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe05e89-9da3-46f5-b832-56701a3206cb None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:12.532808 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe05e89-9da3-46f5-b832-56701a3206cb None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:12.533055 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe05e89-9da3-46f5-b832-56701a3206cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:12.571545 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-cbe05e89-9da3-46f5-b832-56701a3206cb None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:12.572727 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-cbe05e89-9da3-46f5-b832-56701a3206cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:12.577693 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c234cad-e158-484e-8ebe-e6a483f60fec None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:12.658383 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8bba1-d1ea-42a7-ac33-8aa24dfd83e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:12.659056 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8bba1-d1ea-42a7-ac33-8aa24dfd83e6 None admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:12.659334 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8bba1-d1ea-42a7-ac33-8aa24dfd83e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:12.662409 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8bba1-d1ea-42a7-ac33-8aa24dfd83e6 None admin] PATH_INFO: `/v3/projects/39342ea2ea9b45c8817058e7bed7c739/users/b0b8b1d40af040b4908e003f6da65064/roles/65ae44a45ff2443eb03c2802be0453c9` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:12.662409 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d8bba1-d1ea-42a7-ac33-8aa24dfd83e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=39342ea2ea9b45c8817058e7bed7c739, user_id=b0b8b1d40af040b4908e003f6da65064, role_id=65ae44a45ff2443eb03c2802be0453c9)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:12.663120 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d8bba1-d1ea-42a7-ac33-8aa24dfd83e6 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:12.676889 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:12.697567 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 72/149] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Sep 21 12:06:12 2022] PUT /identity/v3/projects/39342ea2ea9b45c8817058e7bed7c739/users/b0b8b1d40af040b4908e003f6da65064/roles/65ae44a45ff2443eb03c2802be0453c9 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:06:12.707055 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 78/150] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 12:06:13.068437 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29c68c-3406-4edc-a8f3-4d30e3ba7c1e None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:13.069308 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29c68c-3406-4edc-a8f3-4d30e3ba7c1e None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:13.069732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29c68c-3406-4edc-a8f3-4d30e3ba7c1e None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:13.071307 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 73/151] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:13.077631 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9fbcc-0d3c-4e75-a09f-83d1ffb151b6 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:13.078544 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9fbcc-0d3c-4e75-a09f-83d1ffb151b6 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:13.079041 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9fbcc-0d3c-4e75-a09f-83d1ffb151b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:13.100672 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-7db9fbcc-0d3c-4e75-a09f-83d1ffb151b6 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:13.102168 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7db9fbcc-0d3c-4e75-a09f-83d1ffb151b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:13.170916 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc29c68c-3406-4edc-a8f3-4d30e3ba7c1e None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:13.205309 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 79/152] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:06:13.278437 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:13.305853 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e90b8-bea4-40ce-9149-0e7478a511d8 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:13.306602 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e90b8-bea4-40ce-9149-0e7478a511d8 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:13.307081 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e90b8-bea4-40ce-9149-0e7478a511d8 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:13.308676 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 80/153] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:06:13.321080 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d273c8-494e-476b-9edc-dece256c52fc None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:13.321652 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d273c8-494e-476b-9edc-dece256c52fc None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:13.322121 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d273c8-494e-476b-9edc-dece256c52fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:13.346242 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc29c68c-3406-4edc-a8f3-4d30e3ba7c1e None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:13.369258 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-44d273c8-494e-476b-9edc-dece256c52fc None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:13.370510 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-44d273c8-494e-476b-9edc-dece256c52fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:13.428059 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d850454-9930-45cf-ae32-5411fadc250a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:13.428910 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d850454-9930-45cf-ae32-5411fadc250a None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:13.429191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d850454-9930-45cf-ae32-5411fadc250a None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:13.429464 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d850454-9930-45cf-ae32-5411fadc250a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:13.453771 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d850454-9930-45cf-ae32-5411fadc250a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:13.459148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-9d850454-9930-45cf-ae32-5411fadc250a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:06:13.459148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:13.459148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:13.459148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:13.459148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:13.459148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:13.459148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:13.459148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:13.459148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:13.459148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:13.459148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:13.459148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:13.459148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:13.459148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:13.459148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:13.459148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:13.460070 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:13.460070 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:13.460070 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:13.460070 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:13.460070 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:13.460070 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:13.460070 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:13.460070 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:13.460070 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:13.460070 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:13.460070 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:13.460070 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:13.460070 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:13.460070 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:13.460070 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:13.460070 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:13.460820 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:13.460820 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:13.460820 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:13.460820 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:13.460820 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:13.460820 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:13.460820 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:13.460820 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:13.460820 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:13.460820 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:13.460820 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:06:13.460820 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:06:13.465800 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 74/154] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Sep 21 12:06:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:06:13.471444 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d850454-9930-45cf-ae32-5411fadc250a None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:13.510748 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 81/155] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 12:06:13.637366 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d850454-9930-45cf-ae32-5411fadc250a None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:13.670243 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:13.682702 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f037b-8690-4e11-b479-ca0c45610b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:13.683383 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f037b-8690-4e11-b479-ca0c45610b78 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:13.683666 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f037b-8690-4e11-b479-ca0c45610b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:13.683940 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f037b-8690-4e11-b479-ca0c45610b78 None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:13.684620 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f037b-8690-4e11-b479-ca0c45610b78 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:13.684926 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f037b-8690-4e11-b479-ca0c45610b78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:13.686304 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f037b-8690-4e11-b479-ca0c45610b78 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:13.695673 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 75/156] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:06:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:06:13.700453 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d273c8-494e-476b-9edc-dece256c52fc None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:13.704701 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f037b-8690-4e11-b479-ca0c45610b78 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:13.766791 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:13.862033 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d273c8-494e-476b-9edc-dece256c52fc None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:13.864670 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f037b-8690-4e11-b479-ca0c45610b78 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:13.914463 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e08cd7-acf3-4b3d-963d-608c14fc8e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:13.915500 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e08cd7-acf3-4b3d-963d-608c14fc8e0d None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:13.915989 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e08cd7-acf3-4b3d-963d-608c14fc8e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:13.918251 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e08cd7-acf3-4b3d-963d-608c14fc8e0d None admin] PATH_INFO: `/v3/users/5ede9eacb91d469ab92c14848276a5bb` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:13.920698 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e08cd7-acf3-4b3d-963d-608c14fc8e0d None admin] RBAC: Authorizing `identity:get_user(user_id=5ede9eacb91d469ab92c14848276a5bb)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:13.923829 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e08cd7-acf3-4b3d-963d-608c14fc8e0d None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:13.927134 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 76/157] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:06:13 2022] GET /identity/v3/users/5ede9eacb91d469ab92c14848276a5bb => generated 247 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:13.933016 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e08cd7-acf3-4b3d-963d-608c14fc8e0d None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:13.951767 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4cb09-bfee-4e6b-b596-8093ddd539e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:13.952797 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4cb09-bfee-4e6b-b596-8093ddd539e2 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:13.953308 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4cb09-bfee-4e6b-b596-8093ddd539e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:13.953796 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4cb09-bfee-4e6b-b596-8093ddd539e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:13.978106 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4cb09-bfee-4e6b-b596-8093ddd539e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:13.986708 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-18f4cb09-bfee-4e6b-b596-8093ddd539e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 12:06:13.986708 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:13.986708 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:13.986708 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:13.986708 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:13.986708 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:13.986708 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:13.986708 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:13.986708 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:13.986708 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:13.986708 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:13.986708 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:13.986708 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:13.986708 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:13.986708 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:13.986708 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:13.987736 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:13.987736 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:13.987736 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:13.987736 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:13.987736 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:13.987736 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:13.987736 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:13.987736 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:13.987736 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:13.987736 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:13.987736 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:13.987736 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:13.987736 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:13.987736 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:13.987736 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:13.987736 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:13.988507 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:13.988507 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:13.988507 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:13.988507 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:13.988507 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:13.988507 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:13.988507 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:13.988507 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:13.988507 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:13.988507 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:13.988507 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 12:06:13.988507 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:06:13.991589 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 82/158] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:06:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:06:13.997715 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4cb09-bfee-4e6b-b596-8093ddd539e2 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:14.102707 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:14.131228 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4cb09-bfee-4e6b-b596-8093ddd539e2 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:14.133209 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:14.189402 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de40405-1ac9-46c1-822e-abe72398731e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:14.190026 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de40405-1ac9-46c1-822e-abe72398731e None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:14.190305 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de40405-1ac9-46c1-822e-abe72398731e None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:14.190604 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de40405-1ac9-46c1-822e-abe72398731e None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:14.191279 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de40405-1ac9-46c1-822e-abe72398731e None admin] RBAC: Adding query filter params (name=member) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:14.191638 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de40405-1ac9-46c1-822e-abe72398731e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:14.193041 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de40405-1ac9-46c1-822e-abe72398731e None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:14.200501 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e08cd7-acf3-4b3d-963d-608c14fc8e0d None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:14.206674 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 83/159] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Sep 21 12:06:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:06:14.209187 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de40405-1ac9-46c1-822e-abe72398731e None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:14.260278 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc24194-2c48-4f5f-bcb2-0578d6136758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:14.260941 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc24194-2c48-4f5f-bcb2-0578d6136758 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:14.261283 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc24194-2c48-4f5f-bcb2-0578d6136758 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:14.262059 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc24194-2c48-4f5f-bcb2-0578d6136758 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:14.468961 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc24194-2c48-4f5f-bcb2-0578d6136758 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:14.470322 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc24194-2c48-4f5f-bcb2-0578d6136758 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:14.474503 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de40405-1ac9-46c1-822e-abe72398731e None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:14.546059 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a02f7-edc2-494f-be70-8cf182b82dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:14.547058 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a02f7-edc2-494f-be70-8cf182b82dc4 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:14.547578 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a02f7-edc2-494f-be70-8cf182b82dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:14.548048 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a02f7-edc2-494f-be70-8cf182b82dc4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:14.561565 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a02f7-edc2-494f-be70-8cf182b82dc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:14.567482 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-0a0a02f7-edc2-494f-be70-8cf182b82dc4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 12:06:14.567482 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:14.567482 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:14.567482 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:14.567482 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:14.567482 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:14.567482 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:14.567482 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:14.567482 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:14.567482 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:14.567482 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:14.567482 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:14.567482 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:14.567482 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:14.567482 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:14.567482 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:14.568420 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:14.568420 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:14.568420 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:14.568420 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:14.568420 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:14.568420 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:14.568420 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:14.568420 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:14.568420 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:14.568420 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:14.568420 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:14.568420 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:14.568420 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:14.568420 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:14.568420 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:14.568420 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:14.569179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:14.569179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:14.569179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:14.569179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:14.569179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:14.569179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:14.569179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:14.569179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:14.569179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:14.569179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:14.569179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 12:06:14.569179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:06:14.571638 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 84/160] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Sep 21 12:06:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:06:14.572834 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a02f7-edc2-494f-be70-8cf182b82dc4 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:14.601696 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:14.619590 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:14.685869 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a02f7-edc2-494f-be70-8cf182b82dc4 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:14.711061 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 77/161] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:06:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 778 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 12:06:14.712348 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f5f50-4d92-4483-9d84-8826804fc586 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:14.712649 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f5f50-4d92-4483-9d84-8826804fc586 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:14.712916 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f5f50-4d92-4483-9d84-8826804fc586 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:14.715052 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 78/162] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:14.715751 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f5f50-4d92-4483-9d84-8826804fc586 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:14.727504 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987f84b-ad70-4fae-ab92-1f76ee97a7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:14.728543 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987f84b-ad70-4fae-ab92-1f76ee97a7c3 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:14.729208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987f84b-ad70-4fae-ab92-1f76ee97a7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:14.729727 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987f84b-ad70-4fae-ab92-1f76ee97a7c3 None admin] PATH_INFO: `/v3/users/96c3d608c85140b1bcd4f716a3c47b7a` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:14.731161 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987f84b-ad70-4fae-ab92-1f76ee97a7c3 None admin] RBAC: Authorizing `identity:get_user(user_id=96c3d608c85140b1bcd4f716a3c47b7a)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:14.732821 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987f84b-ad70-4fae-ab92-1f76ee97a7c3 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:14.734755 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 85/163] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:06:14 2022] GET /identity/v3/users/96c3d608c85140b1bcd4f716a3c47b7a => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:14.739191 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987f84b-ad70-4fae-ab92-1f76ee97a7c3 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:14.846641 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:14.858051 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987f84b-ad70-4fae-ab92-1f76ee97a7c3 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:14.894951 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc79a90-8321-4612-ba3a-97e98d91f160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:14.895961 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc79a90-8321-4612-ba3a-97e98d91f160 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:14.896490 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc79a90-8321-4612-ba3a-97e98d91f160 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:14.896956 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc79a90-8321-4612-ba3a-97e98d91f160 None admin] PATH_INFO: `/v3/projects/39342ea2ea9b45c8817058e7bed7c739` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:14.898311 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc79a90-8321-4612-ba3a-97e98d91f160 None admin] RBAC: Authorizing `identity:get_project(project_id=39342ea2ea9b45c8817058e7bed7c739)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:14.900212 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc79a90-8321-4612-ba3a-97e98d91f160 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:14.902725 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 86/164] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:06:14 2022] GET /identity/v3/projects/39342ea2ea9b45c8817058e7bed7c739 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:14.904485 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42717c8-2c8c-4939-9cc7-64c649e06992 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:14.905052 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42717c8-2c8c-4939-9cc7-64c649e06992 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:14.905527 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42717c8-2c8c-4939-9cc7-64c649e06992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:14.927964 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-a42717c8-2c8c-4939-9cc7-64c649e06992 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:14.929728 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a42717c8-2c8c-4939-9cc7-64c649e06992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:14.947059 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f5f50-4d92-4483-9d84-8826804fc586 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:15.009552 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 87/165] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:06:15.014794 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d2022-11be-4802-818f-45159387a129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:15.015690 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d2022-11be-4802-818f-45159387a129 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:15.016204 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d2022-11be-4802-818f-45159387a129 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:15.017254 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42717c8-2c8c-4939-9cc7-64c649e06992 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:15.017530 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d2022-11be-4802-818f-45159387a129 None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:15.018443 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d2022-11be-4802-818f-45159387a129 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:15.021214 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d2022-11be-4802-818f-45159387a129 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:15.022885 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d2022-11be-4802-818f-45159387a129 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:15.040743 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 79/166] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:06:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:15.044214 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d2022-11be-4802-818f-45159387a129 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:15.084977 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:15.157237 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:15.171305 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42717c8-2c8c-4939-9cc7-64c649e06992 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:15.209914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f96dd-ecae-4c9d-98ef-52b2e8854dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:15.210948 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f96dd-ecae-4c9d-98ef-52b2e8854dd8 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:15.211438 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f96dd-ecae-4c9d-98ef-52b2e8854dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:15.211968 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f96dd-ecae-4c9d-98ef-52b2e8854dd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:15.280322 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d2022-11be-4802-818f-45159387a129 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:15.346532 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f96dd-ecae-4c9d-98ef-52b2e8854dd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:15.347996 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f96dd-ecae-4c9d-98ef-52b2e8854dd8 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:15.363535 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50455c07-ebf8-4751-b273-2f59c6e8b300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:15.364143 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50455c07-ebf8-4751-b273-2f59c6e8b300 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:15.364419 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50455c07-ebf8-4751-b273-2f59c6e8b300 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:15.364691 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50455c07-ebf8-4751-b273-2f59c6e8b300 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:15.365417 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50455c07-ebf8-4751-b273-2f59c6e8b300 None admin] RBAC: Adding query filter params (role.id=72c80b472acb462ebadd86463efe91f7, scope.project.id=39342ea2ea9b45c8817058e7bed7c739, user.id=5ede9eacb91d469ab92c14848276a5bb) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:15.365720 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50455c07-ebf8-4751-b273-2f59c6e8b300 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:15.367198 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50455c07-ebf8-4751-b273-2f59c6e8b300 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:15.382706 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 80/167] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:06:15 2022] GET /identity/v3/role_assignments?user.id=5ede9eacb91d469ab92c14848276a5bb&scope.project.id=39342ea2ea9b45c8817058e7bed7c739&role.id=72c80b472acb462ebadd86463efe91f7 => generated 608 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:15.383562 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50455c07-ebf8-4751-b273-2f59c6e8b300 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:15.547658 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:15.580336 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:15.594517 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50455c07-ebf8-4751-b273-2f59c6e8b300 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:15.611634 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 88/168] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:06:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 12:06:15.627697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f96dd-ecae-4c9d-98ef-52b2e8854dd8 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:15.653667 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1286b292-9b3c-4146-8eb8-6b7f67a2e78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:15.654421 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286b292-9b3c-4146-8eb8-6b7f67a2e78c None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:15.654751 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286b292-9b3c-4146-8eb8-6b7f67a2e78c None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:15.655023 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286b292-9b3c-4146-8eb8-6b7f67a2e78c None admin] PATH_INFO: `/v3/users/96c3d608c85140b1bcd4f716a3c47b7a` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:15.656463 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1286b292-9b3c-4146-8eb8-6b7f67a2e78c None admin] RBAC: Authorizing `identity:get_user(user_id=96c3d608c85140b1bcd4f716a3c47b7a)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:15.663212 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1286b292-9b3c-4146-8eb8-6b7f67a2e78c None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:15.665730 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 81/169] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:06:15 2022] GET /identity/v3/users/96c3d608c85140b1bcd4f716a3c47b7a => generated 275 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:15.672108 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1286b292-9b3c-4146-8eb8-6b7f67a2e78c None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:15.873257 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1286b292-9b3c-4146-8eb8-6b7f67a2e78c None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:15.888805 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f96dd-ecae-4c9d-98ef-52b2e8854dd8 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:15.935234 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b041fd36-de32-4182-8b1d-cef765de6035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:15.936191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041fd36-de32-4182-8b1d-cef765de6035 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:15.936736 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041fd36-de32-4182-8b1d-cef765de6035 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:15.937181 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041fd36-de32-4182-8b1d-cef765de6035 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:15.943975 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2adf475-95ff-4a9b-8215-4adfd53d3c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:15.944623 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2adf475-95ff-4a9b-8215-4adfd53d3c60 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:15.944924 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2adf475-95ff-4a9b-8215-4adfd53d3c60 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:15.945194 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2adf475-95ff-4a9b-8215-4adfd53d3c60 None admin] PATH_INFO: `/v3/projects/39342ea2ea9b45c8817058e7bed7c739` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:15.949852 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2adf475-95ff-4a9b-8215-4adfd53d3c60 None admin] RBAC: Authorizing `identity:get_project(project_id=39342ea2ea9b45c8817058e7bed7c739)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:15.951338 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2adf475-95ff-4a9b-8215-4adfd53d3c60 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:15.953121 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 89/170] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:06:15 2022] GET /identity/v3/projects/39342ea2ea9b45c8817058e7bed7c739 => generated 298 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:15.954484 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2adf475-95ff-4a9b-8215-4adfd53d3c60 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:15.966419 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:16.026216 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:16.053620 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b041fd36-de32-4182-8b1d-cef765de6035 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:16.055140 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b041fd36-de32-4182-8b1d-cef765de6035 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:16.091067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2adf475-95ff-4a9b-8215-4adfd53d3c60 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:16.151272 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c240b-66a3-49fe-bd14-85a06c10cf02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:16.152566 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c240b-66a3-49fe-bd14-85a06c10cf02 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:16.152849 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c240b-66a3-49fe-bd14-85a06c10cf02 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:16.153115 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c240b-66a3-49fe-bd14-85a06c10cf02 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:16.179687 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253c240b-66a3-49fe-bd14-85a06c10cf02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:16.191724 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-253c240b-66a3-49fe-bd14-85a06c10cf02 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 12:06:16.191724 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:16.191724 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:16.191724 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:16.191724 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:16.191724 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:16.191724 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:16.191724 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:16.191724 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:16.191724 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:16.191724 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:16.191724 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:16.191724 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:16.191724 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:16.191724 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:16.191724 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:16.192691 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:16.192691 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:16.192691 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:16.192691 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:16.192691 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:16.192691 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:16.192691 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:16.192691 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:16.192691 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:16.192691 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:16.192691 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:16.192691 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:16.192691 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:16.192691 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:16.192691 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:16.192691 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:16.193489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:16.193489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:16.193489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:16.193489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:16.193489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:16.193489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:16.193489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:16.193489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:16.193489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:16.193489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:16.193489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 12:06:16.193489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:06:16.193489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 90/171] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:06:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:06:16.194130 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c240b-66a3-49fe-bd14-85a06c10cf02 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:16.231656 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 82/172] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:06:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 12:06:16.235292 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b041fd36-de32-4182-8b1d-cef765de6035 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:16.310550 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:16.360691 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b041fd36-de32-4182-8b1d-cef765de6035 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:16.396761 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e435a3-bf91-4179-8af2-9d7abdf25ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:16.397375 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e435a3-bf91-4179-8af2-9d7abdf25ac0 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:16.397650 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e435a3-bf91-4179-8af2-9d7abdf25ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:16.397917 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e435a3-bf91-4179-8af2-9d7abdf25ac0 None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:16.398596 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e435a3-bf91-4179-8af2-9d7abdf25ac0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:16.398897 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e435a3-bf91-4179-8af2-9d7abdf25ac0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:16.400289 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e435a3-bf91-4179-8af2-9d7abdf25ac0 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:16.400840 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c240b-66a3-49fe-bd14-85a06c10cf02 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:16.409743 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 83/173] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Sep 21 12:06:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:16.410619 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e435a3-bf91-4179-8af2-9d7abdf25ac0 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:16.431259 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:16.469098 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26039bca-bd54-4a9d-b6a7-c168c02d23a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:16.470235 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26039bca-bd54-4a9d-b6a7-c168c02d23a2 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:16.470740 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26039bca-bd54-4a9d-b6a7-c168c02d23a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:16.471264 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26039bca-bd54-4a9d-b6a7-c168c02d23a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:16.472198 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26039bca-bd54-4a9d-b6a7-c168c02d23a2 None admin] RBAC: Adding query filter params (role.id=9712f7b332bf484689b3706721ab6311, scope.project.id=39342ea2ea9b45c8817058e7bed7c739, user.id=96c3d608c85140b1bcd4f716a3c47b7a) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:16.472729 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26039bca-bd54-4a9d-b6a7-c168c02d23a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:16.474695 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26039bca-bd54-4a9d-b6a7-c168c02d23a2 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:16.487135 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 91/174] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:06:16 2022] GET /identity/v3/role_assignments?user.id=96c3d608c85140b1bcd4f716a3c47b7a&scope.project.id=39342ea2ea9b45c8817058e7bed7c739&role.id=9712f7b332bf484689b3706721ab6311 => generated 608 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:16.488361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26039bca-bd54-4a9d-b6a7-c168c02d23a2 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:16.535988 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e435a3-bf91-4179-8af2-9d7abdf25ac0 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:16.558108 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:16.591918 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd18452-3246-4ed8-986d-192967bfe2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:16.592583 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd18452-3246-4ed8-986d-192967bfe2af None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:16.592860 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd18452-3246-4ed8-986d-192967bfe2af None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:16.593127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd18452-3246-4ed8-986d-192967bfe2af None admin] PATH_INFO: `/v3/projects/39342ea2ea9b45c8817058e7bed7c739` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:16.596531 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd18452-3246-4ed8-986d-192967bfe2af None admin] RBAC: Authorizing `identity:get_project(project_id=39342ea2ea9b45c8817058e7bed7c739)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:16.596531 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd18452-3246-4ed8-986d-192967bfe2af None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:16.597739 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 84/175] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:06:16 2022] GET /identity/v3/projects/39342ea2ea9b45c8817058e7bed7c739 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:16.599662 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402e086-adef-4630-82d3-93644dea695e None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:16.600374 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402e086-adef-4630-82d3-93644dea695e None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:16.602844 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402e086-adef-4630-82d3-93644dea695e None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:16.606306 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 85/176] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:16.607499 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402e086-adef-4630-82d3-93644dea695e None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:16.672922 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26039bca-bd54-4a9d-b6a7-c168c02d23a2 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:16.739118 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddada3b-3120-47b9-8185-f3b76666a2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:16.739768 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddada3b-3120-47b9-8185-f3b76666a2e8 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:16.740048 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddada3b-3120-47b9-8185-f3b76666a2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:16.740316 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddada3b-3120-47b9-8185-f3b76666a2e8 None admin] PATH_INFO: `/v3/users/96c3d608c85140b1bcd4f716a3c47b7a` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:16.741527 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddada3b-3120-47b9-8185-f3b76666a2e8 None admin] RBAC: Authorizing `identity:get_user(user_id=96c3d608c85140b1bcd4f716a3c47b7a)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:16.743013 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddada3b-3120-47b9-8185-f3b76666a2e8 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:16.744885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 92/177] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:06:16 2022] GET /identity/v3/users/96c3d608c85140b1bcd4f716a3c47b7a => generated 275 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:16.746052 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6449c33-08f1-4066-929d-598eac5b4891 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:16.746330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6449c33-08f1-4066-929d-598eac5b4891 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:16.746624 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6449c33-08f1-4066-929d-598eac5b4891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:16.772853 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402e086-adef-4630-82d3-93644dea695e None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:16.787456 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-e6449c33-08f1-4066-929d-598eac5b4891 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:16.788674 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-e6449c33-08f1-4066-929d-598eac5b4891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:16.811657 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046da82-e820-4e41-9d39-556ca2285aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:16.812079 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046da82-e820-4e41-9d39-556ca2285aa1 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:16.812358 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046da82-e820-4e41-9d39-556ca2285aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:16.812628 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046da82-e820-4e41-9d39-556ca2285aa1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:16.813358 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5046da82-e820-4e41-9d39-556ca2285aa1 None admin] RBAC: Adding query filter params (role.id=173d0e93641b4882934b75f256b38534, scope.project.id=39342ea2ea9b45c8817058e7bed7c739, user.id=96c3d608c85140b1bcd4f716a3c47b7a) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:16.813662 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5046da82-e820-4e41-9d39-556ca2285aa1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:16.815256 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5046da82-e820-4e41-9d39-556ca2285aa1 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:16.822710 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 86/178] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:06:16 2022] GET /identity/v3/role_assignments?user.id=96c3d608c85140b1bcd4f716a3c47b7a&scope.project.id=39342ea2ea9b45c8817058e7bed7c739&role.id=173d0e93641b4882934b75f256b38534 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:16.824263 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046da82-e820-4e41-9d39-556ca2285aa1 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:16.853354 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:16.876837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:16.883581 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 93/179] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:06:16.885263 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32c357-e592-459a-b1a4-190ef65b7b6f None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:16.885878 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32c357-e592-459a-b1a4-190ef65b7b6f None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:16.886959 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32c357-e592-459a-b1a4-190ef65b7b6f None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:16.888507 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 94/180] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:16.899524 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d965e53-ac3a-42f4-8311-7040aae29b07 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:16.900203 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d965e53-ac3a-42f4-8311-7040aae29b07 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:16.900738 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d965e53-ac3a-42f4-8311-7040aae29b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:16.925629 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-5d965e53-ac3a-42f4-8311-7040aae29b07 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:16.927227 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-5d965e53-ac3a-42f4-8311-7040aae29b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:16.949963 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046da82-e820-4e41-9d39-556ca2285aa1 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:16.990654 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76be3c-e367-4304-8e1e-ef4f73adbd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:16.991302 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76be3c-e367-4304-8e1e-ef4f73adbd95 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:16.991565 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76be3c-e367-4304-8e1e-ef4f73adbd95 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:16.991837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76be3c-e367-4304-8e1e-ef4f73adbd95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:17.009632 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 95/181] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 12:06:17.066713 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd76be3c-e367-4304-8e1e-ef4f73adbd95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:17.068187 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd76be3c-e367-4304-8e1e-ef4f73adbd95 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:17.116224 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:17.176349 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 87/182] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:06:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 12:06:17.182258 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d965e53-ac3a-42f4-8311-7040aae29b07 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:17.330574 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d965e53-ac3a-42f4-8311-7040aae29b07 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:17.351954 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:17.380426 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3f952-3c6b-47f4-9372-3a4c8f2c84a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:17.381158 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3f952-3c6b-47f4-9372-3a4c8f2c84a8 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:17.381337 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3f952-3c6b-47f4-9372-3a4c8f2c84a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:17.381592 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3f952-3c6b-47f4-9372-3a4c8f2c84a8 None admin] PATH_INFO: `/v3/projects/4d0a523bbdb54af1b51ed783457ec0d1` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:17.382741 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3f952-3c6b-47f4-9372-3a4c8f2c84a8 None admin] RBAC: Authorizing `identity:get_project(project_id=4d0a523bbdb54af1b51ed783457ec0d1)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:17.384261 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3f952-3c6b-47f4-9372-3a4c8f2c84a8 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:17.386142 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 96/183] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:06:17 2022] GET /identity/v3/projects/4d0a523bbdb54af1b51ed783457ec0d1 => generated 312 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:17.386933 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76be3c-e367-4304-8e1e-ef4f73adbd95 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:17.394198 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3f952-3c6b-47f4-9372-3a4c8f2c84a8 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:17.511944 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76be3c-e367-4304-8e1e-ef4f73adbd95 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:17.532398 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3f952-3c6b-47f4-9372-3a4c8f2c84a8 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:17.550087 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c36809-f2d3-451e-98f7-8b8b5ef86966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:17.550753 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c36809-f2d3-451e-98f7-8b8b5ef86966 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:17.551026 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c36809-f2d3-451e-98f7-8b8b5ef86966 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:17.551290 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c36809-f2d3-451e-98f7-8b8b5ef86966 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:17.567077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c36809-f2d3-451e-98f7-8b8b5ef86966 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:17.570642 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357af7db-6df3-476f-b020-982737f8bbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:17.572627 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357af7db-6df3-476f-b020-982737f8bbab None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:17.572627 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357af7db-6df3-476f-b020-982737f8bbab None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:17.572627 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357af7db-6df3-476f-b020-982737f8bbab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:17.572867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-20c36809-f2d3-451e-98f7-8b8b5ef86966 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:06:17.572867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:17.572867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:17.572867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:17.572867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:17.572867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:17.572867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:17.572867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:17.572867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:17.572867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:17.572867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:17.572867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:17.572867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:17.572867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:17.572867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:17.572867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:17.574225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:17.574225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:17.574225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:17.574225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:17.574225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:17.574225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:17.574225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:17.574225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:17.574225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:17.574225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:17.574225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:17.574225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:17.574225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:17.574225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:17.574225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:17.574225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:17.575073 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:17.575073 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:17.575073 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:17.575073 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:17.575073 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:17.575073 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:17.575073 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:17.575073 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:17.575073 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:17.575073 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:17.575073 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:06:17.575073 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:06:17.575671 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357af7db-6df3-476f-b020-982737f8bbab None admin] RBAC: Adding query filter params (role.id=9712f7b332bf484689b3706721ab6311, scope.project.id=4d0a523bbdb54af1b51ed783457ec0d1, user.id=96c3d608c85140b1bcd4f716a3c47b7a) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:17.575671 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357af7db-6df3-476f-b020-982737f8bbab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:17.575790 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 88/184] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Sep 21 12:06:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 12:06:17.575790 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c36809-f2d3-451e-98f7-8b8b5ef86966 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:17.575916 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357af7db-6df3-476f-b020-982737f8bbab None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:17.580568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:17.582481 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 97/185] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:06:17 2022] GET /identity/v3/role_assignments?user.id=96c3d608c85140b1bcd4f716a3c47b7a&scope.project.id=4d0a523bbdb54af1b51ed783457ec0d1&role.id=9712f7b332bf484689b3706721ab6311 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:06:17.583488 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125b700-567c-4a55-83c3-8a61dbe35d36 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:17.583858 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125b700-567c-4a55-83c3-8a61dbe35d36 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:17.584359 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125b700-567c-4a55-83c3-8a61dbe35d36 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:17.585671 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 98/186] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:17.591260 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e125b700-567c-4a55-83c3-8a61dbe35d36 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:17.662864 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:17.733935 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c36809-f2d3-451e-98f7-8b8b5ef86966 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:17.737663 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e125b700-567c-4a55-83c3-8a61dbe35d36 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:17.773186 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6bf5c7-ef12-4c33-98be-46c483b1b604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:17.773747 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6bf5c7-ef12-4c33-98be-46c483b1b604 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:17.774146 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6bf5c7-ef12-4c33-98be-46c483b1b604 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:17.774456 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6bf5c7-ef12-4c33-98be-46c483b1b604 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:17.782180 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36291747-2422-4a81-9f85-ec46afd41e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:17.782998 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36291747-2422-4a81-9f85-ec46afd41e5a None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:17.783276 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36291747-2422-4a81-9f85-ec46afd41e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:17.783546 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36291747-2422-4a81-9f85-ec46afd41e5a None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:17.784245 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36291747-2422-4a81-9f85-ec46afd41e5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:17.784558 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36291747-2422-4a81-9f85-ec46afd41e5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:17.785995 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36291747-2422-4a81-9f85-ec46afd41e5a None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:17.791406 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6bf5c7-ef12-4c33-98be-46c483b1b604 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:17.797169 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 99/187] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:06:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:17.798821 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-9a6bf5c7-ef12-4c33-98be-46c483b1b604 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 12:06:17.798821 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:17.798821 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:17.798821 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:17.798821 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:17.798821 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:17.798821 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:17.798821 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:17.798821 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:17.798821 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:17.798821 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:17.798821 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:17.798821 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:17.798821 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:17.798821 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:17.798821 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:17.799687 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:17.799687 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:17.799687 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:17.799687 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:17.799687 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:17.799687 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:17.799687 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:17.799687 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:17.799687 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:17.799687 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:17.799687 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:17.799687 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:17.799687 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:17.799687 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:17.799687 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:17.799687 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:17.800480 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:17.800480 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:17.800480 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:17.800480 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:17.800480 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:17.800480 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:17.800480 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:17.800480 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:17.800480 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:17.800480 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:17.800480 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 12:06:17.800480 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:06:17.801073 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d919dd-dff9-446d-bec9-dd59f7173595 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:17.801073 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d919dd-dff9-446d-bec9-dd59f7173595 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:17.801073 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d919dd-dff9-446d-bec9-dd59f7173595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:17.803344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 89/188] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:06:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:06:17.804542 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6bf5c7-ef12-4c33-98be-46c483b1b604 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:17.819911 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-78d919dd-dff9-446d-bec9-dd59f7173595 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:17.821145 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-78d919dd-dff9-446d-bec9-dd59f7173595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:17.877033 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:17.905363 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 100/189] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:06:17.906195 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d919dd-dff9-446d-bec9-dd59f7173595 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:17.942128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6bf5c7-ef12-4c33-98be-46c483b1b604 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:17.944353 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:17.978797 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaad12c-6468-4fae-9e19-83486f42feeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:17.979431 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaad12c-6468-4fae-9e19-83486f42feeb None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:17.979741 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaad12c-6468-4fae-9e19-83486f42feeb None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:17.980014 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaad12c-6468-4fae-9e19-83486f42feeb None admin] PATH_INFO: `/v3/users/1e73ad0ba2484af49b2806be5738b4cf` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:17.996389 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaad12c-6468-4fae-9e19-83486f42feeb None admin] RBAC: Authorizing `identity:get_user(user_id=1e73ad0ba2484af49b2806be5738b4cf)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:17.997854 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaad12c-6468-4fae-9e19-83486f42feeb None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:17.999687 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 90/190] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:06:17 2022] GET /identity/v3/users/1e73ad0ba2484af49b2806be5738b4cf => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:18.000681 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfda7db-b920-430d-8e7e-4374d3e9ea51 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:18.000967 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfda7db-b920-430d-8e7e-4374d3e9ea51 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:18.001238 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfda7db-b920-430d-8e7e-4374d3e9ea51 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:18.002576 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 91/191] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:18.004799 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfda7db-b920-430d-8e7e-4374d3e9ea51 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:18.022067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d919dd-dff9-446d-bec9-dd59f7173595 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:18.058639 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52315738-59be-4528-9582-c8ee471ef4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:18.059302 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52315738-59be-4528-9582-c8ee471ef4ef None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:18.059534 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52315738-59be-4528-9582-c8ee471ef4ef None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:18.059802 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52315738-59be-4528-9582-c8ee471ef4ef None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:18.060466 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52315738-59be-4528-9582-c8ee471ef4ef None admin] RBAC: Adding query filter params (name=reader) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:18.060771 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52315738-59be-4528-9582-c8ee471ef4ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:18.062145 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52315738-59be-4528-9582-c8ee471ef4ef None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:18.075038 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 101/192] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Sep 21 12:06:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:18.075038 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8877196-7f99-4f82-b4ea-fceeabed1afd None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:18.075038 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8877196-7f99-4f82-b4ea-fceeabed1afd None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:18.075038 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8877196-7f99-4f82-b4ea-fceeabed1afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:18.091222 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-f8877196-7f99-4f82-b4ea-fceeabed1afd None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:18.092420 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f8877196-7f99-4f82-b4ea-fceeabed1afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:18.118832 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfda7db-b920-430d-8e7e-4374d3e9ea51 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:18.139578 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:18.154867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c0b54-e63d-4ad9-9510-7cc0789b5d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:18.155482 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c0b54-e63d-4ad9-9510-7cc0789b5d6f None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:18.155763 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c0b54-e63d-4ad9-9510-7cc0789b5d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:18.156038 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c0b54-e63d-4ad9-9510-7cc0789b5d6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:18.164673 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 102/193] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:06:18.165332 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8877196-7f99-4f82-b4ea-fceeabed1afd None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:18.197013 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:18.228236 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c0b54-e63d-4ad9-9510-7cc0789b5d6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:18.230240 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c0b54-e63d-4ad9-9510-7cc0789b5d6f None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:18.278642 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8877196-7f99-4f82-b4ea-fceeabed1afd None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:18.317470 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d7dc83-8d5a-4c2f-8a62-bc5e0efd61db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:18.318104 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d7dc83-8d5a-4c2f-8a62-bc5e0efd61db None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:18.318476 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d7dc83-8d5a-4c2f-8a62-bc5e0efd61db None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:18.318811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d7dc83-8d5a-4c2f-8a62-bc5e0efd61db None admin] PATH_INFO: `/v3/users/b0b8b1d40af040b4908e003f6da65064` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:18.320026 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d7dc83-8d5a-4c2f-8a62-bc5e0efd61db None admin] RBAC: Authorizing `identity:get_user(user_id=b0b8b1d40af040b4908e003f6da65064)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:18.321535 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d7dc83-8d5a-4c2f-8a62-bc5e0efd61db None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:18.323135 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 103/194] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:06:18 2022] GET /identity/v3/users/b0b8b1d40af040b4908e003f6da65064 => generated 289 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:18.323135 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d7dc83-8d5a-4c2f-8a62-bc5e0efd61db None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:18.346054 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 92/195] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:06:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 12:06:18.346926 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c0b54-e63d-4ad9-9510-7cc0789b5d6f None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:18.373150 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:18.434113 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:18.441940 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d7dc83-8d5a-4c2f-8a62-bc5e0efd61db None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:18.455676 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c0b54-e63d-4ad9-9510-7cc0789b5d6f None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:18.475269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500845d9-7e3c-44e0-9f64-880e51423e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:18.475892 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500845d9-7e3c-44e0-9f64-880e51423e55 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:18.476179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500845d9-7e3c-44e0-9f64-880e51423e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:18.476451 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500845d9-7e3c-44e0-9f64-880e51423e55 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:18.487185 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500845d9-7e3c-44e0-9f64-880e51423e55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:18.492459 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-500845d9-7e3c-44e0-9f64-880e51423e55 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 12:06:18.492459 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:18.492459 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:18.492459 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:18.492459 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:18.492459 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:18.492459 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:18.492459 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:18.492459 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:18.492459 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:18.492459 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:18.492459 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:18.492459 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:18.492459 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:18.492459 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:18.492459 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:18.493527 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:18.493527 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:18.493527 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:18.493527 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:18.493527 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:18.493527 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:18.493527 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:18.493527 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:18.493527 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:18.493527 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:18.493527 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:18.493527 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:18.493527 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:18.493527 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:18.493527 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:18.493527 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:18.494330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:18.494330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:18.494330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:18.494330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:18.494330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:18.494330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:18.494330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:18.494330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:18.494330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:18.494330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:18.494330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 12:06:18.494330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:06:18.494330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 104/196] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Sep 21 12:06:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:06:18.494330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500845d9-7e3c-44e0-9f64-880e51423e55 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:18.497907 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143ad1c-d18a-451c-be3c-5a24b72d8c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:18.498624 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143ad1c-d18a-451c-be3c-5a24b72d8c28 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:18.499198 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143ad1c-d18a-451c-be3c-5a24b72d8c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:18.499486 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143ad1c-d18a-451c-be3c-5a24b72d8c28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:18.565751 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c143ad1c-d18a-451c-be3c-5a24b72d8c28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:18.567350 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c143ad1c-d18a-451c-be3c-5a24b72d8c28 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:18.587564 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:18.602313 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500845d9-7e3c-44e0-9f64-880e51423e55 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:18.635848 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d7a70-54ff-49d7-9302-2e8fd0badcfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:18.636499 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d7a70-54ff-49d7-9302-2e8fd0badcfe None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:18.636783 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d7a70-54ff-49d7-9302-2e8fd0badcfe None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:18.637060 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d7a70-54ff-49d7-9302-2e8fd0badcfe None admin] PATH_INFO: `/v3/projects/1367e35623684adc931fd16f99a77b44` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:18.638207 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d7a70-54ff-49d7-9302-2e8fd0badcfe None admin] RBAC: Authorizing `identity:get_project(project_id=1367e35623684adc931fd16f99a77b44)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:18.639947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d7a70-54ff-49d7-9302-2e8fd0badcfe None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:18.641592 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 105/197] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:06:18 2022] GET /identity/v3/projects/1367e35623684adc931fd16f99a77b44 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:18.641592 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d7a70-54ff-49d7-9302-2e8fd0badcfe None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:18.668961 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:18.669127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 93/198] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:06:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 12:06:18.669889 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143ad1c-d18a-451c-be3c-5a24b72d8c28 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:18.758583 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d7a70-54ff-49d7-9302-2e8fd0badcfe None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:18.772829 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143ad1c-d18a-451c-be3c-5a24b72d8c28 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:18.794757 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:18.801034 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad733b6-2428-4e8b-aac4-5dfa5ea88f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:18.801618 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad733b6-2428-4e8b-aac4-5dfa5ea88f37 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:18.801903 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad733b6-2428-4e8b-aac4-5dfa5ea88f37 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:18.802175 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad733b6-2428-4e8b-aac4-5dfa5ea88f37 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:18.803297 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad733b6-2428-4e8b-aac4-5dfa5ea88f37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:18.804728 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad733b6-2428-4e8b-aac4-5dfa5ea88f37 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:18.806281 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 106/199] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:06:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:18.807058 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad733b6-2428-4e8b-aac4-5dfa5ea88f37 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:18.809351 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def60db-44a4-4789-82dc-30bb5ce5e110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:18.810072 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def60db-44a4-4789-82dc-30bb5ce5e110 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:18.810346 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def60db-44a4-4789-82dc-30bb5ce5e110 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:18.810639 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def60db-44a4-4789-82dc-30bb5ce5e110 None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:18.811334 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def60db-44a4-4789-82dc-30bb5ce5e110 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:18.811598 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def60db-44a4-4789-82dc-30bb5ce5e110 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:18.812960 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def60db-44a4-4789-82dc-30bb5ce5e110 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:18.821101 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 94/200] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:06:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:18.821708 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def60db-44a4-4789-82dc-30bb5ce5e110 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:18.898640 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:18.909156 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad733b6-2428-4e8b-aac4-5dfa5ea88f37 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:18.922210 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def60db-44a4-4789-82dc-30bb5ce5e110 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:18.942010 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8402d-d568-4a16-bd57-fb458b7b19bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:18.942632 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8402d-d568-4a16-bd57-fb458b7b19bc None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:18.942908 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8402d-d568-4a16-bd57-fb458b7b19bc None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:18.943174 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8402d-d568-4a16-bd57-fb458b7b19bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:18.943889 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8402d-d568-4a16-bd57-fb458b7b19bc None admin] RBAC: Adding query filter params (role.id=72c80b472acb462ebadd86463efe91f7, scope.project.id=1367e35623684adc931fd16f99a77b44, user.id=1e73ad0ba2484af49b2806be5738b4cf) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:18.944186 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8402d-d568-4a16-bd57-fb458b7b19bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:18.945611 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8402d-d568-4a16-bd57-fb458b7b19bc None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:18.951385 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 107/201] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:06:18 2022] GET /identity/v3/role_assignments?user.id=1e73ad0ba2484af49b2806be5738b4cf&scope.project.id=1367e35623684adc931fd16f99a77b44&role.id=72c80b472acb462ebadd86463efe91f7 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:18.955293 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8402d-d568-4a16-bd57-fb458b7b19bc None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:18.957531 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60945bc0-adfa-478c-bfb9-6bc3330de380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:18.958227 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60945bc0-adfa-478c-bfb9-6bc3330de380 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:18.958542 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60945bc0-adfa-478c-bfb9-6bc3330de380 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:18.958818 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60945bc0-adfa-478c-bfb9-6bc3330de380 None admin] PATH_INFO: `/v3/projects/39342ea2ea9b45c8817058e7bed7c739` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:18.960055 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60945bc0-adfa-478c-bfb9-6bc3330de380 None admin] RBAC: Authorizing `identity:get_project(project_id=39342ea2ea9b45c8817058e7bed7c739)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:18.961562 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60945bc0-adfa-478c-bfb9-6bc3330de380 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:18.969335 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 95/202] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:06:18 2022] GET /identity/v3/projects/39342ea2ea9b45c8817058e7bed7c739 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:18.969335 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60945bc0-adfa-478c-bfb9-6bc3330de380 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:19.032762 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:19.077854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8402d-d568-4a16-bd57-fb458b7b19bc None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:19.091753 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60945bc0-adfa-478c-bfb9-6bc3330de380 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:19.117275 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c64e18-727a-414f-9af1-5725a9ecfe1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:19.117996 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c64e18-727a-414f-9af1-5725a9ecfe1a None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:19.118279 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c64e18-727a-414f-9af1-5725a9ecfe1a None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:19.118588 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c64e18-727a-414f-9af1-5725a9ecfe1a None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:19.119251 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c64e18-727a-414f-9af1-5725a9ecfe1a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:19.122403 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c64e18-727a-414f-9af1-5725a9ecfe1a None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:19.132483 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa794c5-ea8b-4b5b-b41c-a694080763c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:19.133351 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa794c5-ea8b-4b5b-b41c-a694080763c1 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:19.133725 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa794c5-ea8b-4b5b-b41c-a694080763c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:19.134809 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa794c5-ea8b-4b5b-b41c-a694080763c1 None admin] PATH_INFO: `/v3/users/1e73ad0ba2484af49b2806be5738b4cf` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:19.135531 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa794c5-ea8b-4b5b-b41c-a694080763c1 None admin] RBAC: Authorizing `identity:get_user(user_id=1e73ad0ba2484af49b2806be5738b4cf)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:19.142671 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa794c5-ea8b-4b5b-b41c-a694080763c1 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:19.142671 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 96/203] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:06:18 2022] GET /identity/v3/users/1e73ad0ba2484af49b2806be5738b4cf => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:19.142671 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa794c5-ea8b-4b5b-b41c-a694080763c1 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:19.150887 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 108/204] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Sep 21 12:06:18 2022] POST /identity/v3/users => generated 297 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:06:19.152413 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c64e18-727a-414f-9af1-5725a9ecfe1a None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:19.166641 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:19.271428 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa794c5-ea8b-4b5b-b41c-a694080763c1 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:19.274801 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c64e18-727a-414f-9af1-5725a9ecfe1a None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:19.291618 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:19.315505 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a07e9-9cb0-470f-b6df-07462947c60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:19.316150 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a07e9-9cb0-470f-b6df-07462947c60b None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:19.316404 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a07e9-9cb0-470f-b6df-07462947c60b None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:19.316674 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a07e9-9cb0-470f-b6df-07462947c60b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:19.317415 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a07e9-9cb0-470f-b6df-07462947c60b None admin] RBAC: Adding query filter params (role.id=65ae44a45ff2443eb03c2802be0453c9, scope.project.id=39342ea2ea9b45c8817058e7bed7c739, user.id=b0b8b1d40af040b4908e003f6da65064) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:19.317728 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a07e9-9cb0-470f-b6df-07462947c60b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:19.319275 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a07e9-9cb0-470f-b6df-07462947c60b None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:19.321966 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88fcc9b-2462-4800-a036-75d18421a0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:19.324291 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88fcc9b-2462-4800-a036-75d18421a0e7 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:19.325179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88fcc9b-2462-4800-a036-75d18421a0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:19.325659 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88fcc9b-2462-4800-a036-75d18421a0e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:19.326920 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 97/205] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:06:19 2022] GET /identity/v3/role_assignments?user.id=b0b8b1d40af040b4908e003f6da65064&scope.project.id=39342ea2ea9b45c8817058e7bed7c739&role.id=65ae44a45ff2443eb03c2802be0453c9 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:19.412120 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88fcc9b-2462-4800-a036-75d18421a0e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:19.413716 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88fcc9b-2462-4800-a036-75d18421a0e7 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:19.427759 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:19.532669 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 109/206] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:06:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 12:06:19.538744 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a07e9-9cb0-470f-b6df-07462947c60b None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:19.663186 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a07e9-9cb0-470f-b6df-07462947c60b None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:19.699812 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35f691-c85a-423c-9e52-baeca4b2d564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:19.700447 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35f691-c85a-423c-9e52-baeca4b2d564 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:19.700725 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35f691-c85a-423c-9e52-baeca4b2d564 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:19.701022 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35f691-c85a-423c-9e52-baeca4b2d564 None admin] PATH_INFO: `/v3/projects/1367e35623684adc931fd16f99a77b44` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:19.702149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c35f691-c85a-423c-9e52-baeca4b2d564 None admin] RBAC: Authorizing `identity:get_project(project_id=1367e35623684adc931fd16f99a77b44)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:19.703622 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c35f691-c85a-423c-9e52-baeca4b2d564 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:19.705625 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 98/207] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:06:19 2022] GET /identity/v3/projects/1367e35623684adc931fd16f99a77b44 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:19.711473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88fcc9b-2462-4800-a036-75d18421a0e7 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:19.816522 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88fcc9b-2462-4800-a036-75d18421a0e7 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:19.827704 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:19.852745 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837f239-dc6f-479b-a461-c28e874fb9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:19.853456 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837f239-dc6f-479b-a461-c28e874fb9b5 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:19.853802 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837f239-dc6f-479b-a461-c28e874fb9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:19.854143 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837f239-dc6f-479b-a461-c28e874fb9b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:19.855564 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5837f239-dc6f-479b-a461-c28e874fb9b5 None admin] RBAC: Adding query filter params (role.id=173d0e93641b4882934b75f256b38534, scope.project.id=1367e35623684adc931fd16f99a77b44, user.id=1e73ad0ba2484af49b2806be5738b4cf) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:19.856022 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5837f239-dc6f-479b-a461-c28e874fb9b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:19.857552 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5837f239-dc6f-479b-a461-c28e874fb9b5 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:19.864081 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 110/208] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:06:19 2022] GET /identity/v3/role_assignments?user.id=1e73ad0ba2484af49b2806be5738b4cf&scope.project.id=1367e35623684adc931fd16f99a77b44&role.id=173d0e93641b4882934b75f256b38534 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:21.181013 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d52ecb-1651-4633-9419-0e8e742608fa None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:21.181530 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d52ecb-1651-4633-9419-0e8e742608fa None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:21.181608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d52ecb-1651-4633-9419-0e8e742608fa None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:21.183229 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 99/209] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:21.188642 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6861f-0263-47c7-966c-64f2348730af None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:21.189086 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6861f-0263-47c7-966c-64f2348730af None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:21.189175 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6861f-0263-47c7-966c-64f2348730af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:21.208304 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-b2a6861f-0263-47c7-966c-64f2348730af None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:21.209508 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b2a6861f-0263-47c7-966c-64f2348730af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:21.279657 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 111/210] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 12:06:21.548857 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d52ecb-1651-4633-9419-0e8e742608fa None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:21.614654 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:21.672126 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d52ecb-1651-4633-9419-0e8e742608fa None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:21.710879 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c90ca8-edf9-4c09-86b7-29ba7eda18cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:21.711517 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c90ca8-edf9-4c09-86b7-29ba7eda18cc None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:21.711793 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c90ca8-edf9-4c09-86b7-29ba7eda18cc None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:21.712065 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c90ca8-edf9-4c09-86b7-29ba7eda18cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:21.719877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a371c-b36d-4d9c-8ea4-577b11b5b11f None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:21.720167 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a371c-b36d-4d9c-8ea4-577b11b5b11f None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:21.720445 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a371c-b36d-4d9c-8ea4-577b11b5b11f None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:21.721798 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 112/211] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:06:21.723472 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c90ca8-edf9-4c09-86b7-29ba7eda18cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:21.727604 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23f5f3-3989-495c-9886-cb292742dfcb None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:21.727948 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23f5f3-3989-495c-9886-cb292742dfcb None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:21.728298 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23f5f3-3989-495c-9886-cb292742dfcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:21.728802 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-c8c90ca8-edf9-4c09-86b7-29ba7eda18cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:06:21.728802 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:21.728802 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:21.728802 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:21.728802 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:21.728802 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:21.728802 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:21.728802 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:21.728802 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:21.728802 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:21.728802 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:21.728802 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:21.728802 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:21.728802 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:21.728802 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:21.728802 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:21.730203 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:21.730203 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:21.730203 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:21.730203 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:21.730203 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:21.730203 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:21.730203 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:21.730203 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:21.730203 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:21.730203 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:21.730203 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:21.730203 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:21.730203 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:21.730203 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:21.730203 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:21.730203 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:21.731032 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:21.731032 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:21.731032 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:21.731032 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:21.731032 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:21.731032 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:21.731032 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:21.731032 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:21.731032 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:21.731032 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:21.731032 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:06:21.731032 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:06:21.731032 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 100/212] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Sep 21 12:06:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:06:21.736205 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c90ca8-edf9-4c09-86b7-29ba7eda18cc None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:21.753040 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-7a23f5f3-3989-495c-9886-cb292742dfcb None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:21.754139 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7a23f5f3-3989-495c-9886-cb292742dfcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:21.830294 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 113/213] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 12:06:21.835667 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74638b7-2ece-41de-8512-6cf6cb752e13 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:21.835948 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74638b7-2ece-41de-8512-6cf6cb752e13 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:21.836218 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74638b7-2ece-41de-8512-6cf6cb752e13 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:21.837634 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 114/214] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:21.843476 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328db79-bb36-486d-a82c-e1a2bf91ead6 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:21.843762 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328db79-bb36-486d-a82c-e1a2bf91ead6 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:21.844041 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328db79-bb36-486d-a82c-e1a2bf91ead6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:21.860299 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c90ca8-edf9-4c09-86b7-29ba7eda18cc None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:21.862608 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-f328db79-bb36-486d-a82c-e1a2bf91ead6 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:21.864167 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f328db79-bb36-486d-a82c-e1a2bf91ead6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:21.872886 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:21.892587 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:21.905042 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc80dc0-73de-45d5-8c20-d98083ffb2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:21.905661 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc80dc0-73de-45d5-8c20-d98083ffb2fc None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:21.905941 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc80dc0-73de-45d5-8c20-d98083ffb2fc None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:21.906216 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc80dc0-73de-45d5-8c20-d98083ffb2fc None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:21.906922 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc80dc0-73de-45d5-8c20-d98083ffb2fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:21.907228 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc80dc0-73de-45d5-8c20-d98083ffb2fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:21.908616 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc80dc0-73de-45d5-8c20-d98083ffb2fc None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:21.923736 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 101/215] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:06:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:06:21.924856 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc80dc0-73de-45d5-8c20-d98083ffb2fc None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:21.947863 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 115/216] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 12:06:22.050808 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc80dc0-73de-45d5-8c20-d98083ffb2fc None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:22.079245 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefd917-b0a9-4a9d-b7f4-84a895b2ef41 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:22.079574 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefd917-b0a9-4a9d-b7f4-84a895b2ef41 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:22.079842 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefd917-b0a9-4a9d-b7f4-84a895b2ef41 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:22.081394 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 116/217] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:06:22.086745 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df65b73-9d4f-4848-8997-d5788b8cc63c None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:22.087032 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df65b73-9d4f-4848-8997-d5788b8cc63c None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:22.087308 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df65b73-9d4f-4848-8997-d5788b8cc63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:22.094724 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1ecf1-ab81-4c71-9e05-c26830dd00e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:22.095364 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1ecf1-ab81-4c71-9e05-c26830dd00e3 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:22.095646 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1ecf1-ab81-4c71-9e05-c26830dd00e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:22.095919 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1ecf1-ab81-4c71-9e05-c26830dd00e3 None admin] PATH_INFO: `/v3/users/1e73ad0ba2484af49b2806be5738b4cf` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:22.097088 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f1ecf1-ab81-4c71-9e05-c26830dd00e3 None admin] RBAC: Authorizing `identity:get_user(user_id=1e73ad0ba2484af49b2806be5738b4cf)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:22.098552 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f1ecf1-ab81-4c71-9e05-c26830dd00e3 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:22.100288 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 102/218] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:06:21 2022] GET /identity/v3/users/1e73ad0ba2484af49b2806be5738b4cf => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:22.107527 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1ecf1-ab81-4c71-9e05-c26830dd00e3 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:22.108111 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-2df65b73-9d4f-4848-8997-d5788b8cc63c None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:22.109561 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2df65b73-9d4f-4848-8997-d5788b8cc63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:22.156270 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:22.200327 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 117/219] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:06:22.210923 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df65b73-9d4f-4848-8997-d5788b8cc63c None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:22.227488 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1ecf1-ab81-4c71-9e05-c26830dd00e3 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:22.264376 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4862d-4b65-46e3-8528-7a5e0602e54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:22.265011 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4862d-4b65-46e3-8528-7a5e0602e54f None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:22.265286 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4862d-4b65-46e3-8528-7a5e0602e54f None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:22.265553 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4862d-4b65-46e3-8528-7a5e0602e54f None admin] PATH_INFO: `/v3/projects/1367e35623684adc931fd16f99a77b44` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:22.266697 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b4862d-4b65-46e3-8528-7a5e0602e54f None admin] RBAC: Authorizing `identity:get_project(project_id=1367e35623684adc931fd16f99a77b44)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:22.268131 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b4862d-4b65-46e3-8528-7a5e0602e54f None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:22.269745 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 103/220] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:06:22 2022] GET /identity/v3/projects/1367e35623684adc931fd16f99a77b44 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:22.270523 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4862d-4b65-46e3-8528-7a5e0602e54f None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:22.317919 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:22.325375 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df65b73-9d4f-4848-8997-d5788b8cc63c None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:22.367738 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6edeaea-c558-46f5-953c-182d9946843d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:22.369037 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edeaea-c558-46f5-953c-182d9946843d None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:22.369473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edeaea-c558-46f5-953c-182d9946843d None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:22.369881 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6edeaea-c558-46f5-953c-182d9946843d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:22.382813 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6edeaea-c558-46f5-953c-182d9946843d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:22.383176 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4862d-4b65-46e3-8528-7a5e0602e54f None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:22.389512 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-e6edeaea-c558-46f5-953c-182d9946843d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 12:06:22.389512 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:22.389512 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:22.389512 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:22.389512 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:22.389512 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:22.389512 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:22.389512 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:22.389512 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:22.389512 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:22.389512 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:22.389512 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:22.389512 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:22.389512 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:22.389512 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:22.389512 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:22.390584 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:22.390584 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:22.390584 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:22.390584 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:22.390584 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:22.390584 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:22.390584 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:22.390584 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:22.390584 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:22.390584 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:22.390584 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:22.390584 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:22.390584 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:22.390584 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:22.390584 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:22.390584 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:22.391546 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:22.391546 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:22.391546 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:22.391546 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:22.391546 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:22.391546 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:22.391546 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:22.391546 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:22.391546 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:22.391546 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:22.391546 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 12:06:22.391546 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:06:22.393953 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 118/221] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:06:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:06:22.395031 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:22.396100 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6edeaea-c558-46f5-953c-182d9946843d None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:22.427357 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c2c16-c72a-4c64-9e81-03dd2beff52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:22.428156 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c2c16-c72a-4c64-9e81-03dd2beff52d None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:22.428747 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c2c16-c72a-4c64-9e81-03dd2beff52d None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:22.429040 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c2c16-c72a-4c64-9e81-03dd2beff52d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:22.430191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274c2c16-c72a-4c64-9e81-03dd2beff52d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:22.431676 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274c2c16-c72a-4c64-9e81-03dd2beff52d None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:22.434423 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 104/222] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:06:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:22.434423 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c2c16-c72a-4c64-9e81-03dd2beff52d None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:22.512398 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6edeaea-c558-46f5-953c-182d9946843d None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:22.536178 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c2c16-c72a-4c64-9e81-03dd2beff52d None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:22.547449 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb965d-1c9f-4328-8ffa-72150cf4ebad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:22.548102 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb965d-1c9f-4328-8ffa-72150cf4ebad None admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:22.548379 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb965d-1c9f-4328-8ffa-72150cf4ebad None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:22.548652 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb965d-1c9f-4328-8ffa-72150cf4ebad None admin] PATH_INFO: `/v3/projects/1367e35623684adc931fd16f99a77b44/users/1e73ad0ba2484af49b2806be5738b4cf/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:22.550607 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb965d-1c9f-4328-8ffa-72150cf4ebad None admin] RBAC: Authorizing `identity:create_grant(project_id=1367e35623684adc931fd16f99a77b44, user_id=1e73ad0ba2484af49b2806be5738b4cf, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:22.552082 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb965d-1c9f-4328-8ffa-72150cf4ebad None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:22.568721 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 119/223] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Sep 21 12:06:22 2022] PUT /identity/v3/projects/1367e35623684adc931fd16f99a77b44/users/1e73ad0ba2484af49b2806be5738b4cf/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:06:22.569522 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb965d-1c9f-4328-8ffa-72150cf4ebad None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:22.585964 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018695bc-70bc-4f94-aa71-05cb92884a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:22.586651 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018695bc-70bc-4f94-aa71-05cb92884a47 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:22.586937 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018695bc-70bc-4f94-aa71-05cb92884a47 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:22.587353 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018695bc-70bc-4f94-aa71-05cb92884a47 None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:22.588060 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018695bc-70bc-4f94-aa71-05cb92884a47 None admin] RBAC: Adding query filter params (name=member) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:22.588368 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018695bc-70bc-4f94-aa71-05cb92884a47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:22.590563 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018695bc-70bc-4f94-aa71-05cb92884a47 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:22.597383 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:22.600211 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 105/224] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Sep 21 12:06:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:22.601101 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018695bc-70bc-4f94-aa71-05cb92884a47 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:22.656133 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:22.717152 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb965d-1c9f-4328-8ffa-72150cf4ebad None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:22.726169 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018695bc-70bc-4f94-aa71-05cb92884a47 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:22.759623 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4944cb-23a8-410d-a3fa-1b1676d10103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:22.760231 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4944cb-23a8-410d-a3fa-1b1676d10103 None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:22.760508 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4944cb-23a8-410d-a3fa-1b1676d10103 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:22.761308 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4944cb-23a8-410d-a3fa-1b1676d10103 None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:22.761945 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4944cb-23a8-410d-a3fa-1b1676d10103 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:22.763423 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4944cb-23a8-410d-a3fa-1b1676d10103 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:22.768360 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d28f8f-897b-4def-a5fd-8e79bb227330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:22.768998 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d28f8f-897b-4def-a5fd-8e79bb227330 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:22.769277 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d28f8f-897b-4def-a5fd-8e79bb227330 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:22.769551 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d28f8f-897b-4def-a5fd-8e79bb227330 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:22.783301 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d28f8f-897b-4def-a5fd-8e79bb227330 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:22.787641 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 120/225] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Sep 21 12:06:22 2022] POST /identity/v3/users => generated 297 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:06:22.794344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-14d28f8f-897b-4def-a5fd-8e79bb227330 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 12:06:22.794344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:22.794344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:22.794344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:22.794344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:22.794344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:22.794344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:22.794344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:22.794344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:22.794344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:22.794344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:22.794344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:22.794344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:22.794344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:22.794344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:22.794344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:22.795445 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:22.795445 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:22.795445 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:22.795445 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:22.795445 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:22.795445 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:22.795445 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:22.795445 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:22.795445 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:22.795445 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:22.795445 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:22.795445 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:22.795445 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:22.795445 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:22.795445 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:22.795445 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:22.796456 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:22.796456 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:22.796456 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:22.796456 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:22.796456 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:22.796456 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:22.796456 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:22.796456 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:22.796456 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:22.796456 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:22.796456 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 12:06:22.796456 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:06:22.796456 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 106/226] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Sep 21 12:06:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:06:22.796456 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d28f8f-897b-4def-a5fd-8e79bb227330 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:22.799294 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4944cb-23a8-410d-a3fa-1b1676d10103 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:22.896393 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:22.940705 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4944cb-23a8-410d-a3fa-1b1676d10103 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:22.941429 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:22.948214 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d28f8f-897b-4def-a5fd-8e79bb227330 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:22.986662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155ad83-c025-40c3-9af8-b01b67880203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:22.987676 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155ad83-c025-40c3-9af8-b01b67880203 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:22.988169 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155ad83-c025-40c3-9af8-b01b67880203 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:22.988509 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155ad83-c025-40c3-9af8-b01b67880203 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:22.989277 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155ad83-c025-40c3-9af8-b01b67880203 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:22.989585 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155ad83-c025-40c3-9af8-b01b67880203 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:22.991053 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155ad83-c025-40c3-9af8-b01b67880203 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:22.995641 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a0134-09cc-4208-9216-8ff882fc6782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:22.996284 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a0134-09cc-4208-9216-8ff882fc6782 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:22.996561 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a0134-09cc-4208-9216-8ff882fc6782 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:22.996838 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a0134-09cc-4208-9216-8ff882fc6782 None admin] PATH_INFO: `/v3/users/d05d3bec47604fbd8f2a5ec838035d83` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:23.000308 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 121/227] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:06:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:23.005804 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155ad83-c025-40c3-9af8-b01b67880203 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:23.018319 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429a0134-09cc-4208-9216-8ff882fc6782 None admin] RBAC: Authorizing `identity:get_user(user_id=d05d3bec47604fbd8f2a5ec838035d83)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:23.020191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429a0134-09cc-4208-9216-8ff882fc6782 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:23.022687 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 107/228] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:06:22 2022] GET /identity/v3/users/d05d3bec47604fbd8f2a5ec838035d83 => generated 297 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:23.028809 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a0134-09cc-4208-9216-8ff882fc6782 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:23.137063 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155ad83-c025-40c3-9af8-b01b67880203 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:23.153720 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a0134-09cc-4208-9216-8ff882fc6782 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:23.179651 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:23.188057 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405e56b-baa9-4104-9591-f4ed85146649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:23.188689 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405e56b-baa9-4104-9591-f4ed85146649 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:23.188965 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405e56b-baa9-4104-9591-f4ed85146649 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:23.189242 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405e56b-baa9-4104-9591-f4ed85146649 None admin] PATH_INFO: `/v3/users/1e73ad0ba2484af49b2806be5738b4cf` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:23.191292 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2405e56b-baa9-4104-9591-f4ed85146649 None admin] RBAC: Authorizing `identity:get_user(user_id=1e73ad0ba2484af49b2806be5738b4cf)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:23.191865 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2405e56b-baa9-4104-9591-f4ed85146649 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:23.193670 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 122/229] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:06:23 2022] GET /identity/v3/users/1e73ad0ba2484af49b2806be5738b4cf => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:23.196390 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9fcd9-ae5e-4dee-83dc-e4464f9fef77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:23.197099 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9fcd9-ae5e-4dee-83dc-e4464f9fef77 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:23.197448 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9fcd9-ae5e-4dee-83dc-e4464f9fef77 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:23.197780 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9fcd9-ae5e-4dee-83dc-e4464f9fef77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:23.199798 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405e56b-baa9-4104-9591-f4ed85146649 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:23.237014 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:23.288338 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9fcd9-ae5e-4dee-83dc-e4464f9fef77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:23.290922 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9fcd9-ae5e-4dee-83dc-e4464f9fef77 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:23.329448 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405e56b-baa9-4104-9591-f4ed85146649 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:23.365954 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92c0e2-6efd-4b2c-b28e-20ad45d2f57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:23.366666 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92c0e2-6efd-4b2c-b28e-20ad45d2f57a None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:23.366945 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92c0e2-6efd-4b2c-b28e-20ad45d2f57a None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:23.367222 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92c0e2-6efd-4b2c-b28e-20ad45d2f57a None admin] PATH_INFO: `/v3/projects/1367e35623684adc931fd16f99a77b44` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:23.368430 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92c0e2-6efd-4b2c-b28e-20ad45d2f57a None admin] RBAC: Authorizing `identity:get_project(project_id=1367e35623684adc931fd16f99a77b44)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:23.369879 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92c0e2-6efd-4b2c-b28e-20ad45d2f57a None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:23.372721 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 123/230] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:06:23 2022] GET /identity/v3/projects/1367e35623684adc931fd16f99a77b44 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:23.396332 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92c0e2-6efd-4b2c-b28e-20ad45d2f57a None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:23.430789 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 108/231] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:06:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 21 12:06:23.433454 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9fcd9-ae5e-4dee-83dc-e4464f9fef77 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:23.503368 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:23.552473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:23.559874 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9fcd9-ae5e-4dee-83dc-e4464f9fef77 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:23.599565 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb065217-542d-41c2-a81a-f5ba78256a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:23.600215 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb065217-542d-41c2-a81a-f5ba78256a6e None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:23.600494 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb065217-542d-41c2-a81a-f5ba78256a6e None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:23.600766 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb065217-542d-41c2-a81a-f5ba78256a6e None admin] PATH_INFO: `/v3/projects/1367e35623684adc931fd16f99a77b44` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:23.602452 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb065217-542d-41c2-a81a-f5ba78256a6e None admin] RBAC: Authorizing `identity:get_project(project_id=1367e35623684adc931fd16f99a77b44)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:23.604104 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb065217-542d-41c2-a81a-f5ba78256a6e None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:23.605793 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 109/232] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:06:23 2022] GET /identity/v3/projects/1367e35623684adc931fd16f99a77b44 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:06:23.611492 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb065217-542d-41c2-a81a-f5ba78256a6e None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:23.634198 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92c0e2-6efd-4b2c-b28e-20ad45d2f57a None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:23.693542 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fa358-5d4b-4e7b-a268-dc6f9b84b003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:23.694211 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fa358-5d4b-4e7b-a268-dc6f9b84b003 None admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:23.694524 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fa358-5d4b-4e7b-a268-dc6f9b84b003 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:23.694799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fa358-5d4b-4e7b-a268-dc6f9b84b003 None admin] PATH_INFO: `/v3/projects/1367e35623684adc931fd16f99a77b44/users/1e73ad0ba2484af49b2806be5738b4cf/roles/173d0e93641b4882934b75f256b38534` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:23.696977 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648fa358-5d4b-4e7b-a268-dc6f9b84b003 None admin] RBAC: Authorizing `identity:create_grant(project_id=1367e35623684adc931fd16f99a77b44, user_id=1e73ad0ba2484af49b2806be5738b4cf, role_id=173d0e93641b4882934b75f256b38534)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:23.699055 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648fa358-5d4b-4e7b-a268-dc6f9b84b003 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:23.713328 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 124/233] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Sep 21 12:06:23 2022] PUT /identity/v3/projects/1367e35623684adc931fd16f99a77b44/users/1e73ad0ba2484af49b2806be5738b4cf/roles/173d0e93641b4882934b75f256b38534 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:06:23.798696 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb065217-542d-41c2-a81a-f5ba78256a6e None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:23.835325 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:23.850584 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d91d5-3670-48b8-aade-97823e0ac609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:23.851205 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d91d5-3670-48b8-aade-97823e0ac609 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:23.851483 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d91d5-3670-48b8-aade-97823e0ac609 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:23.851806 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d91d5-3670-48b8-aade-97823e0ac609 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:23.852534 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42d91d5-3670-48b8-aade-97823e0ac609 None admin] RBAC: Adding query filter params (role.id=9712f7b332bf484689b3706721ab6311, scope.project.id=1367e35623684adc931fd16f99a77b44, user.id=d05d3bec47604fbd8f2a5ec838035d83) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:23.852886 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42d91d5-3670-48b8-aade-97823e0ac609 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:23.854506 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42d91d5-3670-48b8-aade-97823e0ac609 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:23.860930 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 110/234] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:06:23 2022] GET /identity/v3/role_assignments?user.id=d05d3bec47604fbd8f2a5ec838035d83&scope.project.id=1367e35623684adc931fd16f99a77b44&role.id=9712f7b332bf484689b3706721ab6311 => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:06:25.206150 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdc70a-c252-4c3d-b8f5-40730dc0bc45 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:25.206150 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdc70a-c252-4c3d-b8f5-40730dc0bc45 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:25.206150 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdc70a-c252-4c3d-b8f5-40730dc0bc45 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:25.206150 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 125/235] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:25.211711 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f039b-fe9d-4159-8ec6-754b96fd8975 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:25.212119 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f039b-fe9d-4159-8ec6-754b96fd8975 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:25.212247 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f039b-fe9d-4159-8ec6-754b96fd8975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:25.234243 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-7f5f039b-fe9d-4159-8ec6-754b96fd8975 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:25.235704 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-7f5f039b-fe9d-4159-8ec6-754b96fd8975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:25.315858 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 111/236] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:06:25.641900 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdc70a-c252-4c3d-b8f5-40730dc0bc45 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:25.694398 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24da7b-ec09-4fd3-9fa4-67b3d446586e None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:25.696374 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24da7b-ec09-4fd3-9fa4-67b3d446586e None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:25.696374 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24da7b-ec09-4fd3-9fa4-67b3d446586e None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:25.696859 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 112/237] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:25.704612 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb3e1e-4bfe-4693-936b-5d62842ae7b2 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:25.705111 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb3e1e-4bfe-4693-936b-5d62842ae7b2 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:25.705532 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb3e1e-4bfe-4693-936b-5d62842ae7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:25.727025 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-3cbb3e1e-4bfe-4693-936b-5d62842ae7b2 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:25.728532 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-3cbb3e1e-4bfe-4693-936b-5d62842ae7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:25.810785 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 113/238] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 12:06:25.855407 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdc70a-c252-4c3d-b8f5-40730dc0bc45 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:25.891381 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0205a7-3ee9-441d-8b39-dda50cc996d5 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:25.892011 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0205a7-3ee9-441d-8b39-dda50cc996d5 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:25.892510 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0205a7-3ee9-441d-8b39-dda50cc996d5 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:25.894338 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 114/239] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:25.902383 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:25.903796 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6be04-be79-40b6-8525-33ea2568b8c0 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:25.904251 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6be04-be79-40b6-8525-33ea2568b8c0 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:25.904679 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6be04-be79-40b6-8525-33ea2568b8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:25.924466 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb7aed-a84d-4cdf-9117-f0e32b007f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:25.925356 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb7aed-a84d-4cdf-9117-f0e32b007f62 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:25.925783 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb7aed-a84d-4cdf-9117-f0e32b007f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:25.926260 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb7aed-a84d-4cdf-9117-f0e32b007f62 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:25.939437 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-c1c6be04-be79-40b6-8525-33ea2568b8c0 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:25.941071 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-c1c6be04-be79-40b6-8525-33ea2568b8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:25.948458 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eb7aed-a84d-4cdf-9117-f0e32b007f62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:25.954621 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-50eb7aed-a84d-4cdf-9117-f0e32b007f62 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:06:25.954621 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:25.954621 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:25.954621 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:25.954621 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:25.954621 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:25.954621 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:25.954621 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:25.954621 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:25.954621 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:25.954621 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:25.954621 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:25.954621 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:25.954621 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:25.954621 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:25.954621 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:25.955707 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:25.955707 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:25.955707 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:25.955707 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:25.955707 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:25.955707 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:25.955707 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:25.955707 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:25.955707 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:25.955707 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:25.955707 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:25.955707 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:25.955707 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:25.955707 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:25.955707 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:25.955707 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:25.956672 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:25.956672 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:25.956672 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:25.956672 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:25.956672 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:25.956672 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:25.956672 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:25.956672 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:25.956672 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:25.956672 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:25.956672 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:06:25.956672 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:06:25.964865 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 126/240] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Sep 21 12:06:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:06:25.970646 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb7aed-a84d-4cdf-9117-f0e32b007f62 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:26.038075 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:26.096967 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb7aed-a84d-4cdf-9117-f0e32b007f62 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:26.105208 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 115/241] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:06:26.117767 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c6be04-be79-40b6-8525-33ea2568b8c0 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:26.154766 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60509e3f-b989-4673-a82c-627871b16d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:26.155390 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60509e3f-b989-4673-a82c-627871b16d96 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:26.155676 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60509e3f-b989-4673-a82c-627871b16d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:26.155948 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60509e3f-b989-4673-a82c-627871b16d96 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:26.156622 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60509e3f-b989-4673-a82c-627871b16d96 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:26.156930 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60509e3f-b989-4673-a82c-627871b16d96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:26.158319 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60509e3f-b989-4673-a82c-627871b16d96 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:26.176124 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 127/242] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:06:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:06:26.181927 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60509e3f-b989-4673-a82c-627871b16d96 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:26.279975 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:26.284539 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c6be04-be79-40b6-8525-33ea2568b8c0 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:26.355546 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5fb2cd-9744-4a19-95d4-310706c0aa95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:26.357571 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5fb2cd-9744-4a19-95d4-310706c0aa95 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:26.357998 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5fb2cd-9744-4a19-95d4-310706c0aa95 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:26.358927 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5fb2cd-9744-4a19-95d4-310706c0aa95 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:26.361562 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5fb2cd-9744-4a19-95d4-310706c0aa95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:26.363999 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5fb2cd-9744-4a19-95d4-310706c0aa95 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:26.368114 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 116/243] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:06:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:06:26.374187 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5fb2cd-9744-4a19-95d4-310706c0aa95 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:26.377343 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60509e3f-b989-4673-a82c-627871b16d96 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:26.420133 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943e1fa-4993-498f-9c07-8a8fe45503aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:26.420794 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943e1fa-4993-498f-9c07-8a8fe45503aa None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:26.421076 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943e1fa-4993-498f-9c07-8a8fe45503aa None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:26.421352 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943e1fa-4993-498f-9c07-8a8fe45503aa None admin] PATH_INFO: `/v3/users/1e73ad0ba2484af49b2806be5738b4cf` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:26.422891 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f943e1fa-4993-498f-9c07-8a8fe45503aa None admin] RBAC: Authorizing `identity:get_user(user_id=1e73ad0ba2484af49b2806be5738b4cf)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:26.424389 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f943e1fa-4993-498f-9c07-8a8fe45503aa None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:26.427781 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 128/244] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:06:26 2022] GET /identity/v3/users/1e73ad0ba2484af49b2806be5738b4cf => generated 283 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:26.432246 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943e1fa-4993-498f-9c07-8a8fe45503aa None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:26.469888 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:26.540660 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5fb2cd-9744-4a19-95d4-310706c0aa95 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:26.585022 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943e1fa-4993-498f-9c07-8a8fe45503aa None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:26.590511 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3860712-e5e5-4cd7-9b83-9caff94f2615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:26.591132 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3860712-e5e5-4cd7-9b83-9caff94f2615 None admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:26.591412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3860712-e5e5-4cd7-9b83-9caff94f2615 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:26.591686 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3860712-e5e5-4cd7-9b83-9caff94f2615 None admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:26.592405 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3860712-e5e5-4cd7-9b83-9caff94f2615 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:26.594083 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3860712-e5e5-4cd7-9b83-9caff94f2615 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:26.603325 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:26.617050 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 117/245] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Sep 21 12:06:26 2022] POST /identity/v3/users => generated 293 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:06:26.618250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3860712-e5e5-4cd7-9b83-9caff94f2615 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:26.627002 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ede71d-f797-4065-8b1f-56c434557b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:26.627945 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ede71d-f797-4065-8b1f-56c434557b7a None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:26.628221 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ede71d-f797-4065-8b1f-56c434557b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:26.628487 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ede71d-f797-4065-8b1f-56c434557b7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:26.707655 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ede71d-f797-4065-8b1f-56c434557b7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:26.709593 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ede71d-f797-4065-8b1f-56c434557b7a None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:26.742163 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3860712-e5e5-4cd7-9b83-9caff94f2615 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:26.743875 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:26.783915 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f74343-4466-4e9f-8ceb-5dd8facf61ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:26.784685 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f74343-4466-4e9f-8ceb-5dd8facf61ab None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:26.785087 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f74343-4466-4e9f-8ceb-5dd8facf61ab None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:26.785430 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f74343-4466-4e9f-8ceb-5dd8facf61ab None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:26.804704 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f74343-4466-4e9f-8ceb-5dd8facf61ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:26.810265 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-c5f74343-4466-4e9f-8ceb-5dd8facf61ab None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 12:06:26.810265 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:26.810265 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:26.810265 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:26.810265 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:26.810265 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:26.810265 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:26.810265 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:26.810265 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:26.810265 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:26.810265 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:26.810265 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:26.810265 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:26.810265 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:26.810265 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:26.810265 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:26.811230 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:26.811230 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:26.811230 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:26.811230 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:26.811230 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:26.811230 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:26.811230 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:26.811230 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:26.811230 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:26.811230 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:26.811230 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:26.811230 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:26.811230 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:26.811230 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:26.811230 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:26.811230 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:26.811997 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:26.811997 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:26.811997 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:26.811997 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:26.811997 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:26.811997 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:26.811997 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:26.811997 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:26.811997 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:26.811997 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:26.811997 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 12:06:26.811997 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:06:26.811997 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 118/246] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:06:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:06:26.812770 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8c140-c00b-4f42-bbd5-3249e5a476c9 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:26.813270 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8c140-c00b-4f42-bbd5-3249e5a476c9 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:26.813270 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8c140-c00b-4f42-bbd5-3249e5a476c9 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:26.814891 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 119/247] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:26.816047 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc85a5d-cbfb-4111-81a6-3c8ab5c8c57f None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:26.816332 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc85a5d-cbfb-4111-81a6-3c8ab5c8c57f None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:26.816607 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc85a5d-cbfb-4111-81a6-3c8ab5c8c57f None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:26.817966 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 120/248] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:26.819893 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfe417-ffb8-441b-bb04-e8b4338e9f78 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:26.820179 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfe417-ffb8-441b-bb04-e8b4338e9f78 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:26.820450 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfe417-ffb8-441b-bb04-e8b4338e9f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:26.837174 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 129/249] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:06:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 12:06:26.838045 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ede71d-f797-4065-8b1f-56c434557b7a None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:26.846209 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-b5cfe417-ffb8-441b-bb04-e8b4338e9f78 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:26.848041 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-b5cfe417-ffb8-441b-bb04-e8b4338e9f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:26.861837 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:26.950126 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 121/250] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:06:26.951173 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115a153-c384-473a-b5d7-f0fcc4c5dc49 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:26.951459 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115a153-c384-473a-b5d7-f0fcc4c5dc49 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:26.951732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115a153-c384-473a-b5d7-f0fcc4c5dc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:26.972472 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-b115a153-c384-473a-b5d7-f0fcc4c5dc49 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:26.973650 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-b115a153-c384-473a-b5d7-f0fcc4c5dc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:26.988733 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ede71d-f797-4065-8b1f-56c434557b7a None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:27.034108 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f187d6-2e52-46d5-8b88-0e83561390be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:27.035476 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f187d6-2e52-46d5-8b88-0e83561390be None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:27.035857 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f187d6-2e52-46d5-8b88-0e83561390be None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:27.036228 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f187d6-2e52-46d5-8b88-0e83561390be None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:27.037849 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f187d6-2e52-46d5-8b88-0e83561390be None admin] RBAC: Adding query filter params (name=reader) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:27.037849 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f187d6-2e52-46d5-8b88-0e83561390be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:27.039217 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f187d6-2e52-46d5-8b88-0e83561390be None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:27.049840 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 130/251] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Sep 21 12:06:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:27.050852 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f187d6-2e52-46d5-8b88-0e83561390be None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:27.051574 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 122/252] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:06:27.055544 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115a153-c384-473a-b5d7-f0fcc4c5dc49 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:27.101848 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:27.230555 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:27.260367 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115a153-c384-473a-b5d7-f0fcc4c5dc49 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:27.284212 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f187d6-2e52-46d5-8b88-0e83561390be None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:27.332324 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a8b90-8497-4963-a607-5ecffe81aee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:27.332985 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a8b90-8497-4963-a607-5ecffe81aee9 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:27.333233 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a8b90-8497-4963-a607-5ecffe81aee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:27.333499 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a8b90-8497-4963-a607-5ecffe81aee9 None admin] PATH_INFO: `/v3/users/f548e94a82134d6ea3c6fbaf3e3809cc` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:27.348747 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a8b90-8497-4963-a607-5ecffe81aee9 None admin] RBAC: Authorizing `identity:get_user(user_id=f548e94a82134d6ea3c6fbaf3e3809cc)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:27.350568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a8b90-8497-4963-a607-5ecffe81aee9 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:27.352064 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265cf3d-6de5-4170-9d5b-b7459b30a7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:27.352714 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265cf3d-6de5-4170-9d5b-b7459b30a7d0 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:27.353057 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265cf3d-6de5-4170-9d5b-b7459b30a7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:27.353254 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265cf3d-6de5-4170-9d5b-b7459b30a7d0 None admin] PATH_INFO: `/v3/projects/1367e35623684adc931fd16f99a77b44` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:27.353670 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 123/253] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:06:27 2022] GET /identity/v3/users/f548e94a82134d6ea3c6fbaf3e3809cc => generated 297 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:06:27.355209 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265cf3d-6de5-4170-9d5b-b7459b30a7d0 None admin] RBAC: Authorizing `identity:get_project(project_id=1367e35623684adc931fd16f99a77b44)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:27.355620 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a8b90-8497-4963-a607-5ecffe81aee9 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:27.356671 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265cf3d-6de5-4170-9d5b-b7459b30a7d0 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:27.358442 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 131/254] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:06:27 2022] GET /identity/v3/projects/1367e35623684adc931fd16f99a77b44 => generated 302 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:27.364596 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265cf3d-6de5-4170-9d5b-b7459b30a7d0 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:27.487026 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265cf3d-6de5-4170-9d5b-b7459b30a7d0 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:27.498729 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:27.522025 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a8b90-8497-4963-a607-5ecffe81aee9 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:27.543593 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5dffcc-151b-44a9-9014-7eb396aeb8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:27.545296 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5dffcc-151b-44a9-9014-7eb396aeb8db None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:27.545780 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5dffcc-151b-44a9-9014-7eb396aeb8db None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:27.546682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5dffcc-151b-44a9-9014-7eb396aeb8db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:27.569009 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f481e7-9161-41f9-8380-8aab0be77535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:27.569950 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f481e7-9161-41f9-8380-8aab0be77535 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:27.570230 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f481e7-9161-41f9-8380-8aab0be77535 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:27.570551 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f481e7-9161-41f9-8380-8aab0be77535 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:27.571307 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:27.589286 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f481e7-9161-41f9-8380-8aab0be77535 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:27.595665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-e2f481e7-9161-41f9-8380-8aab0be77535 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 12:06:27.595665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:27.595665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:27.595665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:27.595665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:27.595665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:27.595665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:27.595665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:27.595665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:27.595665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:27.595665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:27.595665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:27.595665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:27.595665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:27.595665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:27.595665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:27.596560 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:27.596560 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:27.596560 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:27.596560 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:27.596560 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:27.596560 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:27.596560 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:27.596560 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:27.596560 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:27.596560 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:27.596560 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:27.596560 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:27.596560 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:27.596560 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:27.596560 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:27.596560 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:27.597360 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:27.597360 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:27.597360 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:27.597360 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:27.597360 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:27.597360 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:27.597360 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:27.597360 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:27.597360 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:27.597360 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:27.597360 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 12:06:27.597360 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:06:27.597360 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 124/255] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:06:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:06:27.598048 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f481e7-9161-41f9-8380-8aab0be77535 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:27.636521 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5dffcc-151b-44a9-9014-7eb396aeb8db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:27.638414 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5dffcc-151b-44a9-9014-7eb396aeb8db None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:27.731179 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f481e7-9161-41f9-8380-8aab0be77535 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:27.766855 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e43175-f84d-4236-a030-e3deab24033c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:27.767377 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e43175-f84d-4236-a030-e3deab24033c None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:27.767649 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e43175-f84d-4236-a030-e3deab24033c None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:27.767923 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e43175-f84d-4236-a030-e3deab24033c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:27.768653 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e43175-f84d-4236-a030-e3deab24033c None admin] RBAC: Adding query filter params (role.id=72c80b472acb462ebadd86463efe91f7, scope.project.id=1367e35623684adc931fd16f99a77b44, user.id=1e73ad0ba2484af49b2806be5738b4cf) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:27.769069 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e43175-f84d-4236-a030-e3deab24033c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:27.773692 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e43175-f84d-4236-a030-e3deab24033c None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:27.774275 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 132/256] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:06:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 12:06:27.776590 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5dffcc-151b-44a9-9014-7eb396aeb8db None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:27.779316 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 125/257] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:06:27 2022] GET /identity/v3/role_assignments?user.id=1e73ad0ba2484af49b2806be5738b4cf&scope.project.id=1367e35623684adc931fd16f99a77b44&role.id=72c80b472acb462ebadd86463efe91f7 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:27.780226 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e43175-f84d-4236-a030-e3deab24033c None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:27.783939 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:27.843221 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:27.909444 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5dffcc-151b-44a9-9014-7eb396aeb8db None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:27.956907 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007e213-9ac5-4060-9558-5d0061aee5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:27.958902 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007e213-9ac5-4060-9558-5d0061aee5ef None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:27.960263 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007e213-9ac5-4060-9558-5d0061aee5ef None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:27.960898 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007e213-9ac5-4060-9558-5d0061aee5ef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:27.986396 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a007e213-9ac5-4060-9558-5d0061aee5ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:27.996204 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-a007e213-9ac5-4060-9558-5d0061aee5ef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 12:06:27.996204 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:27.996204 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:27.996204 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:27.996204 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:27.996204 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:27.996204 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:27.996204 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:27.996204 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:27.996204 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:27.996204 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:27.996204 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:27.996204 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:27.996204 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:27.996204 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:27.996204 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:27.997172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:27.997172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:27.997172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:27.997172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:27.997172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:27.997172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:27.997172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:27.997172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:27.997172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:27.997172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:27.997172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:27.997172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:27.997172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:27.997172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:27.997172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:27.997172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:27.997970 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:27.997970 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:27.997970 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:27.997970 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:27.997970 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:27.997970 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:27.997970 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:27.997970 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:27.997970 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:27.997970 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:27.997970 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 12:06:27.997970 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:06:27.997970 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 133/258] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Sep 21 12:06:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:06:27.999871 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007e213-9ac5-4060-9558-5d0061aee5ef None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:28.003993 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e43175-f84d-4236-a030-e3deab24033c None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:28.068668 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7bfe1d-fdf3-426b-99a0-9e5f28727784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:28.069285 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7bfe1d-fdf3-426b-99a0-9e5f28727784 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:28.069565 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7bfe1d-fdf3-426b-99a0-9e5f28727784 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:28.069895 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7bfe1d-fdf3-426b-99a0-9e5f28727784 None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:28.070691 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7bfe1d-fdf3-426b-99a0-9e5f28727784 None admin] RBAC: Adding query filter params (name=member) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:28.071000 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7bfe1d-fdf3-426b-99a0-9e5f28727784 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:28.072486 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7bfe1d-fdf3-426b-99a0-9e5f28727784 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:28.082574 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 126/259] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Sep 21 12:06:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:28.083397 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7bfe1d-fdf3-426b-99a0-9e5f28727784 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:28.143311 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007e213-9ac5-4060-9558-5d0061aee5ef None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:28.156947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:28.163188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:28.196900 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781670d-5966-44db-8556-95f7fb0c6eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:28.197541 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781670d-5966-44db-8556-95f7fb0c6eaa None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:28.198388 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781670d-5966-44db-8556-95f7fb0c6eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:28.198653 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781670d-5966-44db-8556-95f7fb0c6eaa None admin] PATH_INFO: `/v3/projects/1367e35623684adc931fd16f99a77b44` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:28.199933 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781670d-5966-44db-8556-95f7fb0c6eaa None admin] RBAC: Authorizing `identity:get_project(project_id=1367e35623684adc931fd16f99a77b44)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:28.201381 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781670d-5966-44db-8556-95f7fb0c6eaa None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:28.203221 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 134/260] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:06:27 2022] GET /identity/v3/projects/1367e35623684adc931fd16f99a77b44 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:28.203919 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781670d-5966-44db-8556-95f7fb0c6eaa None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:28.211529 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7bfe1d-fdf3-426b-99a0-9e5f28727784 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:28.249405 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598cb09-9e12-4e74-ac8a-6c314df6e6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:28.250491 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598cb09-9e12-4e74-ac8a-6c314df6e6bf None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:28.250966 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598cb09-9e12-4e74-ac8a-6c314df6e6bf None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:28.251459 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598cb09-9e12-4e74-ac8a-6c314df6e6bf None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:28.252349 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598cb09-9e12-4e74-ac8a-6c314df6e6bf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:28.252909 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598cb09-9e12-4e74-ac8a-6c314df6e6bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:28.254562 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598cb09-9e12-4e74-ac8a-6c314df6e6bf None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:28.264239 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 127/261] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:06:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:28.265304 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598cb09-9e12-4e74-ac8a-6c314df6e6bf None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:28.317412 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781670d-5966-44db-8556-95f7fb0c6eaa None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:28.359043 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce634ad-8579-4196-a31d-464327ae0971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:28.359603 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce634ad-8579-4196-a31d-464327ae0971 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:28.359885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce634ad-8579-4196-a31d-464327ae0971 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:28.360160 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce634ad-8579-4196-a31d-464327ae0971 None admin] PATH_INFO: `/v3/users/d05d3bec47604fbd8f2a5ec838035d83` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:28.361307 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce634ad-8579-4196-a31d-464327ae0971 None admin] RBAC: Authorizing `identity:get_user(user_id=d05d3bec47604fbd8f2a5ec838035d83)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:28.365056 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce634ad-8579-4196-a31d-464327ae0971 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:28.366799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 135/262] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:06:28 2022] GET /identity/v3/users/d05d3bec47604fbd8f2a5ec838035d83 => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:28.367660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce634ad-8579-4196-a31d-464327ae0971 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:28.396373 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598cb09-9e12-4e74-ac8a-6c314df6e6bf None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:28.426789 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:28.433117 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:28.445071 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b858ba16-cdb7-4059-a147-0b012a95a96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:28.446128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858ba16-cdb7-4059-a147-0b012a95a96e None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:28.447253 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858ba16-cdb7-4059-a147-0b012a95a96e None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:28.447785 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858ba16-cdb7-4059-a147-0b012a95a96e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:28.448962 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b858ba16-cdb7-4059-a147-0b012a95a96e None admin] RBAC: Adding query filter params (role.id=65ae44a45ff2443eb03c2802be0453c9, scope.project.id=1367e35623684adc931fd16f99a77b44, user.id=f548e94a82134d6ea3c6fbaf3e3809cc) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:28.449465 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b858ba16-cdb7-4059-a147-0b012a95a96e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:28.452034 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b858ba16-cdb7-4059-a147-0b012a95a96e None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:28.458518 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 128/263] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:06:28 2022] GET /identity/v3/role_assignments?user.id=f548e94a82134d6ea3c6fbaf3e3809cc&scope.project.id=1367e35623684adc931fd16f99a77b44&role.id=65ae44a45ff2443eb03c2802be0453c9 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:28.459951 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b858ba16-cdb7-4059-a147-0b012a95a96e None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:28.495801 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce634ad-8579-4196-a31d-464327ae0971 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:28.576850 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872a7ab-5114-43cd-98ba-f2c0f6ada827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:28.577570 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872a7ab-5114-43cd-98ba-f2c0f6ada827 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:28.577857 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872a7ab-5114-43cd-98ba-f2c0f6ada827 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:28.578132 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872a7ab-5114-43cd-98ba-f2c0f6ada827 None admin] PATH_INFO: `/v3/users/1e73ad0ba2484af49b2806be5738b4cf` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:28.579988 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5872a7ab-5114-43cd-98ba-f2c0f6ada827 None admin] RBAC: Authorizing `identity:get_user(user_id=1e73ad0ba2484af49b2806be5738b4cf)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:28.581473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5872a7ab-5114-43cd-98ba-f2c0f6ada827 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:28.583351 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 136/264] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:06:28 2022] GET /identity/v3/users/1e73ad0ba2484af49b2806be5738b4cf => generated 283 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:28.590090 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872a7ab-5114-43cd-98ba-f2c0f6ada827 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:28.696669 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b858ba16-cdb7-4059-a147-0b012a95a96e None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:28.729787 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872a7ab-5114-43cd-98ba-f2c0f6ada827 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:28.744025 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90c9e9-642d-4551-9021-8e603a7fab92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:28.745012 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90c9e9-642d-4551-9021-8e603a7fab92 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:28.745507 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90c9e9-642d-4551-9021-8e603a7fab92 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:28.745984 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90c9e9-642d-4551-9021-8e603a7fab92 None admin] PATH_INFO: `/v3/projects/1367e35623684adc931fd16f99a77b44` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:28.747374 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b90c9e9-642d-4551-9021-8e603a7fab92 None admin] RBAC: Authorizing `identity:get_project(project_id=1367e35623684adc931fd16f99a77b44)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:28.747480 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:28.749632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b90c9e9-642d-4551-9021-8e603a7fab92 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:28.752639 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 129/265] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:06:28 2022] GET /identity/v3/projects/1367e35623684adc931fd16f99a77b44 => generated 302 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:28.757941 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90c9e9-642d-4551-9021-8e603a7fab92 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:28.782205 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f3878-b1e5-4953-8da3-4027e38dfdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:28.784017 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f3878-b1e5-4953-8da3-4027e38dfdd0 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:28.785251 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f3878-b1e5-4953-8da3-4027e38dfdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:28.785756 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f3878-b1e5-4953-8da3-4027e38dfdd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:28.873176 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:28.928424 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1f3878-b1e5-4953-8da3-4027e38dfdd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:28.933734 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1f3878-b1e5-4953-8da3-4027e38dfdd0 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:28.961526 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90c9e9-642d-4551-9021-8e603a7fab92 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:29.065926 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 137/266] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:06:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 12:06:29.071446 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f3878-b1e5-4953-8da3-4027e38dfdd0 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:29.079970 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ff0e5-7085-4f77-9f93-6992c641f97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:29.081075 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ff0e5-7085-4f77-9f93-6992c641f97e None admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:29.081533 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ff0e5-7085-4f77-9f93-6992c641f97e None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:29.081978 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ff0e5-7085-4f77-9f93-6992c641f97e None admin] PATH_INFO: `/v3/projects/1367e35623684adc931fd16f99a77b44/users/d05d3bec47604fbd8f2a5ec838035d83/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:29.087721 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ff0e5-7085-4f77-9f93-6992c641f97e None admin] RBAC: Authorizing `identity:create_grant(project_id=1367e35623684adc931fd16f99a77b44, user_id=d05d3bec47604fbd8f2a5ec838035d83, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:29.089932 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ff0e5-7085-4f77-9f93-6992c641f97e None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:29.098799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:29.112310 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 130/267] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Sep 21 12:06:28 2022] PUT /identity/v3/projects/1367e35623684adc931fd16f99a77b44/users/d05d3bec47604fbd8f2a5ec838035d83/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:06:29.149567 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86009d2-97ee-461d-a852-327e22cf3c12 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:29.150186 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86009d2-97ee-461d-a852-327e22cf3c12 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:29.150661 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86009d2-97ee-461d-a852-327e22cf3c12 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:29.152883 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 131/268] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:06:29.164542 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808c12a-30a1-44e7-bbb3-f82ae0eae808 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:29.165090 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808c12a-30a1-44e7-bbb3-f82ae0eae808 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:29.165464 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808c12a-30a1-44e7-bbb3-f82ae0eae808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:29.216240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f3878-b1e5-4953-8da3-4027e38dfdd0 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:29.223571 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-7808c12a-30a1-44e7-bbb3-f82ae0eae808 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:29.224824 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-7808c12a-30a1-44e7-bbb3-f82ae0eae808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:29.261363 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052cf3cd-36ab-47c2-8224-4105ec72401a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:29.262400 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052cf3cd-36ab-47c2-8224-4105ec72401a None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:29.262861 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052cf3cd-36ab-47c2-8224-4105ec72401a None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:29.263312 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052cf3cd-36ab-47c2-8224-4105ec72401a None admin] PATH_INFO: `/v3/projects/1367e35623684adc931fd16f99a77b44` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:29.266857 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052cf3cd-36ab-47c2-8224-4105ec72401a None admin] RBAC: Authorizing `identity:get_project(project_id=1367e35623684adc931fd16f99a77b44)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:29.268585 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052cf3cd-36ab-47c2-8224-4105ec72401a None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:29.271583 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 138/269] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:06:29 2022] GET /identity/v3/projects/1367e35623684adc931fd16f99a77b44 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:06:29.278236 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052cf3cd-36ab-47c2-8224-4105ec72401a None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:29.359115 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 132/270] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:06:29.360542 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0009d3-7dd7-4e6b-af13-99d07f67f272 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:29.360816 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0009d3-7dd7-4e6b-af13-99d07f67f272 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:29.361087 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0009d3-7dd7-4e6b-af13-99d07f67f272 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:29.366982 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 133/271] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:29.368165 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fa4ea-200e-4441-89c6-7dbc73a72e8d None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:29.368823 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fa4ea-200e-4441-89c6-7dbc73a72e8d None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:29.369107 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fa4ea-200e-4441-89c6-7dbc73a72e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:29.391826 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-da9fa4ea-200e-4441-89c6-7dbc73a72e8d None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:29.393118 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-da9fa4ea-200e-4441-89c6-7dbc73a72e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:29.435887 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:29.454731 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:29.481588 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052cf3cd-36ab-47c2-8224-4105ec72401a None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:29.495576 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 134/272] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 12:06:29.538047 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72761bd-803d-4175-843c-798bd6c46a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:29.538735 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72761bd-803d-4175-843c-798bd6c46a08 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:29.539008 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72761bd-803d-4175-843c-798bd6c46a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:29.539319 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72761bd-803d-4175-843c-798bd6c46a08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:29.540047 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72761bd-803d-4175-843c-798bd6c46a08 None admin] RBAC: Adding query filter params (role.id=173d0e93641b4882934b75f256b38534, scope.project.id=1367e35623684adc931fd16f99a77b44, user.id=1e73ad0ba2484af49b2806be5738b4cf) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:29.540347 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72761bd-803d-4175-843c-798bd6c46a08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:29.542311 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72761bd-803d-4175-843c-798bd6c46a08 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:29.549209 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 139/273] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:06:29 2022] GET /identity/v3/role_assignments?user.id=1e73ad0ba2484af49b2806be5738b4cf&scope.project.id=1367e35623684adc931fd16f99a77b44&role.id=173d0e93641b4882934b75f256b38534 => generated 608 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:29.680619 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9fa4ea-200e-4441-89c6-7dbc73a72e8d None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:29.820280 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9fa4ea-200e-4441-89c6-7dbc73a72e8d None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:29.848648 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72761bd-803d-4175-843c-798bd6c46a08 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:29.859225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf3c60-1487-47f1-9c5f-5a6b2a26ed43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:29.860191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf3c60-1487-47f1-9c5f-5a6b2a26ed43 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:29.861049 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf3c60-1487-47f1-9c5f-5a6b2a26ed43 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:29.861551 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf3c60-1487-47f1-9c5f-5a6b2a26ed43 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:29.876661 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bf3c60-1487-47f1-9c5f-5a6b2a26ed43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:29.882568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-86bf3c60-1487-47f1-9c5f-5a6b2a26ed43 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 12:06:29.882568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:29.882568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:29.882568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:29.882568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:29.882568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:29.882568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:29.882568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:29.882568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:29.882568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:29.882568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:29.882568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:29.882568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:29.882568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:29.882568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:29.882568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:29.883470 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:29.883470 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:29.883470 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:29.883470 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:29.883470 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:29.883470 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:29.883470 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:29.883470 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:29.883470 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:29.883470 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:29.883470 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:29.883470 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:29.883470 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:29.883470 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:29.883470 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:29.883470 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:29.884236 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:29.884236 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:29.884236 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:29.884236 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:29.884236 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:29.884236 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:29.884236 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:29.884236 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:29.884236 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:29.884236 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:29.884236 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 12:06:29.884236 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:06:29.887612 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 135/274] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:06:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:06:29.893387 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf3c60-1487-47f1-9c5f-5a6b2a26ed43 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:29.953537 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:29.990445 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72761bd-803d-4175-843c-798bd6c46a08 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:30.034386 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf3c60-1487-47f1-9c5f-5a6b2a26ed43 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:30.035545 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb0a64-0797-4d8f-ae89-af6f1857d423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:30.036438 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb0a64-0797-4d8f-ae89-af6f1857d423 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:30.036947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb0a64-0797-4d8f-ae89-af6f1857d423 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:30.037277 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb0a64-0797-4d8f-ae89-af6f1857d423 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:30.038607 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb0a64-0797-4d8f-ae89-af6f1857d423 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:30.040130 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb0a64-0797-4d8f-ae89-af6f1857d423 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:30.043414 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 140/275] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:06:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:30.051007 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb0a64-0797-4d8f-ae89-af6f1857d423 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:30.069967 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:30.074952 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637525c-43b4-40ec-ac09-ed1e75cb4bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:30.075659 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637525c-43b4-40ec-ac09-ed1e75cb4bd8 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:30.075941 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637525c-43b4-40ec-ac09-ed1e75cb4bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:30.076212 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637525c-43b4-40ec-ac09-ed1e75cb4bd8 None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:30.076876 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637525c-43b4-40ec-ac09-ed1e75cb4bd8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:30.077488 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637525c-43b4-40ec-ac09-ed1e75cb4bd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:30.078918 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637525c-43b4-40ec-ac09-ed1e75cb4bd8 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:30.094208 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 136/276] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Sep 21 12:06:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:30.095496 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637525c-43b4-40ec-ac09-ed1e75cb4bd8 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:30.185401 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb0a64-0797-4d8f-ae89-af6f1857d423 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:30.222295 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637525c-43b4-40ec-ac09-ed1e75cb4bd8 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:30.224192 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:30.224763 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a99811-f0b0-4777-b640-8516f5dc407c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:30.225775 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a99811-f0b0-4777-b640-8516f5dc407c None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:30.226295 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a99811-f0b0-4777-b640-8516f5dc407c None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:30.226827 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a99811-f0b0-4777-b640-8516f5dc407c None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:30.227860 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a99811-f0b0-4777-b640-8516f5dc407c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:30.230166 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a99811-f0b0-4777-b640-8516f5dc407c None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:30.262773 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 141/277] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Sep 21 12:06:30 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:06:30.269142 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82408d-6b96-4295-832c-9a8e355b9b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:30.269792 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82408d-6b96-4295-832c-9a8e355b9b0d None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:30.270065 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82408d-6b96-4295-832c-9a8e355b9b0d None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:30.270332 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82408d-6b96-4295-832c-9a8e355b9b0d None admin] PATH_INFO: `/v3/users/ce528bc2a65a4e34a7e3f2830a41cbd1` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:30.287087 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d82408d-6b96-4295-832c-9a8e355b9b0d None admin] RBAC: Authorizing `identity:get_user(user_id=ce528bc2a65a4e34a7e3f2830a41cbd1)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:30.289133 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d82408d-6b96-4295-832c-9a8e355b9b0d None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:30.291262 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 137/278] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:06:30 2022] GET /identity/v3/users/ce528bc2a65a4e34a7e3f2830a41cbd1 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:06:30.299536 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a99811-f0b0-4777-b640-8516f5dc407c None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:30.387425 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:30.434537 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a99811-f0b0-4777-b640-8516f5dc407c None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:30.471511 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbd914-950e-4683-8701-ec9e08bd07b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:30.472957 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbd914-950e-4683-8701-ec9e08bd07b0 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:30.473487 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbd914-950e-4683-8701-ec9e08bd07b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:30.473960 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbd914-950e-4683-8701-ec9e08bd07b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:30.474931 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edbd914-950e-4683-8701-ec9e08bd07b0 None admin] RBAC: Adding query filter params (role.id=9712f7b332bf484689b3706721ab6311, user.id=ce528bc2a65a4e34a7e3f2830a41cbd1, scope.system=all) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:30.475464 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edbd914-950e-4683-8701-ec9e08bd07b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:30.477140 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edbd914-950e-4683-8701-ec9e08bd07b0 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:30.483905 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 142/279] 10.222.0.60 () {56 vars in 1308 bytes} [Wed Sep 21 12:06:30 2022] GET /identity/v3/role_assignments?user.id=ce528bc2a65a4e34a7e3f2830a41cbd1&scope.system=all&role.id=9712f7b332bf484689b3706721ab6311 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:31.109169 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a22cf-68c0-4b07-8b13-b32f79c6f8c4 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:31.109725 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a22cf-68c0-4b07-8b13-b32f79c6f8c4 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:31.109725 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a22cf-68c0-4b07-8b13-b32f79c6f8c4 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:31.111345 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 138/280] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:31.116882 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36fa37-dc07-4794-b6a3-d00e3ed87f59 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:31.117172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36fa37-dc07-4794-b6a3-d00e3ed87f59 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:31.117451 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36fa37-dc07-4794-b6a3-d00e3ed87f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:31.137737 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-3e36fa37-dc07-4794-b6a3-d00e3ed87f59 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:31.139236 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-3e36fa37-dc07-4794-b6a3-d00e3ed87f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:31.230421 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 143/281] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:06:31.546837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a22cf-68c0-4b07-8b13-b32f79c6f8c4 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:31.703360 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a22cf-68c0-4b07-8b13-b32f79c6f8c4 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:31.749702 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f0c20-7da3-4636-b2d8-b8bf187c9c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:31.750472 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f0c20-7da3-4636-b2d8-b8bf187c9c1c None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:31.750750 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f0c20-7da3-4636-b2d8-b8bf187c9c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:31.751018 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f0c20-7da3-4636-b2d8-b8bf187c9c1c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:31.764597 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f0c20-7da3-4636-b2d8-b8bf187c9c1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:31.769366 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-1b1f0c20-7da3-4636-b2d8-b8bf187c9c1c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 12:06:31.769366 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:31.769366 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:31.769366 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:31.769366 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:31.769366 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:31.769366 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:31.769366 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:31.769366 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:31.769366 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:31.769366 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:31.769366 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:31.769366 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:31.769366 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:31.769366 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:31.769366 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:31.770269 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:31.770269 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:31.770269 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:31.770269 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:31.770269 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:31.770269 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:31.770269 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:31.770269 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:31.770269 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:31.770269 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:31.770269 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:31.770269 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:31.770269 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:31.770269 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:31.770269 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:31.770269 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:31.771216 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:31.771216 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:31.771216 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:31.771216 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:31.771216 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:31.771216 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:31.771216 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:31.771216 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:31.771216 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:31.771216 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:31.771216 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 12:06:31.771216 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:06:31.771216 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 139/282] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:06:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:06:31.779506 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36fa37-dc07-4794-b6a3-d00e3ed87f59 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:31.824097 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9431c-cefa-497c-b1bc-eafab6e8df41 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:31.824686 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9431c-cefa-497c-b1bc-eafab6e8df41 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:31.825245 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9431c-cefa-497c-b1bc-eafab6e8df41 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:31.827718 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 140/283] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:06:31.833559 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187e96b-fb6f-4bac-a384-606fe0abcd78 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:31.833844 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187e96b-fb6f-4bac-a384-606fe0abcd78 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:31.834121 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187e96b-fb6f-4bac-a384-606fe0abcd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:31.857912 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-0187e96b-fb6f-4bac-a384-606fe0abcd78 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:31.859467 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-0187e96b-fb6f-4bac-a384-606fe0abcd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:31.872894 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:31.884235 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:31.950039 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36fa37-dc07-4794-b6a3-d00e3ed87f59 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:31.993016 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 141/284] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 12:06:32.001051 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3e814-4577-48b7-88d1-fbcbf021741a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:32.001673 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3e814-4577-48b7-88d1-fbcbf021741a None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:32.001952 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3e814-4577-48b7-88d1-fbcbf021741a None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:32.002225 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3e814-4577-48b7-88d1-fbcbf021741a None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:32.002928 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba3e814-4577-48b7-88d1-fbcbf021741a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:32.003231 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba3e814-4577-48b7-88d1-fbcbf021741a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:32.004624 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba3e814-4577-48b7-88d1-fbcbf021741a None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:32.023074 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 144/285] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Sep 21 12:06:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:32.029151 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187e96b-fb6f-4bac-a384-606fe0abcd78 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:32.233925 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187e96b-fb6f-4bac-a384-606fe0abcd78 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:32.294984 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90811f24-89f3-430e-be76-05f52ddcd806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:32.296022 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90811f24-89f3-430e-be76-05f52ddcd806 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:32.296494 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90811f24-89f3-430e-be76-05f52ddcd806 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:32.296968 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90811f24-89f3-430e-be76-05f52ddcd806 None admin] PATH_INFO: `/v3/users/f548e94a82134d6ea3c6fbaf3e3809cc` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:32.298998 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90811f24-89f3-430e-be76-05f52ddcd806 None admin] RBAC: Authorizing `identity:get_user(user_id=f548e94a82134d6ea3c6fbaf3e3809cc)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:32.301762 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90811f24-89f3-430e-be76-05f52ddcd806 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:32.304710 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 142/286] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:06:32 2022] GET /identity/v3/users/f548e94a82134d6ea3c6fbaf3e3809cc => generated 297 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:32.313840 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3e814-4577-48b7-88d1-fbcbf021741a None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:32.315918 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90811f24-89f3-430e-be76-05f52ddcd806 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:32.368227 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:32.423922 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3e814-4577-48b7-88d1-fbcbf021741a None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:32.449178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:32.463096 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353196d-d017-4829-a065-24527efa8bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:32.464257 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353196d-d017-4829-a065-24527efa8bdf None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:32.464539 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353196d-d017-4829-a065-24527efa8bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:32.464826 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353196d-d017-4829-a065-24527efa8bdf None admin] PATH_INFO: `/v3/projects/1367e35623684adc931fd16f99a77b44` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:32.466284 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353196d-d017-4829-a065-24527efa8bdf None admin] RBAC: Authorizing `identity:get_project(project_id=1367e35623684adc931fd16f99a77b44)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:32.467769 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353196d-d017-4829-a065-24527efa8bdf None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:32.469643 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 145/287] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:06:32 2022] GET /identity/v3/projects/1367e35623684adc931fd16f99a77b44 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:32.475176 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353196d-d017-4829-a065-24527efa8bdf None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:32.581998 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353196d-d017-4829-a065-24527efa8bdf None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:32.582868 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90811f24-89f3-430e-be76-05f52ddcd806 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:32.617579 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75022d1-bafe-48cf-8586-d42d6ff2a27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:32.618253 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75022d1-bafe-48cf-8586-d42d6ff2a27f None admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:32.618580 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75022d1-bafe-48cf-8586-d42d6ff2a27f None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:32.618857 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75022d1-bafe-48cf-8586-d42d6ff2a27f None admin] PATH_INFO: `/v3/projects/1367e35623684adc931fd16f99a77b44/users/f548e94a82134d6ea3c6fbaf3e3809cc/roles/65ae44a45ff2443eb03c2802be0453c9` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:32.620854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75022d1-bafe-48cf-8586-d42d6ff2a27f None admin] RBAC: Authorizing `identity:create_grant(project_id=1367e35623684adc931fd16f99a77b44, user_id=f548e94a82134d6ea3c6fbaf3e3809cc, role_id=65ae44a45ff2443eb03c2802be0453c9)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:32.622308 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75022d1-bafe-48cf-8586-d42d6ff2a27f None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:32.643921 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 146/288] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Sep 21 12:06:32 2022] PUT /identity/v3/projects/1367e35623684adc931fd16f99a77b44/users/f548e94a82134d6ea3c6fbaf3e3809cc/roles/65ae44a45ff2443eb03c2802be0453c9 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:06:32.673619 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d4ce8-59c9-4e2c-afa6-cda1fbe06734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:32.674284 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d4ce8-59c9-4e2c-afa6-cda1fbe06734 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:32.674593 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d4ce8-59c9-4e2c-afa6-cda1fbe06734 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:32.674866 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d4ce8-59c9-4e2c-afa6-cda1fbe06734 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:32.703565 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d4ce8-59c9-4e2c-afa6-cda1fbe06734 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:32.709172 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-3e5d4ce8-59c9-4e2c-afa6-cda1fbe06734 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 12:06:32.709172 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:32.709172 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:32.709172 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:32.709172 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:32.709172 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:32.709172 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:32.709172 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:32.709172 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:32.709172 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:32.709172 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:32.709172 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:32.709172 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:32.709172 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:32.709172 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:32.709172 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:32.711532 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:32.711532 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:32.711532 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:32.711532 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:32.711532 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:32.711532 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:32.711532 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:32.711532 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:32.711532 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:32.711532 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:32.711532 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:32.711532 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:32.711532 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:32.711532 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:32.711532 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:32.711532 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:32.714467 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:32.714467 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:32.714467 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:32.714467 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:32.714467 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:32.714467 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:32.714467 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:32.714467 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:32.714467 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:32.714467 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:32.714467 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 12:06:32.714467 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:06:32.714467 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 143/289] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:06:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:06:32.719754 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75022d1-bafe-48cf-8586-d42d6ff2a27f None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:32.812373 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:32.871447 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75022d1-bafe-48cf-8586-d42d6ff2a27f None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:32.917795 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d3289-acf9-4154-a737-e9b3a7bdb0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:32.918443 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d3289-acf9-4154-a737-e9b3a7bdb0ef None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:32.918725 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d3289-acf9-4154-a737-e9b3a7bdb0ef None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:32.918996 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d3289-acf9-4154-a737-e9b3a7bdb0ef None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:32.919670 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d3289-acf9-4154-a737-e9b3a7bdb0ef None admin] RBAC: Adding query filter params (name=member) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:32.919967 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d3289-acf9-4154-a737-e9b3a7bdb0ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:32.921361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d3289-acf9-4154-a737-e9b3a7bdb0ef None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:32.931368 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 147/290] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Sep 21 12:06:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:06:32.937387 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d4ce8-59c9-4e2c-afa6-cda1fbe06734 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:33.016700 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083553c9-766f-41b1-9e25-232c66aab00c None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:33.019048 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083553c9-766f-41b1-9e25-232c66aab00c None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:33.019048 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083553c9-766f-41b1-9e25-232c66aab00c None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:33.019048 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 148/291] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:33.027335 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94614c13-9203-4d7a-8806-ce60ad5a425a None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:33.027627 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94614c13-9203-4d7a-8806-ce60ad5a425a None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:33.027889 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94614c13-9203-4d7a-8806-ce60ad5a425a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:33.045184 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:33.052441 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-94614c13-9203-4d7a-8806-ce60ad5a425a None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:33.054000 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-94614c13-9203-4d7a-8806-ce60ad5a425a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:33.079187 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d4ce8-59c9-4e2c-afa6-cda1fbe06734 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:33.130177 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812bdfed-68db-4d84-8aa8-502f78a45195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:33.131141 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812bdfed-68db-4d84-8aa8-502f78a45195 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:33.131598 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812bdfed-68db-4d84-8aa8-502f78a45195 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:33.132115 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812bdfed-68db-4d84-8aa8-502f78a45195 None admin] PATH_INFO: `/v3/users/d05d3bec47604fbd8f2a5ec838035d83` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:33.133808 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812bdfed-68db-4d84-8aa8-502f78a45195 None admin] RBAC: Authorizing `identity:get_user(user_id=d05d3bec47604fbd8f2a5ec838035d83)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:33.137103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812bdfed-68db-4d84-8aa8-502f78a45195 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:33.140778 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 144/292] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:06:32 2022] GET /identity/v3/users/d05d3bec47604fbd8f2a5ec838035d83 => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:33.146147 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812bdfed-68db-4d84-8aa8-502f78a45195 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:33.169371 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 149/293] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:06:33.299220 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812bdfed-68db-4d84-8aa8-502f78a45195 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:33.351851 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d9ff9-b9d8-4205-b6dc-b8a2b9795deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:33.352893 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d9ff9-b9d8-4205-b6dc-b8a2b9795deb None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:33.353377 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d9ff9-b9d8-4205-b6dc-b8a2b9795deb None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:33.354492 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d9ff9-b9d8-4205-b6dc-b8a2b9795deb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:33.380849 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:33.458507 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41d9ff9-b9d8-4205-b6dc-b8a2b9795deb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:33.460036 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41d9ff9-b9d8-4205-b6dc-b8a2b9795deb None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:33.462119 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94614c13-9203-4d7a-8806-ce60ad5a425a None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:33.543479 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:33.606384 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94614c13-9203-4d7a-8806-ce60ad5a425a None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:33.616490 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 145/294] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:06:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 12:06:33.617827 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827852f5-e79f-42c8-9b52-b55c2fd20ebf None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:33.618119 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827852f5-e79f-42c8-9b52-b55c2fd20ebf None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:33.618421 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827852f5-e79f-42c8-9b52-b55c2fd20ebf None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:33.619694 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 146/295] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:33.621231 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597314e8-4368-4d80-a4d2-aeb41a8cbd1f None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:33.621497 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597314e8-4368-4d80-a4d2-aeb41a8cbd1f None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:33.621770 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597314e8-4368-4d80-a4d2-aeb41a8cbd1f None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:33.626490 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 147/296] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:33.626490 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597314e8-4368-4d80-a4d2-aeb41a8cbd1f None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:33.652818 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d88e1-1f1d-4dea-b554-ede479d42d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:33.653376 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d88e1-1f1d-4dea-b554-ede479d42d91 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:33.653684 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d88e1-1f1d-4dea-b554-ede479d42d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:33.654046 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d88e1-1f1d-4dea-b554-ede479d42d91 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:33.667291 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d88e1-1f1d-4dea-b554-ede479d42d91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:33.672696 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-561d88e1-1f1d-4dea-b554-ede479d42d91 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 12:06:33.672696 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:33.672696 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:33.672696 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:33.672696 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:33.672696 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:33.672696 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:33.672696 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:33.672696 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:33.672696 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:33.672696 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:33.672696 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:33.672696 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:33.672696 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:33.672696 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:33.672696 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:33.673660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:33.673660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:33.673660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:33.673660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:33.673660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:33.673660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:33.673660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:33.673660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:33.673660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:33.673660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:33.673660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:33.673660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:33.673660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:33.673660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:33.673660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:33.673660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:33.674903 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:33.674903 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:33.674903 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:33.674903 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:33.674903 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:33.674903 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:33.674903 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:33.674903 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:33.674903 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:33.674903 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:33.674903 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 12:06:33.674903 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:06:33.674903 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 150/297] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:06:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 12:06:33.676356 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46452733-a862-49b1-a29a-d1acb701cb9d None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:33.676644 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46452733-a862-49b1-a29a-d1acb701cb9d None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:33.677011 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46452733-a862-49b1-a29a-d1acb701cb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:33.690068 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:33.695848 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-46452733-a862-49b1-a29a-d1acb701cb9d None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:33.697083 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-46452733-a862-49b1-a29a-d1acb701cb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:33.752709 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597314e8-4368-4d80-a4d2-aeb41a8cbd1f None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:33.770934 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 151/298] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:06:33.772144 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52156adf-765b-4187-a11b-27cfad8b7816 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:33.772433 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52156adf-765b-4187-a11b-27cfad8b7816 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:33.772705 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52156adf-765b-4187-a11b-27cfad8b7816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:33.791061 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-52156adf-765b-4187-a11b-27cfad8b7816 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:33.792279 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-52156adf-765b-4187-a11b-27cfad8b7816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:33.806281 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f817d-bedf-4a44-9412-e68d6f2c6cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:33.807984 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f817d-bedf-4a44-9412-e68d6f2c6cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:33.808969 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f817d-bedf-4a44-9412-e68d6f2c6cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:33.809742 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f817d-bedf-4a44-9412-e68d6f2c6cb6 None admin] PATH_INFO: `/v3/projects/1367e35623684adc931fd16f99a77b44` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:33.812503 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f817d-bedf-4a44-9412-e68d6f2c6cb6 None admin] RBAC: Authorizing `identity:get_project(project_id=1367e35623684adc931fd16f99a77b44)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:33.814980 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f817d-bedf-4a44-9412-e68d6f2c6cb6 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:33.816906 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 148/299] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:06:33 2022] GET /identity/v3/projects/1367e35623684adc931fd16f99a77b44 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:33.817965 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f817d-bedf-4a44-9412-e68d6f2c6cb6 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:33.827515 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:33.873412 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 152/300] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:06:33.874560 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52156adf-765b-4187-a11b-27cfad8b7816 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:33.987244 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f817d-bedf-4a44-9412-e68d6f2c6cb6 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:34.024095 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52156adf-765b-4187-a11b-27cfad8b7816 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:34.035866 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:34.067010 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206e66e-1f5a-4ee2-920c-97e64567cab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:34.067837 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206e66e-1f5a-4ee2-920c-97e64567cab6 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:34.068120 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206e66e-1f5a-4ee2-920c-97e64567cab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:34.068393 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206e66e-1f5a-4ee2-920c-97e64567cab6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:34.069115 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e206e66e-1f5a-4ee2-920c-97e64567cab6 None admin] RBAC: Adding query filter params (role.id=9712f7b332bf484689b3706721ab6311, scope.project.id=1367e35623684adc931fd16f99a77b44, user.id=d05d3bec47604fbd8f2a5ec838035d83) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:34.069422 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e206e66e-1f5a-4ee2-920c-97e64567cab6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:34.070889 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e206e66e-1f5a-4ee2-920c-97e64567cab6 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:34.086411 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 153/301] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:06:33 2022] GET /identity/v3/role_assignments?user.id=d05d3bec47604fbd8f2a5ec838035d83&scope.project.id=1367e35623684adc931fd16f99a77b44&role.id=9712f7b332bf484689b3706721ab6311 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:34.086411 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206e66e-1f5a-4ee2-920c-97e64567cab6 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:34.086665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d388fe-adf8-416a-9c60-45619deed5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:34.086665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d388fe-adf8-416a-9c60-45619deed5e7 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:34.086665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d388fe-adf8-416a-9c60-45619deed5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:34.086665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d388fe-adf8-416a-9c60-45619deed5e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:34.086948 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d388fe-adf8-416a-9c60-45619deed5e7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:34.086948 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d388fe-adf8-416a-9c60-45619deed5e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:34.086948 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d388fe-adf8-416a-9c60-45619deed5e7 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:34.107765 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 149/302] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Sep 21 12:06:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:34.113719 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d388fe-adf8-416a-9c60-45619deed5e7 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:34.146777 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:34.243013 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206e66e-1f5a-4ee2-920c-97e64567cab6 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:34.267387 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d388fe-adf8-416a-9c60-45619deed5e7 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:34.291811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1b7d5-97a6-459c-a761-607d52d95e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:34.292799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1b7d5-97a6-459c-a761-607d52d95e51 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:34.293081 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1b7d5-97a6-459c-a761-607d52d95e51 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:34.293351 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1b7d5-97a6-459c-a761-607d52d95e51 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:34.294600 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a1b7d5-97a6-459c-a761-607d52d95e51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:34.296038 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a1b7d5-97a6-459c-a761-607d52d95e51 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:34.297620 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 154/303] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:06:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:34.298522 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1b7d5-97a6-459c-a761-607d52d95e51 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:34.312333 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ed193-104b-418a-9db0-7e8cf672023f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:34.313005 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ed193-104b-418a-9db0-7e8cf672023f None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:34.313250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ed193-104b-418a-9db0-7e8cf672023f None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:34.313523 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ed193-104b-418a-9db0-7e8cf672023f None admin] PATH_INFO: `/v3/users/e553a7a13ea04b98ad80eb358900a633` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:34.328835 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541ed193-104b-418a-9db0-7e8cf672023f None admin] RBAC: Authorizing `identity:get_user(user_id=e553a7a13ea04b98ad80eb358900a633)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:34.330321 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541ed193-104b-418a-9db0-7e8cf672023f None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:34.332026 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 150/304] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:06:34 2022] GET /identity/v3/users/e553a7a13ea04b98ad80eb358900a633 => generated 293 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:34.332853 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ed193-104b-418a-9db0-7e8cf672023f None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:34.378606 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:34.414256 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:34.421826 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1b7d5-97a6-459c-a761-607d52d95e51 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:34.451204 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ed193-104b-418a-9db0-7e8cf672023f None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:34.456656 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd6b5d-678e-4e29-a282-68915fff8c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:34.457365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd6b5d-678e-4e29-a282-68915fff8c7b None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:34.457715 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd6b5d-678e-4e29-a282-68915fff8c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:34.458059 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd6b5d-678e-4e29-a282-68915fff8c7b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:34.472196 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd6b5d-678e-4e29-a282-68915fff8c7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:34.479796 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-eecd6b5d-678e-4e29-a282-68915fff8c7b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 12:06:34.479796 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:34.479796 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:34.479796 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:34.479796 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:34.479796 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:34.479796 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:34.479796 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:34.479796 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:34.479796 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:34.479796 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:34.479796 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:34.479796 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:34.479796 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:34.479796 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:34.479796 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:34.480705 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:34.480705 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:34.480705 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:34.480705 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:34.480705 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:34.480705 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:34.480705 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:34.480705 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:34.480705 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:34.480705 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:34.480705 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:34.480705 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:34.480705 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:34.480705 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:34.480705 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:34.480705 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:34.481486 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:34.481486 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:34.481486 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:34.481486 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:34.481486 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:34.481486 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:34.481486 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:34.481486 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:34.481486 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:34.481486 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:34.481486 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 12:06:34.481486 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:06:34.481486 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 155/305] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:06:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:06:34.482130 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd6b5d-678e-4e29-a282-68915fff8c7b None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:34.496318 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ba99d-2958-411c-8781-5b1c550dda9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:34.496802 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ba99d-2958-411c-8781-5b1c550dda9d None admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:34.497079 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ba99d-2958-411c-8781-5b1c550dda9d None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:34.497352 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ba99d-2958-411c-8781-5b1c550dda9d None admin] PATH_INFO: `/v3/groups` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:34.497976 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ba99d-2958-411c-8781-5b1c550dda9d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:34.499445 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ba99d-2958-411c-8781-5b1c550dda9d None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:34.522396 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 151/306] 10.222.0.60 () {60 vars in 1134 bytes} [Wed Sep 21 12:06:34 2022] POST /identity/v3/groups => generated 229 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:06:34.522396 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ba99d-2958-411c-8781-5b1c550dda9d None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:34.617258 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd6b5d-678e-4e29-a282-68915fff8c7b None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:34.658217 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489e7fc-56e0-4dfe-8054-361b79b47121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:34.659018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489e7fc-56e0-4dfe-8054-361b79b47121 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:34.659374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489e7fc-56e0-4dfe-8054-361b79b47121 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:34.659702 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489e7fc-56e0-4dfe-8054-361b79b47121 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:34.660440 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489e7fc-56e0-4dfe-8054-361b79b47121 None admin] RBAC: Adding query filter params (role.id=65ae44a45ff2443eb03c2802be0453c9, user.id=e553a7a13ea04b98ad80eb358900a633, scope.system=all) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:34.660746 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489e7fc-56e0-4dfe-8054-361b79b47121 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:34.662469 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489e7fc-56e0-4dfe-8054-361b79b47121 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:34.668790 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:34.670279 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 156/307] 10.222.0.60 () {56 vars in 1308 bytes} [Wed Sep 21 12:06:34 2022] GET /identity/v3/role_assignments?user.id=e553a7a13ea04b98ad80eb358900a633&scope.system=all&role.id=65ae44a45ff2443eb03c2802be0453c9 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:34.679827 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ba99d-2958-411c-8781-5b1c550dda9d None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:34.722606 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f720aa-86b6-4692-b822-1b7653f5650e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:34.723562 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f720aa-86b6-4692-b822-1b7653f5650e None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:34.724066 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f720aa-86b6-4692-b822-1b7653f5650e None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:34.724515 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f720aa-86b6-4692-b822-1b7653f5650e None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:34.725382 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f720aa-86b6-4692-b822-1b7653f5650e None admin] RBAC: Adding query filter params (name=member) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:34.725871 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f720aa-86b6-4692-b822-1b7653f5650e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:34.727528 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f720aa-86b6-4692-b822-1b7653f5650e None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:34.739407 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 152/308] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Sep 21 12:06:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:34.745067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489e7fc-56e0-4dfe-8054-361b79b47121 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:34.773721 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:34.866109 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489e7fc-56e0-4dfe-8054-361b79b47121 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:34.902125 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74fc9db-3112-4ee1-a1f1-0cbf14442b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:34.902788 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fc9db-3112-4ee1-a1f1-0cbf14442b1b None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:34.903066 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fc9db-3112-4ee1-a1f1-0cbf14442b1b None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:34.903339 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fc9db-3112-4ee1-a1f1-0cbf14442b1b None admin] PATH_INFO: `/v3/users/ce528bc2a65a4e34a7e3f2830a41cbd1` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:34.904480 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74fc9db-3112-4ee1-a1f1-0cbf14442b1b None admin] RBAC: Authorizing `identity:get_user(user_id=ce528bc2a65a4e34a7e3f2830a41cbd1)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:34.905990 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74fc9db-3112-4ee1-a1f1-0cbf14442b1b None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:34.907983 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 157/309] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:06:34 2022] GET /identity/v3/users/ce528bc2a65a4e34a7e3f2830a41cbd1 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:06:34.913779 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f720aa-86b6-4692-b822-1b7653f5650e None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:35.023526 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f720aa-86b6-4692-b822-1b7653f5650e None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:35.060682 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96204e2-739e-4467-994e-5ea9aebebc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:35.061771 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96204e2-739e-4467-994e-5ea9aebebc07 None admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:35.062251 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96204e2-739e-4467-994e-5ea9aebebc07 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:35.062754 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96204e2-739e-4467-994e-5ea9aebebc07 None admin] PATH_INFO: `/v3/system/users/ce528bc2a65a4e34a7e3f2830a41cbd1/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:35.064367 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96204e2-739e-4467-994e-5ea9aebebc07 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ce528bc2a65a4e34a7e3f2830a41cbd1, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:35.065949 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96204e2-739e-4467-994e-5ea9aebebc07 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:35.080748 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 153/310] 10.222.0.60 () {58 vars in 1334 bytes} [Wed Sep 21 12:06:34 2022] PUT /identity/v3/system/users/ce528bc2a65a4e34a7e3f2830a41cbd1/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:06:35.389622 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de557863-f5f1-4469-9afd-8f5910173b3c None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:35.389966 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de557863-f5f1-4469-9afd-8f5910173b3c None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:35.390143 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de557863-f5f1-4469-9afd-8f5910173b3c None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:35.391710 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 158/311] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:35.397217 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641260d5-93d9-40e8-a0a5-e3a388a04043 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:35.397666 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641260d5-93d9-40e8-a0a5-e3a388a04043 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:35.397855 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641260d5-93d9-40e8-a0a5-e3a388a04043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:35.417166 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-641260d5-93d9-40e8-a0a5-e3a388a04043 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:35.418387 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-641260d5-93d9-40e8-a0a5-e3a388a04043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:35.434586 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:35.490979 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 154/312] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:06:35.775190 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de557863-f5f1-4469-9afd-8f5910173b3c None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:35.870023 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:35.883690 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de557863-f5f1-4469-9afd-8f5910173b3c None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:35.919927 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359a139-69be-4f84-9992-a14e0c676f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:35.920569 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359a139-69be-4f84-9992-a14e0c676f03 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:35.920852 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359a139-69be-4f84-9992-a14e0c676f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:35.921128 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359a139-69be-4f84-9992-a14e0c676f03 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:35.934080 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a359a139-69be-4f84-9992-a14e0c676f03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:35.938979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-a359a139-69be-4f84-9992-a14e0c676f03 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 12:06:35.938979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:35.938979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:35.938979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:35.938979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:35.938979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:35.938979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:35.938979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:35.938979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:35.938979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:35.938979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:35.938979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:35.938979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:35.938979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:35.938979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:35.938979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:35.939854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:35.939854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:35.939854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:35.939854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:35.939854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:35.939854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:35.939854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:35.939854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:35.939854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:35.939854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:35.939854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:35.939854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:35.939854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:35.939854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:35.939854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:35.939854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:35.940642 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:35.940642 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:35.940642 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:35.940642 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:35.940642 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:35.940642 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:35.940642 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:35.940642 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:35.940642 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:35.940642 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:35.940642 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 12:06:35.940642 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:06:35.940642 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 159/313] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:06:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:06:35.946200 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641260d5-93d9-40e8-a0a5-e3a388a04043 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:36.055764 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641260d5-93d9-40e8-a0a5-e3a388a04043 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:36.092033 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87d6a1-6819-49ca-88ef-347c3e39992b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:36.092644 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87d6a1-6819-49ca-88ef-347c3e39992b None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:36.092923 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87d6a1-6819-49ca-88ef-347c3e39992b None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:36.093205 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87d6a1-6819-49ca-88ef-347c3e39992b None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:36.093863 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a87d6a1-6819-49ca-88ef-347c3e39992b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:36.094168 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a87d6a1-6819-49ca-88ef-347c3e39992b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:36.095588 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a87d6a1-6819-49ca-88ef-347c3e39992b None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:36.104887 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 155/314] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Sep 21 12:06:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:36.110649 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359a139-69be-4f84-9992-a14e0c676f03 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:36.215067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359a139-69be-4f84-9992-a14e0c676f03 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:36.252726 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d67646-2dd3-4263-a8b4-b6aee6766226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:36.253356 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d67646-2dd3-4263-a8b4-b6aee6766226 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:36.253634 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d67646-2dd3-4263-a8b4-b6aee6766226 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:36.253967 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d67646-2dd3-4263-a8b4-b6aee6766226 None admin] PATH_INFO: `/v3/users/f548e94a82134d6ea3c6fbaf3e3809cc` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:36.255331 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d67646-2dd3-4263-a8b4-b6aee6766226 None admin] RBAC: Authorizing `identity:get_user(user_id=f548e94a82134d6ea3c6fbaf3e3809cc)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:36.256930 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d67646-2dd3-4263-a8b4-b6aee6766226 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:36.258981 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 160/315] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:06:36 2022] GET /identity/v3/users/f548e94a82134d6ea3c6fbaf3e3809cc => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:36.264937 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87d6a1-6819-49ca-88ef-347c3e39992b None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:36.281264 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:36.382299 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87d6a1-6819-49ca-88ef-347c3e39992b None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:36.419268 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472f0a5-1f92-48cb-8f99-97fccc1560ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:36.419922 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472f0a5-1f92-48cb-8f99-97fccc1560ae None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:36.420148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472f0a5-1f92-48cb-8f99-97fccc1560ae None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:36.420422 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472f0a5-1f92-48cb-8f99-97fccc1560ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:36.500345 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b472f0a5-1f92-48cb-8f99-97fccc1560ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:36.501815 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b472f0a5-1f92-48cb-8f99-97fccc1560ae None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:36.516246 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:36.618500 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 156/316] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:06:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 12:06:36.624292 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d67646-2dd3-4263-a8b4-b6aee6766226 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:36.644106 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:36.733240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d67646-2dd3-4263-a8b4-b6aee6766226 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:36.773166 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8ad73-7f5a-4cf7-a8ae-afd587ae98da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:36.773822 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8ad73-7f5a-4cf7-a8ae-afd587ae98da None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:36.774172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8ad73-7f5a-4cf7-a8ae-afd587ae98da None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:36.774493 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8ad73-7f5a-4cf7-a8ae-afd587ae98da None admin] PATH_INFO: `/v3/projects/1367e35623684adc931fd16f99a77b44` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:36.776337 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c8ad73-7f5a-4cf7-a8ae-afd587ae98da None admin] RBAC: Authorizing `identity:get_project(project_id=1367e35623684adc931fd16f99a77b44)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:36.777890 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c8ad73-7f5a-4cf7-a8ae-afd587ae98da None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:36.780033 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 161/317] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:06:36 2022] GET /identity/v3/projects/1367e35623684adc931fd16f99a77b44 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:36.786267 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472f0a5-1f92-48cb-8f99-97fccc1560ae None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:36.881604 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d9902-16a9-4f82-8c0a-a65a31bdea91 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:36.882126 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d9902-16a9-4f82-8c0a-a65a31bdea91 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:36.882126 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d9902-16a9-4f82-8c0a-a65a31bdea91 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:36.883502 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 162/318] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:36.892301 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b4842-303c-4ab0-8a25-ce0c024f1e83 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:36.892735 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b4842-303c-4ab0-8a25-ce0c024f1e83 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:36.893117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b4842-303c-4ab0-8a25-ce0c024f1e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:36.910752 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472f0a5-1f92-48cb-8f99-97fccc1560ae None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:36.917848 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-0c9b4842-303c-4ab0-8a25-ce0c024f1e83 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:36.919330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-0c9b4842-303c-4ab0-8a25-ce0c024f1e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:36.935408 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:36.960615 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b1911e-fa07-4d21-91d2-c8d9d074493d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:36.960615 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1911e-fa07-4d21-91d2-c8d9d074493d None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:36.960913 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1911e-fa07-4d21-91d2-c8d9d074493d None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:36.961168 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1911e-fa07-4d21-91d2-c8d9d074493d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:36.961912 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b1911e-fa07-4d21-91d2-c8d9d074493d None admin] RBAC: Adding query filter params (role.id=65ae44a45ff2443eb03c2802be0453c9, scope.project.id=1367e35623684adc931fd16f99a77b44, user.id=f548e94a82134d6ea3c6fbaf3e3809cc) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:36.962345 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b1911e-fa07-4d21-91d2-c8d9d074493d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:36.963914 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b1911e-fa07-4d21-91d2-c8d9d074493d None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:36.972184 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 157/319] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:06:36 2022] GET /identity/v3/role_assignments?user.id=f548e94a82134d6ea3c6fbaf3e3809cc&scope.project.id=1367e35623684adc931fd16f99a77b44&role.id=65ae44a45ff2443eb03c2802be0453c9 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:37.009709 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 163/320] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:06:37.033537 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b2fa7-cf3b-48d8-b355-38fe7bbdb3f5 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:37.034126 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b2fa7-cf3b-48d8-b355-38fe7bbdb3f5 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:37.034646 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b2fa7-cf3b-48d8-b355-38fe7bbdb3f5 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:37.036564 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 158/321] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:37.043106 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18120d-e73b-4a56-96a1-6add827f2a07 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:37.043539 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18120d-e73b-4a56-96a1-6add827f2a07 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:37.043939 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18120d-e73b-4a56-96a1-6add827f2a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:37.064922 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-6a18120d-e73b-4a56-96a1-6add827f2a07 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:37.066336 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-6a18120d-e73b-4a56-96a1-6add827f2a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:37.078223 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:37.144788 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 164/322] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:06:37.297679 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b2fa7-cf3b-48d8-b355-38fe7bbdb3f5 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:37.367793 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0761d-b5c4-49f2-82c5-929afc98f215 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:37.368090 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0761d-b5c4-49f2-82c5-929afc98f215 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:37.368358 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0761d-b5c4-49f2-82c5-929afc98f215 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:37.369746 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 165/323] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:06:37.374822 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de6893-1287-4cf2-8556-c59fb1d444b7 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:37.375106 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de6893-1287-4cf2-8556-c59fb1d444b7 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:37.375380 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de6893-1287-4cf2-8556-c59fb1d444b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:37.394119 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-86de6893-1287-4cf2-8556-c59fb1d444b7 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:37.395560 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-86de6893-1287-4cf2-8556-c59fb1d444b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:37.407149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b2fa7-cf3b-48d8-b355-38fe7bbdb3f5 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:37.441779 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc9855-7cba-4230-916a-90becaaf4121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:37.442479 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc9855-7cba-4230-916a-90becaaf4121 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:37.442703 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc9855-7cba-4230-916a-90becaaf4121 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:37.442975 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc9855-7cba-4230-916a-90becaaf4121 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:37.444079 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc9855-7cba-4230-916a-90becaaf4121 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:37.445532 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc9855-7cba-4230-916a-90becaaf4121 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:37.450404 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 159/324] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:06:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:37.450404 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc9855-7cba-4230-916a-90becaaf4121 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:37.469750 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 166/325] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 12:06:37.470615 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de6893-1287-4cf2-8556-c59fb1d444b7 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:37.504338 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:37.556585 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:37.570134 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc9855-7cba-4230-916a-90becaaf4121 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:37.588422 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de6893-1287-4cf2-8556-c59fb1d444b7 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:37.606435 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208198a0-d66f-4670-a93e-978bc7aa3e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:37.607067 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208198a0-d66f-4670-a93e-978bc7aa3e67 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:37.607400 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208198a0-d66f-4670-a93e-978bc7aa3e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:37.607756 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208198a0-d66f-4670-a93e-978bc7aa3e67 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:37.618657 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208198a0-d66f-4670-a93e-978bc7aa3e67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:37.623856 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-208198a0-d66f-4670-a93e-978bc7aa3e67 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 12:06:37.623856 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:37.623856 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:37.623856 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:37.623856 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:37.623856 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:37.623856 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:37.623856 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:37.623856 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:37.623856 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:37.623856 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:37.623856 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:37.623856 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:37.623856 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:37.623856 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:37.623856 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:37.624764 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:37.624764 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:37.624764 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:37.624764 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:37.624764 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:37.624764 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:37.624764 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:37.624764 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:37.624764 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:37.624764 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:37.624764 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:37.624764 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:37.624764 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:37.624764 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:37.624764 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:37.624764 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:37.625576 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:37.625576 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:37.625576 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:37.625576 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:37.625576 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:37.625576 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:37.625576 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:37.625576 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:37.625576 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:37.625576 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:37.625576 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 12:06:37.625576 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:06:37.625576 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 160/326] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:06:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:06:37.628033 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff6c86-eb0e-483a-9a7a-544dae082a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:37.628649 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff6c86-eb0e-483a-9a7a-544dae082a84 None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:37.628930 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff6c86-eb0e-483a-9a7a-544dae082a84 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:37.629205 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff6c86-eb0e-483a-9a7a-544dae082a84 None admin] PATH_INFO: `/v3/groups` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:37.630103 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff6c86-eb0e-483a-9a7a-544dae082a84 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:37.630582 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208198a0-d66f-4670-a93e-978bc7aa3e67 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:37.631585 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebff6c86-eb0e-483a-9a7a-544dae082a84 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:37.651461 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 167/327] 10.222.0.60 () {60 vars in 1134 bytes} [Wed Sep 21 12:06:37 2022] POST /identity/v3/groups => generated 226 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:06:37.740457 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff6c86-eb0e-483a-9a7a-544dae082a84 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:37.759163 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208198a0-d66f-4670-a93e-978bc7aa3e67 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:37.763149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:37.804797 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d03eab-dd4e-4ac1-b6ce-7e9c46a32ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:37.805415 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d03eab-dd4e-4ac1-b6ce-7e9c46a32ba4 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:37.805693 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d03eab-dd4e-4ac1-b6ce-7e9c46a32ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:37.805962 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d03eab-dd4e-4ac1-b6ce-7e9c46a32ba4 None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:37.807863 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d03eab-dd4e-4ac1-b6ce-7e9c46a32ba4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:37.807863 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d03eab-dd4e-4ac1-b6ce-7e9c46a32ba4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:37.809308 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d03eab-dd4e-4ac1-b6ce-7e9c46a32ba4 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:37.819103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 161/328] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Sep 21 12:06:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:06:37.824914 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d03eab-dd4e-4ac1-b6ce-7e9c46a32ba4 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:37.866934 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff6c86-eb0e-483a-9a7a-544dae082a84 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:37.909752 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035aea9b-9f8e-48dd-8388-d039e6bacbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:37.910513 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035aea9b-9f8e-48dd-8388-d039e6bacbf7 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:37.910722 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035aea9b-9f8e-48dd-8388-d039e6bacbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:37.910998 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035aea9b-9f8e-48dd-8388-d039e6bacbf7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:37.913423 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:37.931102 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035aea9b-9f8e-48dd-8388-d039e6bacbf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:37.938752 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-035aea9b-9f8e-48dd-8388-d039e6bacbf7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 12:06:37.938752 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:37.938752 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:37.938752 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:37.938752 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:37.938752 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:37.938752 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:37.938752 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:37.938752 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:37.938752 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:37.938752 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:37.938752 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:37.938752 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:37.938752 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:37.938752 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:37.938752 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:37.939660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:37.939660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:37.939660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:37.939660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:37.939660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:37.939660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:37.939660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:37.939660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:37.939660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:37.939660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:37.939660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:37.939660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:37.939660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:37.939660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:37.939660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:37.939660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:37.940428 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:37.940428 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:37.940428 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:37.940428 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:37.940428 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:37.940428 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:37.940428 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:37.940428 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:37.940428 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:37.940428 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:37.940428 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 12:06:37.940428 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:06:37.941033 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 168/329] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:06:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:06:37.946696 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035aea9b-9f8e-48dd-8388-d039e6bacbf7 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:37.947698 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d03eab-dd4e-4ac1-b6ce-7e9c46a32ba4 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:37.999266 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fec33f-0347-48db-8f0b-1b9c9390f383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:37.999908 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fec33f-0347-48db-8f0b-1b9c9390f383 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:38.000352 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fec33f-0347-48db-8f0b-1b9c9390f383 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:38.000630 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fec33f-0347-48db-8f0b-1b9c9390f383 None admin] PATH_INFO: `/v3/users/e553a7a13ea04b98ad80eb358900a633` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:38.003210 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fec33f-0347-48db-8f0b-1b9c9390f383 None admin] RBAC: Authorizing `identity:get_user(user_id=e553a7a13ea04b98ad80eb358900a633)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:38.004103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fec33f-0347-48db-8f0b-1b9c9390f383 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:38.006062 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 162/330] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:06:37 2022] GET /identity/v3/users/e553a7a13ea04b98ad80eb358900a633 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:38.015600 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fec33f-0347-48db-8f0b-1b9c9390f383 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:38.063359 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:38.077900 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035aea9b-9f8e-48dd-8388-d039e6bacbf7 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:38.118100 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66a0a7-2b54-4c4a-bf4f-a5adfe716c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:38.118771 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66a0a7-2b54-4c4a-bf4f-a5adfe716c77 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:38.119073 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66a0a7-2b54-4c4a-bf4f-a5adfe716c77 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:38.119345 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66a0a7-2b54-4c4a-bf4f-a5adfe716c77 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:38.120020 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f66a0a7-2b54-4c4a-bf4f-a5adfe716c77 None admin] RBAC: Adding query filter params (name=member) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:38.120320 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f66a0a7-2b54-4c4a-bf4f-a5adfe716c77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:38.121708 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f66a0a7-2b54-4c4a-bf4f-a5adfe716c77 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:38.133474 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 169/331] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Sep 21 12:06:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:06:38.140560 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66a0a7-2b54-4c4a-bf4f-a5adfe716c77 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:38.155298 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fec33f-0347-48db-8f0b-1b9c9390f383 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:38.204553 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48b3e2-9e81-4697-b72d-4051903d2676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:38.205270 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48b3e2-9e81-4697-b72d-4051903d2676 None admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:38.205557 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48b3e2-9e81-4697-b72d-4051903d2676 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:38.205830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48b3e2-9e81-4697-b72d-4051903d2676 None admin] PATH_INFO: `/v3/system/users/e553a7a13ea04b98ad80eb358900a633/roles/65ae44a45ff2443eb03c2802be0453c9` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:38.207840 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48b3e2-9e81-4697-b72d-4051903d2676 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e553a7a13ea04b98ad80eb358900a633, role_id=65ae44a45ff2443eb03c2802be0453c9)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:38.209259 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48b3e2-9e81-4697-b72d-4051903d2676 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:38.214868 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:38.218013 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 163/332] 10.222.0.60 () {58 vars in 1334 bytes} [Wed Sep 21 12:06:38 2022] PUT /identity/v3/system/users/e553a7a13ea04b98ad80eb358900a633/roles/65ae44a45ff2443eb03c2802be0453c9 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:06:38.284676 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66a0a7-2b54-4c4a-bf4f-a5adfe716c77 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:38.326791 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1111838-3838-4f6e-a600-2e9053328a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:38.327363 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1111838-3838-4f6e-a600-2e9053328a76 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:38.327642 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1111838-3838-4f6e-a600-2e9053328a76 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:38.327917 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1111838-3838-4f6e-a600-2e9053328a76 None admin] PATH_INFO: `/v3/users/ce528bc2a65a4e34a7e3f2830a41cbd1` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:38.329145 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1111838-3838-4f6e-a600-2e9053328a76 None admin] RBAC: Authorizing `identity:get_user(user_id=ce528bc2a65a4e34a7e3f2830a41cbd1)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:38.330654 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1111838-3838-4f6e-a600-2e9053328a76 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:38.332735 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 170/333] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:06:38 2022] GET /identity/v3/users/ce528bc2a65a4e34a7e3f2830a41cbd1 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:06:38.340733 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48b3e2-9e81-4697-b72d-4051903d2676 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:38.469642 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:38.474447 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48b3e2-9e81-4697-b72d-4051903d2676 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:38.521804 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ecccb0-caf8-40e6-bb8d-6816da7bae4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:38.522446 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecccb0-caf8-40e6-bb8d-6816da7bae4d None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:38.522734 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecccb0-caf8-40e6-bb8d-6816da7bae4d None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:38.523009 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecccb0-caf8-40e6-bb8d-6816da7bae4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:38.523739 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ecccb0-caf8-40e6-bb8d-6816da7bae4d None admin] RBAC: Adding query filter params (role.id=9712f7b332bf484689b3706721ab6311, user.id=ce528bc2a65a4e34a7e3f2830a41cbd1, scope.system=all) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:38.524050 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ecccb0-caf8-40e6-bb8d-6816da7bae4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:38.525531 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ecccb0-caf8-40e6-bb8d-6816da7bae4d None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:38.538506 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 164/334] 10.222.0.60 () {56 vars in 1308 bytes} [Wed Sep 21 12:06:38 2022] GET /identity/v3/role_assignments?user.id=ce528bc2a65a4e34a7e3f2830a41cbd1&scope.system=all&role.id=9712f7b332bf484689b3706721ab6311 => generated 510 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:40.213891 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7d360-0bef-4302-924e-ee2385425def None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:40.214922 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7d360-0bef-4302-924e-ee2385425def None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:40.215398 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7d360-0bef-4302-924e-ee2385425def None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:40.217193 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 171/335] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:40.223105 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063815b7-0fba-4df0-883b-c774ec021d66 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:40.223993 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063815b7-0fba-4df0-883b-c774ec021d66 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:40.224469 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063815b7-0fba-4df0-883b-c774ec021d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:40.244715 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-063815b7-0fba-4df0-883b-c774ec021d66 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:40.246252 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-063815b7-0fba-4df0-883b-c774ec021d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:40.336049 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 165/336] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 12:06:40.734766 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a7192-c9bb-4f97-ae0a-f4e385ebedf9 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:40.735390 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a7192-c9bb-4f97-ae0a-f4e385ebedf9 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:40.735892 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a7192-c9bb-4f97-ae0a-f4e385ebedf9 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:40.737666 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 172/337] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:40.742790 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ade63-18ea-4f9f-a1ef-6f0de27a096f None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:40.743334 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ade63-18ea-4f9f-a1ef-6f0de27a096f None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:40.743833 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ade63-18ea-4f9f-a1ef-6f0de27a096f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:40.770624 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-c99ade63-18ea-4f9f-a1ef-6f0de27a096f None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:40.772139 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-c99ade63-18ea-4f9f-a1ef-6f0de27a096f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:40.864904 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 166/338] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:06:40.948065 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44b29d-5104-4c2a-a8bb-5188f638651e None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:40.948796 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44b29d-5104-4c2a-a8bb-5188f638651e None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:40.949306 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44b29d-5104-4c2a-a8bb-5188f638651e None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:40.951152 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 173/339] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:40.953194 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ade63-18ea-4f9f-a1ef-6f0de27a096f None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:40.956956 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0affb-2c03-4132-b586-9a3ddd04c18d None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:40.957513 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0affb-2c03-4132-b586-9a3ddd04c18d None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:40.958002 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0affb-2c03-4132-b586-9a3ddd04c18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:40.984865 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:40.992671 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-50a0affb-2c03-4132-b586-9a3ddd04c18d None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:40.995568 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-50a0affb-2c03-4132-b586-9a3ddd04c18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:41.140074 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 174/340] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:06:41.158113 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ade63-18ea-4f9f-a1ef-6f0de27a096f None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:41.207925 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd30ecc-3f34-4d61-ae8b-dcdb98216d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:41.208566 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd30ecc-3f34-4d61-ae8b-dcdb98216d35 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:41.208849 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd30ecc-3f34-4d61-ae8b-dcdb98216d35 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:41.209120 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd30ecc-3f34-4d61-ae8b-dcdb98216d35 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:41.222583 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd30ecc-3f34-4d61-ae8b-dcdb98216d35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:41.227577 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-3bd30ecc-3f34-4d61-ae8b-dcdb98216d35 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 12:06:41.227577 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:41.227577 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:41.227577 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:41.227577 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:41.227577 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:41.227577 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:41.227577 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:41.227577 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:41.227577 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:41.227577 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:41.227577 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:41.227577 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:41.227577 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:41.227577 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:41.227577 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:41.229524 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:41.229524 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:41.229524 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:41.229524 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:41.229524 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:41.229524 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:41.229524 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:41.229524 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:41.229524 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:41.229524 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:41.229524 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:41.229524 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:41.229524 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:41.229524 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:41.229524 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:41.229524 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:41.230324 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:41.230324 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:41.230324 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:41.230324 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:41.230324 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:41.230324 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:41.230324 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:41.230324 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:41.230324 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:41.230324 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:41.230324 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 12:06:41.230324 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:06:41.230324 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 167/341] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:06:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:06:41.236933 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a0affb-2c03-4132-b586-9a3ddd04c18d None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:41.307728 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:41.360187 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a0affb-2c03-4132-b586-9a3ddd04c18d None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:41.397536 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f0d48-5ad7-4f96-8130-912532605648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:41.398070 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f0d48-5ad7-4f96-8130-912532605648 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:41.398353 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f0d48-5ad7-4f96-8130-912532605648 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:41.398655 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f0d48-5ad7-4f96-8130-912532605648 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:41.399323 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f0d48-5ad7-4f96-8130-912532605648 None admin] RBAC: Adding query filter params (name=member) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:41.399627 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f0d48-5ad7-4f96-8130-912532605648 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:41.401086 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f0d48-5ad7-4f96-8130-912532605648 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:41.410435 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 175/342] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Sep 21 12:06:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:41.417745 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd30ecc-3f34-4d61-ae8b-dcdb98216d35 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:41.510213 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:41.520953 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f0d48-5ad7-4f96-8130-912532605648 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:41.535865 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd30ecc-3f34-4d61-ae8b-dcdb98216d35 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:41.588140 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58cfe7-7048-4842-8947-5d302e47d941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:41.588857 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58cfe7-7048-4842-8947-5d302e47d941 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:41.589309 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58cfe7-7048-4842-8947-5d302e47d941 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:41.589726 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58cfe7-7048-4842-8947-5d302e47d941 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:41.661160 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f0d48-5ad7-4f96-8130-912532605648 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:41.680051 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:41.703597 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d58cfe7-7048-4842-8947-5d302e47d941 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:41.705349 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d58cfe7-7048-4842-8947-5d302e47d941 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:41.713977 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb2cf7-03d1-483b-8f6b-27f3cfac7e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:41.714860 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb2cf7-03d1-483b-8f6b-27f3cfac7e5c None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:41.715244 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb2cf7-03d1-483b-8f6b-27f3cfac7e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:41.715614 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb2cf7-03d1-483b-8f6b-27f3cfac7e5c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:41.731794 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb2cf7-03d1-483b-8f6b-27f3cfac7e5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:41.743178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-c6bb2cf7-03d1-483b-8f6b-27f3cfac7e5c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 12:06:41.743178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:41.743178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:41.743178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:41.743178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:41.743178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:41.743178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:41.743178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:41.743178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:41.743178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:41.743178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:41.743178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:41.743178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:41.743178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:41.743178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:41.743178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:41.744182 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:41.744182 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:41.744182 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:41.744182 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:41.744182 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:41.744182 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:41.744182 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:41.744182 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:41.744182 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:41.744182 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:41.744182 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:41.744182 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:41.744182 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:41.744182 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:41.744182 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:41.744182 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:41.744969 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:41.744969 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:41.744969 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:41.744969 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:41.744969 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:41.744969 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:41.744969 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:41.744969 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:41.744969 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:41.744969 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:41.744969 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 12:06:41.744969 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:06:41.747647 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 176/343] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Sep 21 12:06:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 12:06:41.753627 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb2cf7-03d1-483b-8f6b-27f3cfac7e5c None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:41.828280 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:41.858632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 168/344] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:06:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 12:06:41.859524 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58cfe7-7048-4842-8947-5d302e47d941 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:41.906254 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb2cf7-03d1-483b-8f6b-27f3cfac7e5c None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:41.954217 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57770b7f-985a-4522-8672-b296088d5a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:41.955085 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57770b7f-985a-4522-8672-b296088d5a27 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:41.955523 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57770b7f-985a-4522-8672-b296088d5a27 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:41.955998 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57770b7f-985a-4522-8672-b296088d5a27 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:41.956809 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57770b7f-985a-4522-8672-b296088d5a27 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:41.957278 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57770b7f-985a-4522-8672-b296088d5a27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:41.960445 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57770b7f-985a-4522-8672-b296088d5a27 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:41.971745 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 177/345] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:06:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:06:41.973005 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5335b-6022-4dd3-99ac-1a5c78c632d0 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:41.973291 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5335b-6022-4dd3-99ac-1a5c78c632d0 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:41.973567 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5335b-6022-4dd3-99ac-1a5c78c632d0 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:41.975179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 178/346] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:41.978514 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5335b-6022-4dd3-99ac-1a5c78c632d0 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:41.997083 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58cfe7-7048-4842-8947-5d302e47d941 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:42.037151 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:42.041494 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1951f11b-ef42-4b3c-9d67-75169462fce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:42.042799 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951f11b-ef42-4b3c-9d67-75169462fce5 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:42.043199 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951f11b-ef42-4b3c-9d67-75169462fce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:42.043554 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951f11b-ef42-4b3c-9d67-75169462fce5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:42.055191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1951f11b-ef42-4b3c-9d67-75169462fce5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:42.061542 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-1951f11b-ef42-4b3c-9d67-75169462fce5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 12:06:42.061542 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:42.061542 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:42.061542 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:42.061542 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:42.061542 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:42.061542 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:42.061542 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:42.061542 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:42.061542 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:42.061542 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:42.061542 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:42.061542 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:42.061542 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:42.061542 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:42.061542 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:42.063830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:42.063830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:42.063830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:42.063830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:42.063830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:42.063830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:42.063830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:42.063830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:42.063830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:42.063830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:42.063830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:42.063830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:42.063830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:42.063830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:42.063830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:42.063830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:42.064665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:42.064665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:42.064665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:42.064665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:42.064665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:42.064665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:42.064665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:42.064665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:42.064665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:42.064665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:42.064665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 12:06:42.064665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:06:42.064665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 169/347] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:06:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:06:42.065347 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af51339-1c07-4112-8b6e-d22d8664805e None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:42.065347 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af51339-1c07-4112-8b6e-d22d8664805e None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:42.065471 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af51339-1c07-4112-8b6e-d22d8664805e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:42.095975 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-4af51339-1c07-4112-8b6e-d22d8664805e None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:42.097358 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-4af51339-1c07-4112-8b6e-d22d8664805e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:42.112963 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5335b-6022-4dd3-99ac-1a5c78c632d0 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:42.138041 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:42.157101 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79f09d-96cd-4e71-bab0-e2d6338488be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:42.158008 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79f09d-96cd-4e71-bab0-e2d6338488be None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:42.158484 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79f09d-96cd-4e71-bab0-e2d6338488be None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:42.158922 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79f09d-96cd-4e71-bab0-e2d6338488be None admin] PATH_INFO: `/v3/projects/39342ea2ea9b45c8817058e7bed7c739` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:42.160739 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d79f09d-96cd-4e71-bab0-e2d6338488be None admin] RBAC: Authorizing `identity:get_project(project_id=39342ea2ea9b45c8817058e7bed7c739)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:42.162606 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d79f09d-96cd-4e71-bab0-e2d6338488be None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:42.164683 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 179/348] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:06:41 2022] GET /identity/v3/projects/39342ea2ea9b45c8817058e7bed7c739 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:42.165799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79f09d-96cd-4e71-bab0-e2d6338488be None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:42.197946 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 170/349] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:06:42.198907 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af51339-1c07-4112-8b6e-d22d8664805e None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:42.332955 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af51339-1c07-4112-8b6e-d22d8664805e None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:42.357563 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79f09d-96cd-4e71-bab0-e2d6338488be None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:42.372220 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:42.409498 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073c1d2-8afe-4cd0-a3da-63dfc51485aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:42.410117 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073c1d2-8afe-4cd0-a3da-63dfc51485aa None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:42.410415 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073c1d2-8afe-4cd0-a3da-63dfc51485aa None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:42.410692 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073c1d2-8afe-4cd0-a3da-63dfc51485aa None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:42.411358 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7073c1d2-8afe-4cd0-a3da-63dfc51485aa None admin] RBAC: Adding query filter params (name=member) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:42.411661 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7073c1d2-8afe-4cd0-a3da-63dfc51485aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:42.413030 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7073c1d2-8afe-4cd0-a3da-63dfc51485aa None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:42.430474 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c3ca2-1559-4c86-ac40-2c0e0c335c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:42.431095 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c3ca2-1559-4c86-ac40-2c0e0c335c48 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:42.432000 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c3ca2-1559-4c86-ac40-2c0e0c335c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:42.432277 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c3ca2-1559-4c86-ac40-2c0e0c335c48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:42.434989 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 171/350] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Sep 21 12:06:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:42.435841 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073c1d2-8afe-4cd0-a3da-63dfc51485aa None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:42.515732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:42.535111 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13c3ca2-1559-4c86-ac40-2c0e0c335c48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:42.537630 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13c3ca2-1559-4c86-ac40-2c0e0c335c48 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:42.655956 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073c1d2-8afe-4cd0-a3da-63dfc51485aa None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:42.685513 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 180/351] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:06:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 12:06:42.686429 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c3ca2-1559-4c86-ac40-2c0e0c335c48 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:42.698801 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:42.708618 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea53feb-e436-4e81-9e87-0b779d76a254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:42.709939 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea53feb-e436-4e81-9e87-0b779d76a254 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:42.710477 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea53feb-e436-4e81-9e87-0b779d76a254 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:42.710939 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea53feb-e436-4e81-9e87-0b779d76a254 None admin] PATH_INFO: `/v3/groups/7ffeaf61ec3c42f0b0ff694a3392e12d` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:42.721690 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea53feb-e436-4e81-9e87-0b779d76a254 None admin] RBAC: Authorizing `identity:get_group(group_id=7ffeaf61ec3c42f0b0ff694a3392e12d)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:42.724306 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea53feb-e436-4e81-9e87-0b779d76a254 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:42.726094 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 172/352] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Sep 21 12:06:42 2022] GET /identity/v3/groups/7ffeaf61ec3c42f0b0ff694a3392e12d => generated 226 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:42.727022 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea53feb-e436-4e81-9e87-0b779d76a254 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:42.842555 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c3ca2-1559-4c86-ac40-2c0e0c335c48 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:42.856462 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:42.873295 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea53feb-e436-4e81-9e87-0b779d76a254 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:42.896060 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715b9db-a17d-42c2-9227-619efc8ade8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:42.896783 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715b9db-a17d-42c2-9227-619efc8ade8f None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:42.897065 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715b9db-a17d-42c2-9227-619efc8ade8f None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:42.897333 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715b9db-a17d-42c2-9227-619efc8ade8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:42.914831 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7aa89-a265-46b9-9eb0-7f53f04cfaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:42.915386 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7aa89-a265-46b9-9eb0-7f53f04cfaff None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:42.915693 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7aa89-a265-46b9-9eb0-7f53f04cfaff None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:42.915966 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7aa89-a265-46b9-9eb0-7f53f04cfaff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:42.931647 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe7aa89-a265-46b9-9eb0-7f53f04cfaff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:42.936109 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-cfe7aa89-a265-46b9-9eb0-7f53f04cfaff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 12:06:42.936109 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:42.936109 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:42.936109 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:42.936109 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:42.936109 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:42.936109 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:42.936109 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:42.936109 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:42.936109 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:42.936109 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:42.936109 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:42.936109 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:42.936109 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:42.936109 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:42.936109 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:42.937028 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:42.937028 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:42.937028 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:42.937028 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:42.937028 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:42.937028 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:42.937028 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:42.937028 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:42.937028 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:42.937028 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:42.937028 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:42.937028 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:42.937028 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:42.937028 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:42.937028 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:42.937028 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:42.937841 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:42.937841 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:42.937841 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:42.937841 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:42.937841 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:42.937841 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:42.937841 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:42.937841 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:42.937841 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:42.937841 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:42.937841 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 21 12:06:42.937841 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:06:42.937841 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 173/353] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:06:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:06:42.940077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ed3cf-276b-4680-a5dc-76e82a1fc51e None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:42.940077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ed3cf-276b-4680-a5dc-76e82a1fc51e None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:42.940258 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ed3cf-276b-4680-a5dc-76e82a1fc51e None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:42.941582 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 174/354] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:42.942121 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ed3cf-276b-4680-a5dc-76e82a1fc51e None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:42.992397 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3715b9db-a17d-42c2-9227-619efc8ade8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:42.993878 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3715b9db-a17d-42c2-9227-619efc8ade8f None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:43.002391 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:43.073005 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ed3cf-276b-4680-a5dc-76e82a1fc51e None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:43.114437 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af3843-a837-4352-bcec-f15f1caa846a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:43.114437 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af3843-a837-4352-bcec-f15f1caa846a None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:43.114437 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af3843-a837-4352-bcec-f15f1caa846a None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:43.114779 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af3843-a837-4352-bcec-f15f1caa846a None admin] PATH_INFO: `/v3/projects/39342ea2ea9b45c8817058e7bed7c739` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:43.115828 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af3843-a837-4352-bcec-f15f1caa846a None admin] RBAC: Authorizing `identity:get_project(project_id=39342ea2ea9b45c8817058e7bed7c739)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:43.117034 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 181/355] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:06:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 12:06:43.117271 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af3843-a837-4352-bcec-f15f1caa846a None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:43.119185 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 175/356] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:06:42 2022] GET /identity/v3/projects/39342ea2ea9b45c8817058e7bed7c739 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:43.120356 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841d936-e87b-4cc2-907d-9b9f1e429ad8 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:43.120636 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841d936-e87b-4cc2-907d-9b9f1e429ad8 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:43.120901 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841d936-e87b-4cc2-907d-9b9f1e429ad8 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:43.122260 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 176/357] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:43.123249 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715b9db-a17d-42c2-9227-619efc8ade8f None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:43.128207 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841d936-e87b-4cc2-907d-9b9f1e429ad8 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:43.154225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:43.239482 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715b9db-a17d-42c2-9227-619efc8ade8f None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:43.248664 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841d936-e87b-4cc2-907d-9b9f1e429ad8 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:43.250045 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:43.283887 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15db56e-f6ed-43e7-9486-49e3bfdcabe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:43.284495 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15db56e-f6ed-43e7-9486-49e3bfdcabe0 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:43.284766 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15db56e-f6ed-43e7-9486-49e3bfdcabe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:43.285033 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15db56e-f6ed-43e7-9486-49e3bfdcabe0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:43.285751 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15db56e-f6ed-43e7-9486-49e3bfdcabe0 None admin] RBAC: Adding query filter params (group.id=7ffeaf61ec3c42f0b0ff694a3392e12d, role.id=9712f7b332bf484689b3706721ab6311, scope.project.id=39342ea2ea9b45c8817058e7bed7c739) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:43.286064 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15db56e-f6ed-43e7-9486-49e3bfdcabe0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:43.287492 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15db56e-f6ed-43e7-9486-49e3bfdcabe0 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:43.289598 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7c79b-228e-4eb7-84e8-ad05c5888004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:43.290205 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7c79b-228e-4eb7-84e8-ad05c5888004 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:43.291266 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7c79b-228e-4eb7-84e8-ad05c5888004 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:43.291266 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7c79b-228e-4eb7-84e8-ad05c5888004 None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:43.291492 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb7c79b-228e-4eb7-84e8-ad05c5888004 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:43.291800 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb7c79b-228e-4eb7-84e8-ad05c5888004 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:43.293160 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb7c79b-228e-4eb7-84e8-ad05c5888004 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:43.294474 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 182/358] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Sep 21 12:06:43 2022] GET /identity/v3/role_assignments?group.id=7ffeaf61ec3c42f0b0ff694a3392e12d&scope.project.id=39342ea2ea9b45c8817058e7bed7c739&role.id=9712f7b332bf484689b3706721ab6311 => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:43.295669 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5943344-8f4e-4d05-b088-cd81e9a3fa07 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:43.295951 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5943344-8f4e-4d05-b088-cd81e9a3fa07 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:43.296217 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5943344-8f4e-4d05-b088-cd81e9a3fa07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:43.303469 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 177/359] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Sep 21 12:06:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:43.304798 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7c79b-228e-4eb7-84e8-ad05c5888004 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:43.320793 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-a5943344-8f4e-4d05-b088-cd81e9a3fa07 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:43.323683 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a5943344-8f4e-4d05-b088-cd81e9a3fa07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:43.417786 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 183/360] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:06:43.419416 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5943344-8f4e-4d05-b088-cd81e9a3fa07 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:43.433895 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:43.455946 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7c79b-228e-4eb7-84e8-ad05c5888004 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:43.507496 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02de09e-62b4-4838-837d-8d6687c9958f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:43.508067 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02de09e-62b4-4838-837d-8d6687c9958f None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:43.508346 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02de09e-62b4-4838-837d-8d6687c9958f None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:43.508650 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02de09e-62b4-4838-837d-8d6687c9958f None admin] PATH_INFO: `/v3/projects/1367e35623684adc931fd16f99a77b44` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:43.510697 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02de09e-62b4-4838-837d-8d6687c9958f None admin] RBAC: Authorizing `identity:get_project(project_id=1367e35623684adc931fd16f99a77b44)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:43.512734 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02de09e-62b4-4838-837d-8d6687c9958f None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:43.520404 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 178/361] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:06:43 2022] GET /identity/v3/projects/1367e35623684adc931fd16f99a77b44 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:43.521765 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f728524-a150-49e1-9d27-02ac24cf71f5 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:43.522048 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f728524-a150-49e1-9d27-02ac24cf71f5 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:43.522316 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f728524-a150-49e1-9d27-02ac24cf71f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:43.544734 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-1f728524-a150-49e1-9d27-02ac24cf71f5 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:43.546468 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-1f728524-a150-49e1-9d27-02ac24cf71f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:43.555326 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:43.559869 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5943344-8f4e-4d05-b088-cd81e9a3fa07 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:43.596897 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510d473-7e8d-4baf-b485-868756da7d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:43.597541 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510d473-7e8d-4baf-b485-868756da7d02 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:43.597820 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510d473-7e8d-4baf-b485-868756da7d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:43.598093 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510d473-7e8d-4baf-b485-868756da7d02 None admin] PATH_INFO: `/v3/groups/7ffeaf61ec3c42f0b0ff694a3392e12d` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:43.600430 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7510d473-7e8d-4baf-b485-868756da7d02 None admin] RBAC: Authorizing `identity:get_group(group_id=7ffeaf61ec3c42f0b0ff694a3392e12d)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:43.601919 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7510d473-7e8d-4baf-b485-868756da7d02 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:43.607375 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 184/362] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Sep 21 12:06:43 2022] GET /identity/v3/groups/7ffeaf61ec3c42f0b0ff694a3392e12d => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:43.608306 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510d473-7e8d-4baf-b485-868756da7d02 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:43.658760 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 179/363] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:06:43.659621 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f728524-a150-49e1-9d27-02ac24cf71f5 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:43.729130 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510d473-7e8d-4baf-b485-868756da7d02 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:43.753889 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:43.775900 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0852b6-e6d4-47e4-9f8b-72b71ce276d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:43.776455 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0852b6-e6d4-47e4-9f8b-72b71ce276d3 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:43.776734 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0852b6-e6d4-47e4-9f8b-72b71ce276d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:43.777005 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0852b6-e6d4-47e4-9f8b-72b71ce276d3 None admin] PATH_INFO: `/v3/users/e553a7a13ea04b98ad80eb358900a633` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:43.777504 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f728524-a150-49e1-9d27-02ac24cf71f5 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:43.778164 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0852b6-e6d4-47e4-9f8b-72b71ce276d3 None admin] RBAC: Authorizing `identity:get_user(user_id=e553a7a13ea04b98ad80eb358900a633)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:43.779654 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0852b6-e6d4-47e4-9f8b-72b71ce276d3 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:43.781439 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 185/364] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:06:43 2022] GET /identity/v3/users/e553a7a13ea04b98ad80eb358900a633 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:43.782305 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0852b6-e6d4-47e4-9f8b-72b71ce276d3 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:43.819101 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aafdbeb-03f6-481d-a0c8-a8d08a5aef65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:43.820295 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aafdbeb-03f6-481d-a0c8-a8d08a5aef65 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:43.820597 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aafdbeb-03f6-481d-a0c8-a8d08a5aef65 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:43.820882 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aafdbeb-03f6-481d-a0c8-a8d08a5aef65 None admin] PATH_INFO: `/v3/groups/7ffeaf61ec3c42f0b0ff694a3392e12d` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:43.822489 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aafdbeb-03f6-481d-a0c8-a8d08a5aef65 None admin] RBAC: Authorizing `identity:get_group(group_id=7ffeaf61ec3c42f0b0ff694a3392e12d)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:43.824309 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aafdbeb-03f6-481d-a0c8-a8d08a5aef65 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:43.826742 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 180/365] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Sep 21 12:06:43 2022] GET /identity/v3/groups/7ffeaf61ec3c42f0b0ff694a3392e12d => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:43.827536 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aafdbeb-03f6-481d-a0c8-a8d08a5aef65 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:43.845038 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:43.949276 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0852b6-e6d4-47e4-9f8b-72b71ce276d3 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:43.975278 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aafdbeb-03f6-481d-a0c8-a8d08a5aef65 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:43.996065 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2602c-ba82-41f7-b6fd-487bca370914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:43.996683 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2602c-ba82-41f7-b6fd-487bca370914 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:43.996960 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2602c-ba82-41f7-b6fd-487bca370914 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:43.997230 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2602c-ba82-41f7-b6fd-487bca370914 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:43.998033 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2602c-ba82-41f7-b6fd-487bca370914 None admin] RBAC: Adding query filter params (group.id=7ffeaf61ec3c42f0b0ff694a3392e12d, role.id=173d0e93641b4882934b75f256b38534, scope.project.id=39342ea2ea9b45c8817058e7bed7c739) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:43.998337 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2602c-ba82-41f7-b6fd-487bca370914 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:43.999817 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2602c-ba82-41f7-b6fd-487bca370914 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:44.007260 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 186/366] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Sep 21 12:06:43 2022] GET /identity/v3/role_assignments?group.id=7ffeaf61ec3c42f0b0ff694a3392e12d&scope.project.id=39342ea2ea9b45c8817058e7bed7c739&role.id=173d0e93641b4882934b75f256b38534 => generated 260 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:44.008225 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2602c-ba82-41f7-b6fd-487bca370914 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:44.026214 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67091c-f777-4ee5-883b-a8f3e34a987c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:44.026807 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67091c-f777-4ee5-883b-a8f3e34a987c None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:44.027088 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67091c-f777-4ee5-883b-a8f3e34a987c None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:44.027354 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67091c-f777-4ee5-883b-a8f3e34a987c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:44.028104 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db67091c-f777-4ee5-883b-a8f3e34a987c None admin] RBAC: Adding query filter params (role.id=65ae44a45ff2443eb03c2802be0453c9, user.id=e553a7a13ea04b98ad80eb358900a633, scope.system=all) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:44.028405 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db67091c-f777-4ee5-883b-a8f3e34a987c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:44.030132 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db67091c-f777-4ee5-883b-a8f3e34a987c None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:44.044929 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 181/367] 10.222.0.60 () {56 vars in 1308 bytes} [Wed Sep 21 12:06:43 2022] GET /identity/v3/role_assignments?user.id=e553a7a13ea04b98ad80eb358900a633&scope.system=all&role.id=65ae44a45ff2443eb03c2802be0453c9 => generated 510 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:44.045905 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67091c-f777-4ee5-883b-a8f3e34a987c None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:44.065328 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:44.195831 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:44.204943 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2602c-ba82-41f7-b6fd-487bca370914 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:44.255883 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ae6c7-25bd-4509-8019-bea70970650b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:44.256520 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ae6c7-25bd-4509-8019-bea70970650b None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:44.256789 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ae6c7-25bd-4509-8019-bea70970650b None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:44.257325 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ae6c7-25bd-4509-8019-bea70970650b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:44.261892 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67091c-f777-4ee5-883b-a8f3e34a987c None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:44.271095 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ae6c7-25bd-4509-8019-bea70970650b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:44.277654 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-ab9ae6c7-25bd-4509-8019-bea70970650b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 12:06:44.277654 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:44.277654 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:44.277654 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:44.277654 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:44.277654 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:44.277654 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:44.277654 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:44.277654 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:44.277654 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:44.277654 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:44.277654 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:44.277654 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:44.277654 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:44.277654 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:44.277654 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:44.279820 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:44.279820 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:44.279820 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:44.279820 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:44.279820 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:44.279820 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:44.279820 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:44.279820 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:44.279820 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:44.279820 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:44.279820 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:44.279820 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:44.279820 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:44.279820 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:44.279820 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:44.279820 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:44.281736 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:44.281736 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:44.281736 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:44.281736 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:44.281736 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:44.281736 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:44.281736 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:44.281736 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:44.281736 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:44.281736 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:44.281736 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 12:06:44.281736 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:06:44.281736 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 187/368] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Sep 21 12:06:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:06:44.281736 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ae6c7-25bd-4509-8019-bea70970650b None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:44.318625 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024398d-b6c3-4b2b-981e-4553dab39a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:44.318625 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024398d-b6c3-4b2b-981e-4553dab39a1c None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:44.318625 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024398d-b6c3-4b2b-981e-4553dab39a1c None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:44.318625 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024398d-b6c3-4b2b-981e-4553dab39a1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:44.319393 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024398d-b6c3-4b2b-981e-4553dab39a1c None admin] RBAC: Adding query filter params (group.id=7ffeaf61ec3c42f0b0ff694a3392e12d, role.id=9712f7b332bf484689b3706721ab6311, scope.project.id=1367e35623684adc931fd16f99a77b44) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:44.319393 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024398d-b6c3-4b2b-981e-4553dab39a1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:44.320076 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024398d-b6c3-4b2b-981e-4553dab39a1c None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:44.327162 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 182/369] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Sep 21 12:06:44 2022] GET /identity/v3/role_assignments?group.id=7ffeaf61ec3c42f0b0ff694a3392e12d&scope.project.id=1367e35623684adc931fd16f99a77b44&role.id=9712f7b332bf484689b3706721ab6311 => generated 260 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:44.328270 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024398d-b6c3-4b2b-981e-4553dab39a1c None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:44.409262 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ae6c7-25bd-4509-8019-bea70970650b None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:44.450194 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c58ec5-0408-45a8-b91c-df5765a1e46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:44.450977 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c58ec5-0408-45a8-b91c-df5765a1e46f None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:44.451211 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c58ec5-0408-45a8-b91c-df5765a1e46f None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:44.451482 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c58ec5-0408-45a8-b91c-df5765a1e46f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:44.464804 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c58ec5-0408-45a8-b91c-df5765a1e46f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:44.470862 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-13c58ec5-0408-45a8-b91c-df5765a1e46f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:06:44.470862 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:44.470862 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:44.470862 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:44.470862 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:44.470862 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:44.470862 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:44.470862 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:44.470862 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:44.470862 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:44.470862 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:44.470862 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:44.470862 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:44.470862 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:44.470862 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:44.470862 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:44.471782 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:44.471782 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:44.471782 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:44.471782 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:44.471782 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:44.471782 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:44.471782 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:44.471782 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:44.471782 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:44.471782 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:44.471782 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:44.471782 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:44.471782 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:44.471782 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:44.471782 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:44.471782 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:44.472573 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:44.472573 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:44.472573 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:44.472573 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:44.472573 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:44.472573 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:44.472573 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:44.472573 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:44.472573 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:44.472573 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:44.472573 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:06:44.472573 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:06:44.472573 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 188/370] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Sep 21 12:06:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:06:44.480762 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c58ec5-0408-45a8-b91c-df5765a1e46f None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:44.482067 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:44.510658 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:44.544588 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024398d-b6c3-4b2b-981e-4553dab39a1c None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:44.605530 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c58ec5-0408-45a8-b91c-df5765a1e46f None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:44.624715 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24ce9e-c874-4941-9929-d590142158c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:44.625864 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24ce9e-c874-4941-9929-d590142158c8 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:44.626348 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24ce9e-c874-4941-9929-d590142158c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:44.626866 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24ce9e-c874-4941-9929-d590142158c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:44.627719 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae24ce9e-c874-4941-9929-d590142158c8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:44.628262 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae24ce9e-c874-4941-9929-d590142158c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:44.629849 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae24ce9e-c874-4941-9929-d590142158c8 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:44.644161 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9d060-0648-44ed-994a-718ffc794f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:44.644768 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9d060-0648-44ed-994a-718ffc794f45 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:44.645041 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9d060-0648-44ed-994a-718ffc794f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:44.645307 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9d060-0648-44ed-994a-718ffc794f45 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:44.645976 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c9d060-0648-44ed-994a-718ffc794f45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:44.646269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c9d060-0648-44ed-994a-718ffc794f45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:44.647860 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c9d060-0648-44ed-994a-718ffc794f45 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:44.651159 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 183/371] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:06:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:44.657213 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24ce9e-c874-4941-9929-d590142158c8 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:44.658446 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 189/372] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:06:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:44.664824 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9d060-0648-44ed-994a-718ffc794f45 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:44.782723 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:44.828453 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9d060-0648-44ed-994a-718ffc794f45 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:44.848457 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24ce9e-c874-4941-9929-d590142158c8 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:44.894956 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b09aa-68e1-4b25-aee6-e035cea31dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:44.895581 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b09aa-68e1-4b25-aee6-e035cea31dfc None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:44.895863 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b09aa-68e1-4b25-aee6-e035cea31dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:44.896135 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b09aa-68e1-4b25-aee6-e035cea31dfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:44.909380 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:44.920598 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66891dc9-9fc6-465c-913d-46fdb4bfa2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:44.921227 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66891dc9-9fc6-465c-913d-46fdb4bfa2ec None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:44.921514 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66891dc9-9fc6-465c-913d-46fdb4bfa2ec None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:44.921792 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66891dc9-9fc6-465c-913d-46fdb4bfa2ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:45.010026 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66891dc9-9fc6-465c-913d-46fdb4bfa2ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:45.011737 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66891dc9-9fc6-465c-913d-46fdb4bfa2ec None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:45.031922 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04b09aa-68e1-4b25-aee6-e035cea31dfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:45.033402 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04b09aa-68e1-4b25-aee6-e035cea31dfc None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:45.139095 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:45.149210 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 190/373] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:06:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 21 12:06:45.155918 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b09aa-68e1-4b25-aee6-e035cea31dfc None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:45.176124 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 184/374] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:06:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 21 12:06:45.181767 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66891dc9-9fc6-465c-913d-46fdb4bfa2ec None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:45.238809 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:45.267548 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b09aa-68e1-4b25-aee6-e035cea31dfc None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:45.308415 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b131e73-1347-4bb4-a5cd-ee58069b499b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:45.309069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b131e73-1347-4bb4-a5cd-ee58069b499b None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:45.309351 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b131e73-1347-4bb4-a5cd-ee58069b499b None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:45.309628 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b131e73-1347-4bb4-a5cd-ee58069b499b None admin] PATH_INFO: `/v3/projects/1600cabcba2e4465b53f5a73f9b91b11` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:45.311638 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b131e73-1347-4bb4-a5cd-ee58069b499b None admin] RBAC: Authorizing `identity:get_project(project_id=1600cabcba2e4465b53f5a73f9b91b11)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:45.313090 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b131e73-1347-4bb4-a5cd-ee58069b499b None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:45.315090 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 191/375] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:06:45 2022] GET /identity/v3/projects/1600cabcba2e4465b53f5a73f9b91b11 => generated 344 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:06:45.321505 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b131e73-1347-4bb4-a5cd-ee58069b499b None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:45.354922 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66891dc9-9fc6-465c-913d-46fdb4bfa2ec None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:45.430390 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:45.438970 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79eacd-a614-442c-9773-aad15bb20aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:45.439617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79eacd-a614-442c-9773-aad15bb20aee None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:45.439897 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79eacd-a614-442c-9773-aad15bb20aee None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:45.440174 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79eacd-a614-442c-9773-aad15bb20aee None admin] PATH_INFO: `/v3/projects/1367e35623684adc931fd16f99a77b44` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:45.442479 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df79eacd-a614-442c-9773-aad15bb20aee None admin] RBAC: Authorizing `identity:get_project(project_id=1367e35623684adc931fd16f99a77b44)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:45.443933 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df79eacd-a614-442c-9773-aad15bb20aee None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:45.447229 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 185/376] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:06:45 2022] GET /identity/v3/projects/1367e35623684adc931fd16f99a77b44 => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:45.452286 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79eacd-a614-442c-9773-aad15bb20aee None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:45.527908 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b131e73-1347-4bb4-a5cd-ee58069b499b None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:45.601242 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a19138-2f8b-42ca-84c6-51c1d7c7333c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:45.604359 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a19138-2f8b-42ca-84c6-51c1d7c7333c None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:45.604828 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a19138-2f8b-42ca-84c6-51c1d7c7333c None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:45.605248 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a19138-2f8b-42ca-84c6-51c1d7c7333c None admin] PATH_INFO: `/v3/groups/2e3285d6cbf7432c9d5d484ae17f54e4` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:45.618526 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a19138-2f8b-42ca-84c6-51c1d7c7333c None admin] RBAC: Authorizing `identity:get_group(group_id=2e3285d6cbf7432c9d5d484ae17f54e4)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:45.620222 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a19138-2f8b-42ca-84c6-51c1d7c7333c None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:45.622233 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 192/377] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Sep 21 12:06:45 2022] GET /identity/v3/groups/2e3285d6cbf7432c9d5d484ae17f54e4 => generated 229 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:45.629424 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a19138-2f8b-42ca-84c6-51c1d7c7333c None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:45.631412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:45.638608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79eacd-a614-442c-9773-aad15bb20aee None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:45.687462 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800005e2-c066-44de-bab3-2d585195a574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:45.688406 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800005e2-c066-44de-bab3-2d585195a574 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:45.688852 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800005e2-c066-44de-bab3-2d585195a574 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:45.689278 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800005e2-c066-44de-bab3-2d585195a574 None admin] PATH_INFO: `/v3/groups/7ffeaf61ec3c42f0b0ff694a3392e12d` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:45.690601 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800005e2-c066-44de-bab3-2d585195a574 None admin] RBAC: Authorizing `identity:get_group(group_id=7ffeaf61ec3c42f0b0ff694a3392e12d)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:45.692584 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800005e2-c066-44de-bab3-2d585195a574 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:45.694535 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 186/378] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Sep 21 12:06:45 2022] GET /identity/v3/groups/7ffeaf61ec3c42f0b0ff694a3392e12d => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:45.702661 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800005e2-c066-44de-bab3-2d585195a574 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:45.868518 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800005e2-c066-44de-bab3-2d585195a574 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:45.904306 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a19138-2f8b-42ca-84c6-51c1d7c7333c None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:45.909667 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d897c7b-9cb9-4497-a876-6b539eef97de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:45.910720 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d897c7b-9cb9-4497-a876-6b539eef97de None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:45.911175 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d897c7b-9cb9-4497-a876-6b539eef97de None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:45.911595 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d897c7b-9cb9-4497-a876-6b539eef97de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:45.912470 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d897c7b-9cb9-4497-a876-6b539eef97de None admin] RBAC: Adding query filter params (group.id=7ffeaf61ec3c42f0b0ff694a3392e12d, role.id=173d0e93641b4882934b75f256b38534, scope.project.id=1367e35623684adc931fd16f99a77b44) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:45.912939 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d897c7b-9cb9-4497-a876-6b539eef97de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:45.916505 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d897c7b-9cb9-4497-a876-6b539eef97de None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:45.923274 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 187/379] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Sep 21 12:06:45 2022] GET /identity/v3/role_assignments?group.id=7ffeaf61ec3c42f0b0ff694a3392e12d&scope.project.id=1367e35623684adc931fd16f99a77b44&role.id=173d0e93641b4882934b75f256b38534 => generated 260 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:45.936631 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:45.961130 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92475a1e-86ee-46d7-99b9-afa0f643355b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:45.961764 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92475a1e-86ee-46d7-99b9-afa0f643355b None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:45.962099 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92475a1e-86ee-46d7-99b9-afa0f643355b None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:45.962500 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92475a1e-86ee-46d7-99b9-afa0f643355b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:45.963243 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92475a1e-86ee-46d7-99b9-afa0f643355b None admin] RBAC: Adding query filter params (group.id=2e3285d6cbf7432c9d5d484ae17f54e4, role.id=72c80b472acb462ebadd86463efe91f7, scope.project.id=1600cabcba2e4465b53f5a73f9b91b11) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:45.963548 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92475a1e-86ee-46d7-99b9-afa0f643355b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:45.965072 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92475a1e-86ee-46d7-99b9-afa0f643355b None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:45.974105 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 193/380] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Sep 21 12:06:45 2022] GET /identity/v3/role_assignments?group.id=2e3285d6cbf7432c9d5d484ae17f54e4&scope.project.id=1600cabcba2e4465b53f5a73f9b91b11&role.id=72c80b472acb462ebadd86463efe91f7 => generated 260 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:46.355139 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bbc10-6218-4a72-af4b-c2fb19aa1e34 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:46.355822 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bbc10-6218-4a72-af4b-c2fb19aa1e34 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:46.356305 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bbc10-6218-4a72-af4b-c2fb19aa1e34 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:46.358114 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 188/381] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:46.363359 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a98341-dcbc-4ccc-8eb7-bd35822bfbc1 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:46.363646 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a98341-dcbc-4ccc-8eb7-bd35822bfbc1 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:46.363919 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a98341-dcbc-4ccc-8eb7-bd35822bfbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:46.389201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-97a98341-dcbc-4ccc-8eb7-bd35822bfbc1 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:46.390440 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-97a98341-dcbc-4ccc-8eb7-bd35822bfbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:46.471993 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 194/382] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:06:46.698932 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c2c3e-e811-48c7-bc53-1e837ceadc00 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:46.699756 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c2c3e-e811-48c7-bc53-1e837ceadc00 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:46.700034 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c2c3e-e811-48c7-bc53-1e837ceadc00 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:46.701505 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 189/383] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:46.706980 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525bea3-a8f4-4ec0-b72b-456fbdccdaeb None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:46.707835 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525bea3-a8f4-4ec0-b72b-456fbdccdaeb None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:46.708302 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525bea3-a8f4-4ec0-b72b-456fbdccdaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:46.729027 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-8525bea3-a8f4-4ec0-b72b-456fbdccdaeb None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:46.730815 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-8525bea3-a8f4-4ec0-b72b-456fbdccdaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:46.832442 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 195/384] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 12:06:46.834710 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c2c3e-e811-48c7-bc53-1e837ceadc00 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:46.873681 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:46.958901 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c2c3e-e811-48c7-bc53-1e837ceadc00 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:46.996721 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4aa0c-b55e-4c90-887f-b8598698e637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:46.997750 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4aa0c-b55e-4c90-887f-b8598698e637 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:46.998253 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4aa0c-b55e-4c90-887f-b8598698e637 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:46.998764 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4aa0c-b55e-4c90-887f-b8598698e637 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:47.011063 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4aa0c-b55e-4c90-887f-b8598698e637 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:47.017123 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-1aa4aa0c-b55e-4c90-887f-b8598698e637 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 12:06:47.017123 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:47.017123 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:47.017123 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:47.017123 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:47.017123 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:47.017123 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:47.017123 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:47.017123 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:47.017123 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:47.017123 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:47.017123 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:47.017123 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:47.017123 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:47.017123 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:47.017123 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:47.018035 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:47.018035 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:47.018035 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:47.018035 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:47.018035 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:47.018035 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:47.018035 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:47.018035 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:47.018035 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:47.018035 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:47.018035 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:47.018035 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:47.018035 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:47.018035 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:47.018035 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:47.018035 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:47.018849 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:47.018849 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:47.018849 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:47.018849 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:47.018849 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:47.018849 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:47.018849 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:47.018849 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:47.018849 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:47.018849 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:47.018849 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 12:06:47.018849 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:06:47.021443 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 190/385] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:06:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:06:47.028127 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525bea3-a8f4-4ec0-b72b-456fbdccdaeb None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:47.076483 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:47.142095 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4aa0c-b55e-4c90-887f-b8598698e637 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:47.166429 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525bea3-a8f4-4ec0-b72b-456fbdccdaeb None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:47.213433 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627bdff-f83d-4d32-b577-00ddfda9a158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:47.214759 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627bdff-f83d-4d32-b577-00ddfda9a158 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:47.215041 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627bdff-f83d-4d32-b577-00ddfda9a158 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:47.215315 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627bdff-f83d-4d32-b577-00ddfda9a158 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:47.215989 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627bdff-f83d-4d32-b577-00ddfda9a158 None admin] RBAC: Adding query filter params (name=member) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:47.216290 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627bdff-f83d-4d32-b577-00ddfda9a158 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:47.217908 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627bdff-f83d-4d32-b577-00ddfda9a158 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:47.248892 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 196/386] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Sep 21 12:06:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:47.256598 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627bdff-f83d-4d32-b577-00ddfda9a158 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:47.338578 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:47.354637 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4aa0c-b55e-4c90-887f-b8598698e637 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:47.409947 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b952475-8abe-440e-b0cf-e72ff996d095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:47.411249 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b952475-8abe-440e-b0cf-e72ff996d095 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:47.411530 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b952475-8abe-440e-b0cf-e72ff996d095 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:47.412093 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b952475-8abe-440e-b0cf-e72ff996d095 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:47.422033 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:47.425522 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627bdff-f83d-4d32-b577-00ddfda9a158 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:47.430070 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b952475-8abe-440e-b0cf-e72ff996d095 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:47.436613 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-4b952475-8abe-440e-b0cf-e72ff996d095 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 12:06:47.436613 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:47.436613 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:47.436613 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:47.436613 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:47.436613 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:47.436613 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:47.436613 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:47.436613 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:47.436613 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:47.436613 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:47.436613 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:47.436613 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:47.436613 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:47.436613 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:47.436613 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:47.437717 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:47.437717 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:47.437717 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:47.437717 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:47.437717 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:47.437717 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:47.437717 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:47.437717 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:47.437717 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:47.437717 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:47.437717 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:47.437717 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:47.437717 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:47.437717 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:47.437717 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:47.437717 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:47.438722 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:47.438722 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:47.438722 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:47.438722 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:47.438722 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:47.438722 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:47.438722 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:47.438722 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:47.438722 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:47.438722 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:47.438722 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 12:06:47.438722 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:06:47.438722 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 191/387] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Sep 21 12:06:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 12:06:47.439383 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbafcd-525a-49ed-96c6-bf3e62c80dac None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:47.439383 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbafcd-525a-49ed-96c6-bf3e62c80dac None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:47.439626 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbafcd-525a-49ed-96c6-bf3e62c80dac None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:47.441047 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 192/388] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:47.446010 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbafcd-525a-49ed-96c6-bf3e62c80dac None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:47.479174 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e6c945-34d9-493d-96b9-35898adcdbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:47.479755 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e6c945-34d9-493d-96b9-35898adcdbfa None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:47.480035 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e6c945-34d9-493d-96b9-35898adcdbfa None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:47.480308 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e6c945-34d9-493d-96b9-35898adcdbfa None admin] PATH_INFO: `/v3/groups/7ffeaf61ec3c42f0b0ff694a3392e12d` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:47.481549 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e6c945-34d9-493d-96b9-35898adcdbfa None admin] RBAC: Authorizing `identity:get_group(group_id=7ffeaf61ec3c42f0b0ff694a3392e12d)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:47.483313 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e6c945-34d9-493d-96b9-35898adcdbfa None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:47.484887 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 197/389] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Sep 21 12:06:47 2022] GET /identity/v3/groups/7ffeaf61ec3c42f0b0ff694a3392e12d => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:06:47.486334 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a78014-f1de-42e6-afc5-4a942d38d0b2 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:47.486747 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a78014-f1de-42e6-afc5-4a942d38d0b2 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:47.487027 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a78014-f1de-42e6-afc5-4a942d38d0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:47.507381 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-47a78014-f1de-42e6-afc5-4a942d38d0b2 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:47.508610 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-47a78014-f1de-42e6-afc5-4a942d38d0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:47.578015 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbafcd-525a-49ed-96c6-bf3e62c80dac None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:47.590573 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 198/390] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:06:47.591516 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a78014-f1de-42e6-afc5-4a942d38d0b2 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:47.614337 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f3d94-ea23-4a86-91ac-9dce73eea306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:47.615241 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f3d94-ea23-4a86-91ac-9dce73eea306 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:47.615665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f3d94-ea23-4a86-91ac-9dce73eea306 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:47.616071 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f3d94-ea23-4a86-91ac-9dce73eea306 None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:47.616887 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f3d94-ea23-4a86-91ac-9dce73eea306 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:47.617350 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f3d94-ea23-4a86-91ac-9dce73eea306 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:47.619540 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f3d94-ea23-4a86-91ac-9dce73eea306 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:47.630199 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 193/391] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:06:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:06:47.638885 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f3d94-ea23-4a86-91ac-9dce73eea306 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:47.688601 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:47.725465 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a78014-f1de-42e6-afc5-4a942d38d0b2 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:47.728100 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:47.796561 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec13e0-4a97-4dcf-b329-2110ecc5f575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:47.797532 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec13e0-4a97-4dcf-b329-2110ecc5f575 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:47.797955 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec13e0-4a97-4dcf-b329-2110ecc5f575 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:47.798394 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec13e0-4a97-4dcf-b329-2110ecc5f575 None admin] PATH_INFO: `/v3/projects/39342ea2ea9b45c8817058e7bed7c739` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:47.803080 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec13e0-4a97-4dcf-b329-2110ecc5f575 None admin] RBAC: Authorizing `identity:get_project(project_id=39342ea2ea9b45c8817058e7bed7c739)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:47.804747 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec13e0-4a97-4dcf-b329-2110ecc5f575 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:47.807138 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 199/392] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:06:47 2022] GET /identity/v3/projects/39342ea2ea9b45c8817058e7bed7c739 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:47.815294 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec13e0-4a97-4dcf-b329-2110ecc5f575 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:47.834403 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f3d94-ea23-4a86-91ac-9dce73eea306 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:47.870858 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555f94d-3ac9-4d44-997d-ae5a513745da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:47.871579 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555f94d-3ac9-4d44-997d-ae5a513745da None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:47.871925 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555f94d-3ac9-4d44-997d-ae5a513745da None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:47.872262 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555f94d-3ac9-4d44-997d-ae5a513745da None admin] PATH_INFO: `/v3/groups/7ffeaf61ec3c42f0b0ff694a3392e12d` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:47.873431 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555f94d-3ac9-4d44-997d-ae5a513745da None admin] RBAC: Authorizing `identity:get_group(group_id=7ffeaf61ec3c42f0b0ff694a3392e12d)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:47.878389 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555f94d-3ac9-4d44-997d-ae5a513745da None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:47.878389 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 194/393] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Sep 21 12:06:47 2022] GET /identity/v3/groups/7ffeaf61ec3c42f0b0ff694a3392e12d => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:47.883814 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555f94d-3ac9-4d44-997d-ae5a513745da None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:47.983026 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec13e0-4a97-4dcf-b329-2110ecc5f575 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:47.986377 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:48.010014 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555f94d-3ac9-4d44-997d-ae5a513745da None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:48.023048 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291461f2-db10-4c1b-a48a-a7d340245c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:48.024115 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291461f2-db10-4c1b-a48a-a7d340245c82 None admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:48.025194 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291461f2-db10-4c1b-a48a-a7d340245c82 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:48.025644 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291461f2-db10-4c1b-a48a-a7d340245c82 None admin] PATH_INFO: `/v3/projects/39342ea2ea9b45c8817058e7bed7c739/groups/7ffeaf61ec3c42f0b0ff694a3392e12d/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:48.027892 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291461f2-db10-4c1b-a48a-a7d340245c82 None admin] RBAC: Authorizing `identity:create_grant(project_id=39342ea2ea9b45c8817058e7bed7c739, group_id=7ffeaf61ec3c42f0b0ff694a3392e12d, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:48.029693 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291461f2-db10-4c1b-a48a-a7d340245c82 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:48.045438 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 200/394] 10.222.0.60 () {58 vars in 1442 bytes} [Wed Sep 21 12:06:47 2022] PUT /identity/v3/projects/39342ea2ea9b45c8817058e7bed7c739/groups/7ffeaf61ec3c42f0b0ff694a3392e12d/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:06:48.046798 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291461f2-db10-4c1b-a48a-a7d340245c82 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:48.061460 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827338e-4f01-41ff-84a3-4d210d544c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:48.062109 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827338e-4f01-41ff-84a3-4d210d544c84 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:48.062401 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827338e-4f01-41ff-84a3-4d210d544c84 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:48.062682 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827338e-4f01-41ff-84a3-4d210d544c84 None admin] PATH_INFO: `/v3/projects/39342ea2ea9b45c8817058e7bed7c739` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:48.063930 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7827338e-4f01-41ff-84a3-4d210d544c84 None admin] RBAC: Authorizing `identity:get_project(project_id=39342ea2ea9b45c8817058e7bed7c739)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:48.065664 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7827338e-4f01-41ff-84a3-4d210d544c84 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:48.067308 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 195/395] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:06:47 2022] GET /identity/v3/projects/39342ea2ea9b45c8817058e7bed7c739 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:48.080040 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827338e-4f01-41ff-84a3-4d210d544c84 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:48.085579 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:48.175257 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291461f2-db10-4c1b-a48a-a7d340245c82 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:48.216618 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ebeaf-6c0b-4052-891c-c12f59f78c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:48.217623 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ebeaf-6c0b-4052-891c-c12f59f78c7d None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:48.218098 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ebeaf-6c0b-4052-891c-c12f59f78c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:48.218580 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ebeaf-6c0b-4052-891c-c12f59f78c7d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:48.231955 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ebeaf-6c0b-4052-891c-c12f59f78c7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:48.237540 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-d96ebeaf-6c0b-4052-891c-c12f59f78c7d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 12:06:48.237540 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:48.237540 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:48.237540 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:48.237540 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:48.237540 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:48.237540 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:48.237540 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:48.237540 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:48.237540 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:48.237540 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:48.237540 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:48.237540 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:48.237540 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:48.237540 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:48.237540 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:48.238717 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:48.238717 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:48.238717 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:48.238717 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:48.238717 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:48.238717 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:48.238717 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:48.238717 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:48.238717 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:48.238717 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:48.238717 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:48.238717 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:48.238717 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:48.238717 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:48.238717 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:48.238717 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:48.239509 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:48.239509 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:48.239509 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:48.239509 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:48.239509 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:48.239509 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:48.239509 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:48.239509 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:48.239509 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:48.239509 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:48.239509 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 12:06:48.239509 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:06:48.245475 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 201/396] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:06:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:06:48.248789 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ebeaf-6c0b-4052-891c-c12f59f78c7d None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:48.328003 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827338e-4f01-41ff-84a3-4d210d544c84 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:48.345873 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:48.364609 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ebeaf-6c0b-4052-891c-c12f59f78c7d None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:48.367783 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87362e0-67e5-4fed-aadc-8f73a9adda6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:48.368227 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87362e0-67e5-4fed-aadc-8f73a9adda6c None admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:48.369119 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87362e0-67e5-4fed-aadc-8f73a9adda6c None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:48.369391 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87362e0-67e5-4fed-aadc-8f73a9adda6c None admin] PATH_INFO: `/v3/projects/39342ea2ea9b45c8817058e7bed7c739/groups/7ffeaf61ec3c42f0b0ff694a3392e12d/roles/173d0e93641b4882934b75f256b38534` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:48.372382 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87362e0-67e5-4fed-aadc-8f73a9adda6c None admin] RBAC: Authorizing `identity:create_grant(project_id=39342ea2ea9b45c8817058e7bed7c739, group_id=7ffeaf61ec3c42f0b0ff694a3392e12d, role_id=173d0e93641b4882934b75f256b38534)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:48.373824 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87362e0-67e5-4fed-aadc-8f73a9adda6c None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:48.390115 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 196/397] 10.222.0.60 () {58 vars in 1442 bytes} [Wed Sep 21 12:06:48 2022] PUT /identity/v3/projects/39342ea2ea9b45c8817058e7bed7c739/groups/7ffeaf61ec3c42f0b0ff694a3392e12d/roles/173d0e93641b4882934b75f256b38534 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:06:48.407134 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ca644-8e96-4d1c-a3ff-265498ac9caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:48.408116 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ca644-8e96-4d1c-a3ff-265498ac9caf None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:48.408570 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ca644-8e96-4d1c-a3ff-265498ac9caf None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:48.409015 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ca644-8e96-4d1c-a3ff-265498ac9caf None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:48.409925 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4ca644-8e96-4d1c-a3ff-265498ac9caf None admin] RBAC: Adding query filter params (name=member) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:48.410394 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4ca644-8e96-4d1c-a3ff-265498ac9caf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:48.412243 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4ca644-8e96-4d1c-a3ff-265498ac9caf None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:48.427700 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 202/398] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Sep 21 12:06:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:06:48.429926 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87362e0-67e5-4fed-aadc-8f73a9adda6c None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:48.444228 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:48.584772 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87362e0-67e5-4fed-aadc-8f73a9adda6c None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:48.648652 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b435edf-fdb5-4685-a744-f1b29e6d2801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:48.649590 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b435edf-fdb5-4685-a744-f1b29e6d2801 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:48.650041 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b435edf-fdb5-4685-a744-f1b29e6d2801 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:48.650488 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b435edf-fdb5-4685-a744-f1b29e6d2801 None admin] PATH_INFO: `/v3/groups/7ffeaf61ec3c42f0b0ff694a3392e12d` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:48.652033 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b435edf-fdb5-4685-a744-f1b29e6d2801 None admin] RBAC: Authorizing `identity:get_group(group_id=7ffeaf61ec3c42f0b0ff694a3392e12d)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:48.653756 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b435edf-fdb5-4685-a744-f1b29e6d2801 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:48.655587 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 197/399] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Sep 21 12:06:48 2022] GET /identity/v3/groups/7ffeaf61ec3c42f0b0ff694a3392e12d => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:48.661491 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ca644-8e96-4d1c-a3ff-265498ac9caf None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:48.740604 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba36e80-0f39-4b07-9be3-edccb472ff50 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:48.741066 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba36e80-0f39-4b07-9be3-edccb472ff50 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:48.741512 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba36e80-0f39-4b07-9be3-edccb472ff50 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:48.744890 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 198/400] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:48.751207 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675de421-57e4-4300-93e6-6120f0273462 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:48.751495 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675de421-57e4-4300-93e6-6120f0273462 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:48.751775 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675de421-57e4-4300-93e6-6120f0273462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:48.786622 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ca644-8e96-4d1c-a3ff-265498ac9caf None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:48.788275 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-675de421-57e4-4300-93e6-6120f0273462 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:48.791175 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-675de421-57e4-4300-93e6-6120f0273462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:48.862550 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b40da-53a9-45a1-80e5-145fb1b1452a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:48.863744 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b40da-53a9-45a1-80e5-145fb1b1452a None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:48.864792 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b40da-53a9-45a1-80e5-145fb1b1452a None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:48.865440 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b40da-53a9-45a1-80e5-145fb1b1452a None admin] PATH_INFO: `/v3/projects/1367e35623684adc931fd16f99a77b44` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:48.867898 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b40da-53a9-45a1-80e5-145fb1b1452a None admin] RBAC: Authorizing `identity:get_project(project_id=1367e35623684adc931fd16f99a77b44)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:48.870573 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b40da-53a9-45a1-80e5-145fb1b1452a None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:48.876068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 203/401] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:06:48 2022] GET /identity/v3/projects/1367e35623684adc931fd16f99a77b44 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:48.885450 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b40da-53a9-45a1-80e5-145fb1b1452a None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:48.931641 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:48.961452 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 199/402] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 12:06:48.962924 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c43c27-bf6f-4e24-8afb-eb438d96ab93 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:48.963208 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c43c27-bf6f-4e24-8afb-eb438d96ab93 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:48.963479 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c43c27-bf6f-4e24-8afb-eb438d96ab93 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:48.969108 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 200/403] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:48.970816 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b58fdc-2759-4e40-bceb-c065615bad66 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:48.971187 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b58fdc-2759-4e40-bceb-c065615bad66 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:48.971536 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b58fdc-2759-4e40-bceb-c065615bad66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:48.992119 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-06b58fdc-2759-4e40-bceb-c065615bad66 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:48.994081 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-06b58fdc-2759-4e40-bceb-c065615bad66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:48.996486 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:49.051038 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b40da-53a9-45a1-80e5-145fb1b1452a None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:49.078572 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 201/404] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 12:06:49.107393 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9145a5-398f-40a9-b451-0d662107b0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:49.108346 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9145a5-398f-40a9-b451-0d662107b0d8 None admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:49.108803 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9145a5-398f-40a9-b451-0d662107b0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:49.109277 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9145a5-398f-40a9-b451-0d662107b0d8 None admin] PATH_INFO: `/v3/projects/1367e35623684adc931fd16f99a77b44/groups/7ffeaf61ec3c42f0b0ff694a3392e12d/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:49.113783 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9145a5-398f-40a9-b451-0d662107b0d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=1367e35623684adc931fd16f99a77b44, group_id=7ffeaf61ec3c42f0b0ff694a3392e12d, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:49.115430 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9145a5-398f-40a9-b451-0d662107b0d8 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:49.140595 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 204/405] 10.222.0.60 () {58 vars in 1442 bytes} [Wed Sep 21 12:06:48 2022] PUT /identity/v3/projects/1367e35623684adc931fd16f99a77b44/groups/7ffeaf61ec3c42f0b0ff694a3392e12d/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:06:49.264351 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b58fdc-2759-4e40-bceb-c065615bad66 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:49.399542 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9145a5-398f-40a9-b451-0d662107b0d8 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:49.402932 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b58fdc-2759-4e40-bceb-c065615bad66 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:49.441030 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b473f7-8cfd-4bcf-bf4c-79d12b1e0a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:49.441675 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b473f7-8cfd-4bcf-bf4c-79d12b1e0a0b None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:49.441954 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b473f7-8cfd-4bcf-bf4c-79d12b1e0a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:49.442221 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b473f7-8cfd-4bcf-bf4c-79d12b1e0a0b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:49.450496 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:49.456081 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b473f7-8cfd-4bcf-bf4c-79d12b1e0a0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:49.461344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-41b473f7-8cfd-4bcf-bf4c-79d12b1e0a0b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 12:06:49.461344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:49.461344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:49.461344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:49.461344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:49.461344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:49.461344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:49.461344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:49.461344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:49.461344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:49.461344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:49.461344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:49.461344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:49.461344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:49.461344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:49.461344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:49.462243 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:49.462243 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:49.462243 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:49.462243 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:49.462243 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:49.462243 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:49.462243 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:49.462243 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:49.462243 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:49.462243 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:49.462243 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:49.462243 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:49.462243 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:49.462243 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:49.462243 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:49.462243 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:49.463119 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:49.463119 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:49.463119 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:49.463119 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:49.463119 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:49.463119 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:49.463119 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:49.463119 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:49.463119 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:49.463119 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:49.463119 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 12:06:49.463119 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:06:49.463119 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 202/406] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Sep 21 12:06:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:06:49.471395 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b473f7-8cfd-4bcf-bf4c-79d12b1e0a0b None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:49.524782 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:49.568744 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9145a5-398f-40a9-b451-0d662107b0d8 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:49.628269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d45374-4986-4cb2-aa1a-28e59ffe4287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:49.629253 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d45374-4986-4cb2-aa1a-28e59ffe4287 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:49.629730 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d45374-4986-4cb2-aa1a-28e59ffe4287 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:49.630178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d45374-4986-4cb2-aa1a-28e59ffe4287 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:49.644662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d45374-4986-4cb2-aa1a-28e59ffe4287 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:49.651068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-b2d45374-4986-4cb2-aa1a-28e59ffe4287 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:06:49.651068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:49.651068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:49.651068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:49.651068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:49.651068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:49.651068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:49.651068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:49.651068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:49.651068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:49.651068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:49.651068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:49.651068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:49.651068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:49.651068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:49.651068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:49.652045 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:49.652045 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:49.652045 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:49.652045 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:49.652045 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:49.652045 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:49.652045 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:49.652045 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:49.652045 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:49.652045 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:49.652045 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:49.652045 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:49.652045 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:49.652045 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:49.652045 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:49.652045 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:49.652823 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:49.652823 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:49.652823 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:49.652823 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:49.652823 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:49.652823 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:49.652823 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:49.652823 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:49.652823 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:49.652823 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:49.652823 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:06:49.652823 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:06:49.655232 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 205/407] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Sep 21 12:06:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:06:49.661519 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d45374-4986-4cb2-aa1a-28e59ffe4287 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:49.698137 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b473f7-8cfd-4bcf-bf4c-79d12b1e0a0b None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:49.775391 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1769a-3524-4055-8a02-74f26eec61d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:49.783142 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1769a-3524-4055-8a02-74f26eec61d9 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:49.783428 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1769a-3524-4055-8a02-74f26eec61d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:49.783706 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1769a-3524-4055-8a02-74f26eec61d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:49.784402 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1769a-3524-4055-8a02-74f26eec61d9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:49.784833 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1769a-3524-4055-8a02-74f26eec61d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:49.786402 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1769a-3524-4055-8a02-74f26eec61d9 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:49.803906 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 203/408] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:06:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:49.809202 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d45374-4986-4cb2-aa1a-28e59ffe4287 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:49.809983 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1769a-3524-4055-8a02-74f26eec61d9 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:49.846774 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ed101-5b05-4101-93ea-9d8449480118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:49.847727 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ed101-5b05-4101-93ea-9d8449480118 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:49.848221 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ed101-5b05-4101-93ea-9d8449480118 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:49.848641 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ed101-5b05-4101-93ea-9d8449480118 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:49.849487 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ed101-5b05-4101-93ea-9d8449480118 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:49.850032 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ed101-5b05-4101-93ea-9d8449480118 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:49.851657 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ed101-5b05-4101-93ea-9d8449480118 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:49.854666 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:49.863263 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 206/409] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:06:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:06:49.869658 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ed101-5b05-4101-93ea-9d8449480118 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:49.959515 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:49.972403 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ed101-5b05-4101-93ea-9d8449480118 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:50.006262 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90027c6a-a71c-4081-806a-2306c8486631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:50.006924 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90027c6a-a71c-4081-806a-2306c8486631 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:50.007200 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90027c6a-a71c-4081-806a-2306c8486631 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:50.007467 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90027c6a-a71c-4081-806a-2306c8486631 None admin] PATH_INFO: `/v3/groups/2e3285d6cbf7432c9d5d484ae17f54e4` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:50.008581 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90027c6a-a71c-4081-806a-2306c8486631 None admin] RBAC: Authorizing `identity:get_group(group_id=2e3285d6cbf7432c9d5d484ae17f54e4)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:50.010557 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90027c6a-a71c-4081-806a-2306c8486631 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:50.012398 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 207/410] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Sep 21 12:06:49 2022] GET /identity/v3/groups/2e3285d6cbf7432c9d5d484ae17f54e4 => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:50.017959 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90027c6a-a71c-4081-806a-2306c8486631 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:50.085249 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:50.088609 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1769a-3524-4055-8a02-74f26eec61d9 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:50.120247 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90027c6a-a71c-4081-806a-2306c8486631 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:50.155748 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b900e7-44df-4876-8347-f300bf21f2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:50.156392 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b900e7-44df-4876-8347-f300bf21f2fa None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:50.156673 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b900e7-44df-4876-8347-f300bf21f2fa None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:50.156947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b900e7-44df-4876-8347-f300bf21f2fa None admin] PATH_INFO: `/v3/projects/1600cabcba2e4465b53f5a73f9b91b11` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:50.158084 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b900e7-44df-4876-8347-f300bf21f2fa None admin] RBAC: Authorizing `identity:get_project(project_id=1600cabcba2e4465b53f5a73f9b91b11)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:50.159627 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b900e7-44df-4876-8347-f300bf21f2fa None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:50.161823 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 208/411] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:06:50 2022] GET /identity/v3/projects/1600cabcba2e4465b53f5a73f9b91b11 => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:06:50.167650 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b900e7-44df-4876-8347-f300bf21f2fa None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:50.219244 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c81aa-8381-4f5d-a2d7-773a79521009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:50.219808 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c81aa-8381-4f5d-a2d7-773a79521009 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:50.220095 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c81aa-8381-4f5d-a2d7-773a79521009 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:50.220373 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c81aa-8381-4f5d-a2d7-773a79521009 None admin] PATH_INFO: `/v3/groups/7ffeaf61ec3c42f0b0ff694a3392e12d` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:50.227063 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4c81aa-8381-4f5d-a2d7-773a79521009 None admin] RBAC: Authorizing `identity:get_group(group_id=7ffeaf61ec3c42f0b0ff694a3392e12d)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:50.228550 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4c81aa-8381-4f5d-a2d7-773a79521009 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:50.230489 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 204/412] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Sep 21 12:06:49 2022] GET /identity/v3/groups/7ffeaf61ec3c42f0b0ff694a3392e12d => generated 226 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:50.235928 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c81aa-8381-4f5d-a2d7-773a79521009 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:50.289809 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b900e7-44df-4876-8347-f300bf21f2fa None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:50.353951 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdaf4a-639b-43f8-b0b7-fa12c917ea2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:50.355383 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdaf4a-639b-43f8-b0b7-fa12c917ea2b None admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:50.355672 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdaf4a-639b-43f8-b0b7-fa12c917ea2b None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:50.355949 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdaf4a-639b-43f8-b0b7-fa12c917ea2b None admin] PATH_INFO: `/v3/projects/1600cabcba2e4465b53f5a73f9b91b11/groups/2e3285d6cbf7432c9d5d484ae17f54e4/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:50.358693 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfdaf4a-639b-43f8-b0b7-fa12c917ea2b None admin] RBAC: Authorizing `identity:create_grant(project_id=1600cabcba2e4465b53f5a73f9b91b11, group_id=2e3285d6cbf7432c9d5d484ae17f54e4, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:50.360160 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfdaf4a-639b-43f8-b0b7-fa12c917ea2b None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:50.365855 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:50.379320 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 209/413] 10.222.0.60 () {58 vars in 1442 bytes} [Wed Sep 21 12:06:50 2022] PUT /identity/v3/projects/1600cabcba2e4465b53f5a73f9b91b11/groups/2e3285d6cbf7432c9d5d484ae17f54e4/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:06:50.436847 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c81aa-8381-4f5d-a2d7-773a79521009 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:50.485098 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:50.495378 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2baf205-f1c4-4a28-b095-856a8d854462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:50.496025 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2baf205-f1c4-4a28-b095-856a8d854462 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:50.496303 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2baf205-f1c4-4a28-b095-856a8d854462 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:50.496574 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2baf205-f1c4-4a28-b095-856a8d854462 None admin] PATH_INFO: `/v3/projects/1367e35623684adc931fd16f99a77b44` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:50.502599 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2baf205-f1c4-4a28-b095-856a8d854462 None admin] RBAC: Authorizing `identity:get_project(project_id=1367e35623684adc931fd16f99a77b44)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:50.504087 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2baf205-f1c4-4a28-b095-856a8d854462 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:50.506039 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 205/414] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:06:50 2022] GET /identity/v3/projects/1367e35623684adc931fd16f99a77b44 => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:06:50.512337 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdaf4a-639b-43f8-b0b7-fa12c917ea2b None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:50.665721 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdaf4a-639b-43f8-b0b7-fa12c917ea2b None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:50.709940 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52467297-1cee-4e7f-9fd6-07c58b6fb9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:50.710649 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52467297-1cee-4e7f-9fd6-07c58b6fb9f6 None admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:50.710932 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52467297-1cee-4e7f-9fd6-07c58b6fb9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:50.711275 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52467297-1cee-4e7f-9fd6-07c58b6fb9f6 None admin] PATH_INFO: `/v3/projects/1367e35623684adc931fd16f99a77b44/groups/7ffeaf61ec3c42f0b0ff694a3392e12d/roles/173d0e93641b4882934b75f256b38534` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:50.714047 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52467297-1cee-4e7f-9fd6-07c58b6fb9f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=1367e35623684adc931fd16f99a77b44, group_id=7ffeaf61ec3c42f0b0ff694a3392e12d, role_id=173d0e93641b4882934b75f256b38534)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:50.715539 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52467297-1cee-4e7f-9fd6-07c58b6fb9f6 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:50.734139 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 210/415] 10.222.0.60 () {58 vars in 1442 bytes} [Wed Sep 21 12:06:50 2022] PUT /identity/v3/projects/1367e35623684adc931fd16f99a77b44/groups/7ffeaf61ec3c42f0b0ff694a3392e12d/roles/173d0e93641b4882934b75f256b38534 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:06:50.808533 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c699fc8-02f8-4a8b-b9a3-4c6cc7548d97 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:50.808886 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c699fc8-02f8-4a8b-b9a3-4c6cc7548d97 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:50.809082 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c699fc8-02f8-4a8b-b9a3-4c6cc7548d97 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:50.810459 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 206/416] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:50.816271 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce028e0-2001-41d4-b072-94e7c2b3534d None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:50.816769 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce028e0-2001-41d4-b072-94e7c2b3534d None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:50.816988 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce028e0-2001-41d4-b072-94e7c2b3534d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:50.838286 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-6ce028e0-2001-41d4-b072-94e7c2b3534d None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:50.843867 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-6ce028e0-2001-41d4-b072-94e7c2b3534d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:50.913614 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:50.941221 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 211/417] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 12:06:51.174185 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac96a7-db04-4bfc-abb7-019ad3634e10 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:51.174722 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac96a7-db04-4bfc-abb7-019ad3634e10 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:51.174722 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac96a7-db04-4bfc-abb7-019ad3634e10 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:51.176321 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 207/418] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:51.181857 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63da1bd-324b-440d-a9f4-5cb7c1409141 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:51.182140 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63da1bd-324b-440d-a9f4-5cb7c1409141 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:51.182453 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63da1bd-324b-440d-a9f4-5cb7c1409141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:51.207361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-d63da1bd-324b-440d-a9f4-5cb7c1409141 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:51.208556 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d63da1bd-324b-440d-a9f4-5cb7c1409141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:51.292892 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 212/419] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:06:51.326438 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac96a7-db04-4bfc-abb7-019ad3634e10 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:51.442438 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac96a7-db04-4bfc-abb7-019ad3634e10 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:51.476708 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f9707-09f4-4bd6-9246-40ee4387190a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:51.477336 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f9707-09f4-4bd6-9246-40ee4387190a None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:51.478143 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f9707-09f4-4bd6-9246-40ee4387190a None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:51.478437 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f9707-09f4-4bd6-9246-40ee4387190a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:51.489174 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f9707-09f4-4bd6-9246-40ee4387190a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:51.495058 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-891f9707-09f4-4bd6-9246-40ee4387190a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 12:06:51.495058 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:51.495058 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:51.495058 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:51.495058 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:51.495058 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:51.495058 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:51.495058 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:51.495058 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:51.495058 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:51.495058 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:51.495058 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:51.495058 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:51.495058 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:51.495058 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:51.495058 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:51.495938 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:51.495938 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:51.495938 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:51.495938 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:51.495938 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:51.495938 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:51.495938 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:51.495938 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:51.495938 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:51.495938 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:51.495938 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:51.495938 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:51.495938 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:51.495938 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:51.495938 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:51.495938 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:51.496721 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:51.496721 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:51.496721 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:51.496721 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:51.496721 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:51.496721 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:51.496721 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:51.496721 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:51.496721 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:51.496721 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:51.496721 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 12:06:51.496721 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:06:51.496721 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 208/420] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:06:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:06:51.507496 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63da1bd-324b-440d-a9f4-5cb7c1409141 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:51.657040 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63da1bd-324b-440d-a9f4-5cb7c1409141 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:51.665116 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f9707-09f4-4bd6-9246-40ee4387190a None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:51.688149 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:51.743804 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef81f18-948e-4f1f-a6f2-881f3b1c2887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:51.744335 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef81f18-948e-4f1f-a6f2-881f3b1c2887 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:51.744610 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef81f18-948e-4f1f-a6f2-881f3b1c2887 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:51.744875 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef81f18-948e-4f1f-a6f2-881f3b1c2887 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:51.745539 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef81f18-948e-4f1f-a6f2-881f3b1c2887 None admin] RBAC: Adding query filter params (name=member) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:51.745974 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef81f18-948e-4f1f-a6f2-881f3b1c2887 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:51.747455 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef81f18-948e-4f1f-a6f2-881f3b1c2887 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:51.764629 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 213/421] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Sep 21 12:06:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:51.770446 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef81f18-948e-4f1f-a6f2-881f3b1c2887 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:51.785022 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:51.857070 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f9707-09f4-4bd6-9246-40ee4387190a None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:51.899422 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf16fc-13a4-4a26-a345-5b69f20a84e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:51.900086 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf16fc-13a4-4a26-a345-5b69f20a84e1 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:51.900594 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf16fc-13a4-4a26-a345-5b69f20a84e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:51.900867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf16fc-13a4-4a26-a345-5b69f20a84e1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:51.907250 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef81f18-948e-4f1f-a6f2-881f3b1c2887 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:51.923431 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf16fc-13a4-4a26-a345-5b69f20a84e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:51.931711 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-abbf16fc-13a4-4a26-a345-5b69f20a84e1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 12:06:51.931711 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:51.931711 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:51.931711 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:51.931711 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:51.931711 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:51.931711 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:51.931711 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:51.931711 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:51.931711 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:51.931711 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:51.931711 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:51.931711 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:51.931711 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:51.931711 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:51.931711 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:51.932884 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:51.932884 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:51.932884 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:51.932884 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:51.932884 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:51.932884 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:51.932884 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:51.932884 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:51.932884 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:51.932884 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:51.932884 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:51.932884 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:51.932884 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:51.932884 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:51.932884 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:51.932884 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:51.934526 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:51.934526 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:51.934526 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:51.934526 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:51.934526 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:51.934526 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:51.934526 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:51.934526 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:51.934526 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:51.934526 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:51.934526 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 12:06:51.934526 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:06:51.942384 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 209/422] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Sep 21 12:06:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 12:06:51.942384 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3d5bd-ddb5-4d0e-8ff8-0355811461af None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:51.942384 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3d5bd-ddb5-4d0e-8ff8-0355811461af None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:51.942384 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3d5bd-ddb5-4d0e-8ff8-0355811461af None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:51.942807 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 210/423] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:51.943729 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3d5bd-ddb5-4d0e-8ff8-0355811461af None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:51.955840 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c6893-8c18-47e8-a0fd-6dabb9617902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:51.956458 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c6893-8c18-47e8-a0fd-6dabb9617902 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:51.956747 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c6893-8c18-47e8-a0fd-6dabb9617902 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:51.957021 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c6893-8c18-47e8-a0fd-6dabb9617902 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:52.005987 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:52.031098 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c6893-8c18-47e8-a0fd-6dabb9617902 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:52.032835 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c6893-8c18-47e8-a0fd-6dabb9617902 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:52.086419 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3d5bd-ddb5-4d0e-8ff8-0355811461af None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:52.105656 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:52.128709 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe26117-dd91-44c7-b082-a63a917c743e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:52.129322 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe26117-dd91-44c7-b082-a63a917c743e None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:52.130029 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe26117-dd91-44c7-b082-a63a917c743e None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:52.130306 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe26117-dd91-44c7-b082-a63a917c743e None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:52.131003 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe26117-dd91-44c7-b082-a63a917c743e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:52.131357 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe26117-dd91-44c7-b082-a63a917c743e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:52.133439 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe26117-dd91-44c7-b082-a63a917c743e None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:52.145169 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 211/424] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:06:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:52.147297 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6c7d4-1694-4f1e-83ee-4e45636c0f30 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:52.147637 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6c7d4-1694-4f1e-83ee-4e45636c0f30 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:52.147910 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6c7d4-1694-4f1e-83ee-4e45636c0f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:52.170124 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 214/425] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:06:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 12:06:52.171545 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c6893-8c18-47e8-a0fd-6dabb9617902 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:52.175036 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-5cc6c7d4-1694-4f1e-83ee-4e45636c0f30 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:52.176249 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-5cc6c7d4-1694-4f1e-83ee-4e45636c0f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:52.262574 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 212/426] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:06:52.263778 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6c7d4-1694-4f1e-83ee-4e45636c0f30 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:52.268511 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:52.305343 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c6893-8c18-47e8-a0fd-6dabb9617902 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:52.373486 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a594f-9b06-463e-85dd-10556ead8c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:52.374096 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a594f-9b06-463e-85dd-10556ead8c74 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:52.374386 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a594f-9b06-463e-85dd-10556ead8c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:52.374687 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a594f-9b06-463e-85dd-10556ead8c74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:52.440515 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6c7d4-1694-4f1e-83ee-4e45636c0f30 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:52.457282 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a594f-9b06-463e-85dd-10556ead8c74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:52.458777 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a594f-9b06-463e-85dd-10556ead8c74 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:52.462390 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:52.545369 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:52.562900 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440f53c-5fa3-415e-81d1-c3a365650a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:52.563844 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440f53c-5fa3-415e-81d1-c3a365650a89 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:52.564574 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440f53c-5fa3-415e-81d1-c3a365650a89 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:52.565289 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440f53c-5fa3-415e-81d1-c3a365650a89 None admin] PATH_INFO: `/v3/projects/39342ea2ea9b45c8817058e7bed7c739` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:52.566807 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440f53c-5fa3-415e-81d1-c3a365650a89 None admin] RBAC: Authorizing `identity:get_project(project_id=39342ea2ea9b45c8817058e7bed7c739)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:52.569026 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440f53c-5fa3-415e-81d1-c3a365650a89 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:52.571128 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 215/427] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:06:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 12:06:52.571868 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 213/428] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:06:52 2022] GET /identity/v3/projects/39342ea2ea9b45c8817058e7bed7c739 => generated 298 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:52.572048 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a594f-9b06-463e-85dd-10556ead8c74 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:52.577932 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440f53c-5fa3-415e-81d1-c3a365650a89 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:52.692027 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a594f-9b06-463e-85dd-10556ead8c74 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:52.694452 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440f53c-5fa3-415e-81d1-c3a365650a89 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:52.729963 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43648ba-c9a8-404c-97c9-ed9037de6425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:52.731076 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43648ba-c9a8-404c-97c9-ed9037de6425 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:52.731608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43648ba-c9a8-404c-97c9-ed9037de6425 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:52.731986 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc69201-d039-4560-8432-bff5ad5c26ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:52.732263 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43648ba-c9a8-404c-97c9-ed9037de6425 None admin] PATH_INFO: `/v3/groups/7ffeaf61ec3c42f0b0ff694a3392e12d` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:52.732760 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc69201-d039-4560-8432-bff5ad5c26ed None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:52.733103 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc69201-d039-4560-8432-bff5ad5c26ed None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:52.733441 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc69201-d039-4560-8432-bff5ad5c26ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:52.734328 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43648ba-c9a8-404c-97c9-ed9037de6425 None admin] RBAC: Authorizing `identity:get_group(group_id=7ffeaf61ec3c42f0b0ff694a3392e12d)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:52.735971 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43648ba-c9a8-404c-97c9-ed9037de6425 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:52.738181 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 214/429] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Sep 21 12:06:52 2022] GET /identity/v3/groups/7ffeaf61ec3c42f0b0ff694a3392e12d => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:06:52.739358 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43648ba-c9a8-404c-97c9-ed9037de6425 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:52.746431 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc69201-d039-4560-8432-bff5ad5c26ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:52.752389 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-7cc69201-d039-4560-8432-bff5ad5c26ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 21 12:06:52.752389 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:52.752389 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:52.752389 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:52.752389 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:52.752389 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:52.752389 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:52.752389 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:52.752389 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:52.752389 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:52.752389 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:52.752389 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:52.752389 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:52.752389 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:52.752389 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:52.752389 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:52.753283 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:52.753283 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:52.753283 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:52.753283 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:52.753283 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:52.753283 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:52.753283 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:52.753283 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:52.753283 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:52.753283 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:52.753283 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:52.753283 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:52.753283 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:52.753283 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:52.753283 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:52.753283 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:52.754099 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:52.754099 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:52.754099 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:52.754099 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:52.754099 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:52.754099 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:52.754099 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:52.754099 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:52.754099 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:52.754099 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:52.754099 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 21 12:06:52.754099 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:06:52.754099 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 216/430] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:06:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:06:52.754805 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc69201-d039-4560-8432-bff5ad5c26ed None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:52.798008 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:52.807303 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:52.876973 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43648ba-c9a8-404c-97c9-ed9037de6425 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:52.889144 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc69201-d039-4560-8432-bff5ad5c26ed None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:52.923482 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d56123-be64-4b55-8f89-0001395f0cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:52.924433 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d56123-be64-4b55-8f89-0001395f0cc5 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:52.924892 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d56123-be64-4b55-8f89-0001395f0cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:52.925341 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d56123-be64-4b55-8f89-0001395f0cc5 None admin] PATH_INFO: `/v3/projects/39342ea2ea9b45c8817058e7bed7c739` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:52.926728 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d56123-be64-4b55-8f89-0001395f0cc5 None admin] RBAC: Authorizing `identity:get_project(project_id=39342ea2ea9b45c8817058e7bed7c739)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:52.928433 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d56123-be64-4b55-8f89-0001395f0cc5 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:52.935151 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 215/431] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:06:52 2022] GET /identity/v3/projects/39342ea2ea9b45c8817058e7bed7c739 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:52.935151 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d56123-be64-4b55-8f89-0001395f0cc5 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:52.939784 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a20970-86f3-4506-93cb-fff7f454c4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:52.939784 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a20970-86f3-4506-93cb-fff7f454c4c2 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:52.940338 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a20970-86f3-4506-93cb-fff7f454c4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:52.940338 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a20970-86f3-4506-93cb-fff7f454c4c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:52.940942 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a20970-86f3-4506-93cb-fff7f454c4c2 None admin] RBAC: Adding query filter params (group.id=7ffeaf61ec3c42f0b0ff694a3392e12d, role.id=9712f7b332bf484689b3706721ab6311, scope.project.id=39342ea2ea9b45c8817058e7bed7c739) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:52.941251 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a20970-86f3-4506-93cb-fff7f454c4c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:52.942711 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a20970-86f3-4506-93cb-fff7f454c4c2 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:52.950156 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 217/432] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Sep 21 12:06:52 2022] GET /identity/v3/role_assignments?group.id=7ffeaf61ec3c42f0b0ff694a3392e12d&scope.project.id=39342ea2ea9b45c8817058e7bed7c739&role.id=9712f7b332bf484689b3706721ab6311 => generated 611 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:52.951167 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a20970-86f3-4506-93cb-fff7f454c4c2 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:53.055344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d56123-be64-4b55-8f89-0001395f0cc5 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:53.071242 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:53.089089 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a20970-86f3-4506-93cb-fff7f454c4c2 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:53.096363 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2579ec21-e88d-4177-a678-2cbafd99101e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:53.097411 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579ec21-e88d-4177-a678-2cbafd99101e None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:53.097942 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579ec21-e88d-4177-a678-2cbafd99101e None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:53.098448 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579ec21-e88d-4177-a678-2cbafd99101e None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:53.099349 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2579ec21-e88d-4177-a678-2cbafd99101e None admin] RBAC: Adding query filter params (name=member) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:53.099905 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2579ec21-e88d-4177-a678-2cbafd99101e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:53.101652 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2579ec21-e88d-4177-a678-2cbafd99101e None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:53.105015 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:53.118732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 216/433] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Sep 21 12:06:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:53.120144 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4dfbbc-7d61-4aa1-b955-2c0b3d059288 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:53.120390 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4dfbbc-7d61-4aa1-b955-2c0b3d059288 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:53.120662 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4dfbbc-7d61-4aa1-b955-2c0b3d059288 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:53.122143 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 217/434] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:53.122742 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4dfbbc-7d61-4aa1-b955-2c0b3d059288 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:53.138456 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd41204-00e4-435f-b2a0-df89f979094c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:53.139881 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd41204-00e4-435f-b2a0-df89f979094c None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:53.140705 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd41204-00e4-435f-b2a0-df89f979094c None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:53.141393 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd41204-00e4-435f-b2a0-df89f979094c None admin] PATH_INFO: `/v3/groups/7ffeaf61ec3c42f0b0ff694a3392e12d` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:53.143002 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd41204-00e4-435f-b2a0-df89f979094c None admin] RBAC: Authorizing `identity:get_group(group_id=7ffeaf61ec3c42f0b0ff694a3392e12d)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:53.144708 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd41204-00e4-435f-b2a0-df89f979094c None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:53.147151 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 218/435] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Sep 21 12:06:52 2022] GET /identity/v3/groups/7ffeaf61ec3c42f0b0ff694a3392e12d => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:53.152779 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662f046-e993-4d62-a5fb-3f0c6f779597 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:53.154519 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662f046-e993-4d62-a5fb-3f0c6f779597 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:53.155128 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662f046-e993-4d62-a5fb-3f0c6f779597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:53.179642 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-6662f046-e993-4d62-a5fb-3f0c6f779597 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:53.182232 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-6662f046-e993-4d62-a5fb-3f0c6f779597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:53.254232 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4dfbbc-7d61-4aa1-b955-2c0b3d059288 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:53.278930 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 219/436] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:06:53.280327 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6662f046-e993-4d62-a5fb-3f0c6f779597 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:53.311063 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e131e-609a-46ff-baaa-75249ddb70ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:53.312240 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e131e-609a-46ff-baaa-75249ddb70ab None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:53.312623 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e131e-609a-46ff-baaa-75249ddb70ab None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:53.313289 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3e131e-609a-46ff-baaa-75249ddb70ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:53.384737 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:53.415164 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:53.420584 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6662f046-e993-4d62-a5fb-3f0c6f779597 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:53.427676 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e131e-609a-46ff-baaa-75249ddb70ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:53.429648 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3e131e-609a-46ff-baaa-75249ddb70ab None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:53.457666 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c644d1-2af7-4551-8359-500dfb579315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:53.458652 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c644d1-2af7-4551-8359-500dfb579315 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:53.459168 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c644d1-2af7-4551-8359-500dfb579315 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:53.459649 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c644d1-2af7-4551-8359-500dfb579315 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:53.460572 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c644d1-2af7-4551-8359-500dfb579315 None admin] RBAC: Adding query filter params (group.id=7ffeaf61ec3c42f0b0ff694a3392e12d, role.id=173d0e93641b4882934b75f256b38534, scope.project.id=39342ea2ea9b45c8817058e7bed7c739) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:53.461087 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c644d1-2af7-4551-8359-500dfb579315 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:53.462972 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c644d1-2af7-4551-8359-500dfb579315 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:53.471424 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 220/437] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Sep 21 12:06:53 2022] GET /identity/v3/role_assignments?group.id=7ffeaf61ec3c42f0b0ff694a3392e12d&scope.project.id=39342ea2ea9b45c8817058e7bed7c739&role.id=173d0e93641b4882934b75f256b38534 => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:53.506583 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94314bd7-c2a2-4ae2-982b-2cb495d1bc8e None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:53.507247 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94314bd7-c2a2-4ae2-982b-2cb495d1bc8e None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:53.507726 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94314bd7-c2a2-4ae2-982b-2cb495d1bc8e None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:53.509546 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 221/438] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:53.515930 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654da869-8c0e-45e1-a293-8e969a226148 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:53.516253 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654da869-8c0e-45e1-a293-8e969a226148 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:53.516480 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654da869-8c0e-45e1-a293-8e969a226148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:53.539264 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-654da869-8c0e-45e1-a293-8e969a226148 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:53.541257 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-654da869-8c0e-45e1-a293-8e969a226148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:53.555144 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 218/439] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:06:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 12:06:53.562106 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e131e-609a-46ff-baaa-75249ddb70ab None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:53.652381 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 222/440] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 12:06:53.653582 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654da869-8c0e-45e1-a293-8e969a226148 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:53.666050 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:53.701390 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3e131e-609a-46ff-baaa-75249ddb70ab None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:53.745556 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410450a-cf2d-4a7c-94b8-836e50c8343f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:53.746203 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410450a-cf2d-4a7c-94b8-836e50c8343f None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:53.746530 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410450a-cf2d-4a7c-94b8-836e50c8343f None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:53.746805 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410450a-cf2d-4a7c-94b8-836e50c8343f None admin] PATH_INFO: `/v3/projects/1367e35623684adc931fd16f99a77b44` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:53.747955 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c410450a-cf2d-4a7c-94b8-836e50c8343f None admin] RBAC: Authorizing `identity:get_project(project_id=1367e35623684adc931fd16f99a77b44)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:53.749533 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c410450a-cf2d-4a7c-94b8-836e50c8343f None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:53.751643 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 219/441] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:06:53 2022] GET /identity/v3/projects/1367e35623684adc931fd16f99a77b44 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:06:53.757289 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410450a-cf2d-4a7c-94b8-836e50c8343f None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:53.769460 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:53.784711 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654da869-8c0e-45e1-a293-8e969a226148 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:53.830634 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367641b8-1284-4c49-9997-5a66ef7dde0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:53.831291 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367641b8-1284-4c49-9997-5a66ef7dde0f None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:53.831567 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367641b8-1284-4c49-9997-5a66ef7dde0f None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:53.831839 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367641b8-1284-4c49-9997-5a66ef7dde0f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:53.843575 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367641b8-1284-4c49-9997-5a66ef7dde0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:53.848324 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-367641b8-1284-4c49-9997-5a66ef7dde0f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:06:53.848324 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:53.848324 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:53.848324 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:53.848324 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:53.848324 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:53.848324 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:53.848324 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:53.848324 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:53.848324 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:53.848324 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:53.848324 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:53.848324 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:53.848324 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:53.848324 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:53.848324 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:53.849208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:53.849208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:53.849208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:53.849208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:53.849208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:53.849208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:53.849208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:53.849208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:53.849208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:53.849208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:53.849208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:53.849208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:53.849208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:53.849208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:53.849208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:53.849208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:53.850011 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:53.850011 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:53.850011 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:53.850011 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:53.850011 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:53.850011 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:53.850011 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:53.850011 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:53.850011 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:53.850011 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:53.850011 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:06:53.850011 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:06:53.850011 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 223/442] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Sep 21 12:06:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:06:53.856579 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367641b8-1284-4c49-9997-5a66ef7dde0f None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:53.891221 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410450a-cf2d-4a7c-94b8-836e50c8343f None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:53.938543 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fcae2f-cab5-4d77-9dbf-9f669efd9d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:53.939449 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcae2f-cab5-4d77-9dbf-9f669efd9d20 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:53.939797 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcae2f-cab5-4d77-9dbf-9f669efd9d20 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:53.940075 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fcae2f-cab5-4d77-9dbf-9f669efd9d20 None admin] PATH_INFO: `/v3/groups/7ffeaf61ec3c42f0b0ff694a3392e12d` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:53.941207 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fcae2f-cab5-4d77-9dbf-9f669efd9d20 None admin] RBAC: Authorizing `identity:get_group(group_id=7ffeaf61ec3c42f0b0ff694a3392e12d)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:53.942695 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fcae2f-cab5-4d77-9dbf-9f669efd9d20 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:53.944435 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 220/443] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Sep 21 12:06:53 2022] GET /identity/v3/groups/7ffeaf61ec3c42f0b0ff694a3392e12d => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:06:53.950598 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fcae2f-cab5-4d77-9dbf-9f669efd9d20 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:53.969031 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:53.988513 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367641b8-1284-4c49-9997-5a66ef7dde0f None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:54.031860 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65cded-4a89-442e-97d7-766307d7e96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:54.032474 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65cded-4a89-442e-97d7-766307d7e96e None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:54.032756 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65cded-4a89-442e-97d7-766307d7e96e None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:54.033031 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65cded-4a89-442e-97d7-766307d7e96e None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:54.033708 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f65cded-4a89-442e-97d7-766307d7e96e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:54.034017 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f65cded-4a89-442e-97d7-766307d7e96e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:54.035478 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f65cded-4a89-442e-97d7-766307d7e96e None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:54.043952 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 224/444] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:06:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:06:54.044749 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65cded-4a89-442e-97d7-766307d7e96e None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:54.063505 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:54.072100 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fcae2f-cab5-4d77-9dbf-9f669efd9d20 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:54.107667 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7edc0b-dca3-46c0-8b1d-bc90a7dfdde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:54.108180 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7edc0b-dca3-46c0-8b1d-bc90a7dfdde3 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:54.108465 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7edc0b-dca3-46c0-8b1d-bc90a7dfdde3 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:54.108736 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7edc0b-dca3-46c0-8b1d-bc90a7dfdde3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:54.109455 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7edc0b-dca3-46c0-8b1d-bc90a7dfdde3 None admin] RBAC: Adding query filter params (group.id=7ffeaf61ec3c42f0b0ff694a3392e12d, role.id=9712f7b332bf484689b3706721ab6311, scope.project.id=1367e35623684adc931fd16f99a77b44) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:54.109764 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7edc0b-dca3-46c0-8b1d-bc90a7dfdde3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:54.111237 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7edc0b-dca3-46c0-8b1d-bc90a7dfdde3 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:54.117021 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 221/445] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Sep 21 12:06:53 2022] GET /identity/v3/role_assignments?group.id=7ffeaf61ec3c42f0b0ff694a3392e12d&scope.project.id=1367e35623684adc931fd16f99a77b44&role.id=9712f7b332bf484689b3706721ab6311 => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:54.117790 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7edc0b-dca3-46c0-8b1d-bc90a7dfdde3 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:54.161247 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65cded-4a89-442e-97d7-766307d7e96e None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:54.203782 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12815d35-a4c1-4469-afe0-80efc9c56652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:54.204530 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12815d35-a4c1-4469-afe0-80efc9c56652 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:54.204875 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12815d35-a4c1-4469-afe0-80efc9c56652 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:54.205216 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12815d35-a4c1-4469-afe0-80efc9c56652 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:54.217244 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:54.217569 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12815d35-a4c1-4469-afe0-80efc9c56652 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:06:54.223667 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-12815d35-a4c1-4469-afe0-80efc9c56652 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 12:06:54.223667 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:54.223667 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:54.223667 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:54.223667 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:54.223667 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:54.223667 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:54.223667 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:54.223667 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:54.223667 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:54.223667 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:54.223667 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:54.223667 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:06:54.223667 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:06:54.223667 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:06:54.223667 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:06:54.224649 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:06:54.224649 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:06:54.224649 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:06:54.224649 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:06:54.224649 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:54.224649 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:54.224649 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:54.224649 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:54.224649 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:54.224649 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:54.224649 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:54.224649 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:54.224649 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:54.224649 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:54.224649 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:54.224649 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:54.225463 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:54.225463 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:54.225463 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:54.225463 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:54.225463 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:06:54.225463 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:06:54.225463 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:06:54.225463 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:06:54.225463 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:06:54.225463 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:06:54.225463 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 12:06:54.225463 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:06:54.225463 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 225/446] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Sep 21 12:06:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:06:54.231341 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12815d35-a4c1-4469-afe0-80efc9c56652 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:54.251832 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7edc0b-dca3-46c0-8b1d-bc90a7dfdde3 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:54.292773 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c877b-a6a2-4aa4-a98d-ef39ee3bf314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:54.293434 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c877b-a6a2-4aa4-a98d-ef39ee3bf314 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:54.293659 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c877b-a6a2-4aa4-a98d-ef39ee3bf314 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:54.293932 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c877b-a6a2-4aa4-a98d-ef39ee3bf314 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:54.321254 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:54.351345 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12815d35-a4c1-4469-afe0-80efc9c56652 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:54.380607 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c877b-a6a2-4aa4-a98d-ef39ee3bf314 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:54.381984 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c877b-a6a2-4aa4-a98d-ef39ee3bf314 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:54.395421 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98a232-cf3f-454a-83a8-b6b1bf5c0412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:54.395888 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98a232-cf3f-454a-83a8-b6b1bf5c0412 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:54.396176 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98a232-cf3f-454a-83a8-b6b1bf5c0412 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:54.396501 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98a232-cf3f-454a-83a8-b6b1bf5c0412 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:54.397118 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c98a232-cf3f-454a-83a8-b6b1bf5c0412 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:54.397421 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c98a232-cf3f-454a-83a8-b6b1bf5c0412 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:54.398926 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c98a232-cf3f-454a-83a8-b6b1bf5c0412 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:54.407784 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 226/447] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:06:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:06:54.414664 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98a232-cf3f-454a-83a8-b6b1bf5c0412 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:54.476020 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:54.507041 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 222/448] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:06:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 12:06:54.512329 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c877b-a6a2-4aa4-a98d-ef39ee3bf314 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:54.537588 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98a232-cf3f-454a-83a8-b6b1bf5c0412 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:54.572239 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3784c6-7745-4bb8-9fad-a346e9e36a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:54.572844 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3784c6-7745-4bb8-9fad-a346e9e36a04 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:54.573124 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3784c6-7745-4bb8-9fad-a346e9e36a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:54.573395 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3784c6-7745-4bb8-9fad-a346e9e36a04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:54.576981 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:54.612860 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c877b-a6a2-4aa4-a98d-ef39ee3bf314 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:54.642435 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3784c6-7745-4bb8-9fad-a346e9e36a04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:54.643823 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3784c6-7745-4bb8-9fad-a346e9e36a04 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:54.645815 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ca614-2420-4dba-8030-a53b421d84e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:54.646482 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ca614-2420-4dba-8030-a53b421d84e6 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:54.646759 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ca614-2420-4dba-8030-a53b421d84e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:54.647028 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ca614-2420-4dba-8030-a53b421d84e6 None admin] PATH_INFO: `/v3/projects/1600cabcba2e4465b53f5a73f9b91b11` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:54.648140 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ca614-2420-4dba-8030-a53b421d84e6 None admin] RBAC: Authorizing `identity:get_project(project_id=1600cabcba2e4465b53f5a73f9b91b11)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:54.650083 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ca614-2420-4dba-8030-a53b421d84e6 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:54.651742 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 223/449] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:06:54 2022] GET /identity/v3/projects/1600cabcba2e4465b53f5a73f9b91b11 => generated 344 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:06:54.657146 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ca614-2420-4dba-8030-a53b421d84e6 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:54.700061 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:54.744790 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 227/450] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:06:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 21 12:06:54.750330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3784c6-7745-4bb8-9fad-a346e9e36a04 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:54.756200 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ca614-2420-4dba-8030-a53b421d84e6 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:54.784123 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:54.791155 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b762a9c-5dd7-4bad-ba77-fda90b423f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:54.791786 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b762a9c-5dd7-4bad-ba77-fda90b423f00 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:54.792073 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b762a9c-5dd7-4bad-ba77-fda90b423f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:54.792336 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b762a9c-5dd7-4bad-ba77-fda90b423f00 None admin] PATH_INFO: `/v3/groups/2e3285d6cbf7432c9d5d484ae17f54e4` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:54.793448 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b762a9c-5dd7-4bad-ba77-fda90b423f00 None admin] RBAC: Authorizing `identity:get_group(group_id=2e3285d6cbf7432c9d5d484ae17f54e4)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:54.794988 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b762a9c-5dd7-4bad-ba77-fda90b423f00 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:54.796552 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 224/451] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Sep 21 12:06:54 2022] GET /identity/v3/groups/2e3285d6cbf7432c9d5d484ae17f54e4 => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:06:54.802316 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b762a9c-5dd7-4bad-ba77-fda90b423f00 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:54.849650 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3784c6-7745-4bb8-9fad-a346e9e36a04 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:54.884516 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ad3af-edba-4e78-bef1-d33b688cdcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:54.885129 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ad3af-edba-4e78-bef1-d33b688cdcf2 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:54.885409 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ad3af-edba-4e78-bef1-d33b688cdcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:54.885679 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ad3af-edba-4e78-bef1-d33b688cdcf2 None admin] PATH_INFO: `/v3/projects/1367e35623684adc931fd16f99a77b44` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:54.886824 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ad3af-edba-4e78-bef1-d33b688cdcf2 None admin] RBAC: Authorizing `identity:get_project(project_id=1367e35623684adc931fd16f99a77b44)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:54.888494 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ad3af-edba-4e78-bef1-d33b688cdcf2 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:54.890097 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 228/452] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:06:54 2022] GET /identity/v3/projects/1367e35623684adc931fd16f99a77b44 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:06:54.895490 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ad3af-edba-4e78-bef1-d33b688cdcf2 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:54.903553 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b762a9c-5dd7-4bad-ba77-fda90b423f00 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:54.914408 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:54.938601 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21433b7-f5ef-408e-9e84-32dc6fc6af0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:54.939204 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21433b7-f5ef-408e-9e84-32dc6fc6af0f None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:54.939484 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21433b7-f5ef-408e-9e84-32dc6fc6af0f None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:54.939758 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21433b7-f5ef-408e-9e84-32dc6fc6af0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:54.940479 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21433b7-f5ef-408e-9e84-32dc6fc6af0f None admin] RBAC: Adding query filter params (group.id=2e3285d6cbf7432c9d5d484ae17f54e4, role.id=72c80b472acb462ebadd86463efe91f7, scope.project.id=1600cabcba2e4465b53f5a73f9b91b11) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:54.940792 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21433b7-f5ef-408e-9e84-32dc6fc6af0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:54.942219 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21433b7-f5ef-408e-9e84-32dc6fc6af0f None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:54.948407 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 225/453] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Sep 21 12:06:54 2022] GET /identity/v3/role_assignments?group.id=2e3285d6cbf7432c9d5d484ae17f54e4&scope.project.id=1600cabcba2e4465b53f5a73f9b91b11&role.id=72c80b472acb462ebadd86463efe91f7 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:06:54.997715 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ad3af-edba-4e78-bef1-d33b688cdcf2 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:55.000444 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:55.035148 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5f7a0-8ddf-4eef-a678-f08c74515501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:55.035800 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5f7a0-8ddf-4eef-a678-f08c74515501 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:55.036076 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5f7a0-8ddf-4eef-a678-f08c74515501 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:55.036351 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5f7a0-8ddf-4eef-a678-f08c74515501 None admin] PATH_INFO: `/v3/groups/7ffeaf61ec3c42f0b0ff694a3392e12d` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:55.037524 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c5f7a0-8ddf-4eef-a678-f08c74515501 None admin] RBAC: Authorizing `identity:get_group(group_id=7ffeaf61ec3c42f0b0ff694a3392e12d)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:55.039050 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c5f7a0-8ddf-4eef-a678-f08c74515501 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:55.040993 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 229/454] 10.222.0.60 () {56 vars in 1180 bytes} [Wed Sep 21 12:06:54 2022] GET /identity/v3/groups/7ffeaf61ec3c42f0b0ff694a3392e12d => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:06:55.047088 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21433b7-f5ef-408e-9e84-32dc6fc6af0f None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:55.154281 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21433b7-f5ef-408e-9e84-32dc6fc6af0f None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:55.188263 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22491c3c-0698-4ae3-872f-db0407bb1a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:55.188873 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22491c3c-0698-4ae3-872f-db0407bb1a3f None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:55.189153 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22491c3c-0698-4ae3-872f-db0407bb1a3f None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:55.189426 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22491c3c-0698-4ae3-872f-db0407bb1a3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:55.190140 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22491c3c-0698-4ae3-872f-db0407bb1a3f None admin] RBAC: Adding query filter params (group.id=7ffeaf61ec3c42f0b0ff694a3392e12d, role.id=173d0e93641b4882934b75f256b38534, scope.project.id=1367e35623684adc931fd16f99a77b44) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:55.190475 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22491c3c-0698-4ae3-872f-db0407bb1a3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:55.191912 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22491c3c-0698-4ae3-872f-db0407bb1a3f None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:55.198028 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 226/455] 10.222.0.60 () {56 vars in 1376 bytes} [Wed Sep 21 12:06:55 2022] GET /identity/v3/role_assignments?group.id=7ffeaf61ec3c42f0b0ff694a3392e12d&scope.project.id=1367e35623684adc931fd16f99a77b44&role.id=173d0e93641b4882934b75f256b38534 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:57.877020 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f1885-ee5c-4e8c-bc4b-53120166b59d None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:57.877506 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f1885-ee5c-4e8c-bc4b-53120166b59d None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:57.877506 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f1885-ee5c-4e8c-bc4b-53120166b59d None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:57.879109 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 230/456] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:57.885242 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed72de0-de40-4d3a-84f1-a1103eb397df None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:57.885918 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed72de0-de40-4d3a-84f1-a1103eb397df None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:57.885918 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed72de0-de40-4d3a-84f1-a1103eb397df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:57.916542 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-aed72de0-de40-4d3a-84f1-a1103eb397df None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:57.917763 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-aed72de0-de40-4d3a-84f1-a1103eb397df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:57.963114 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:58.012806 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 227/457] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:06:58.065893 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7992d-08bb-428e-9e37-29871d2e72aa None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:58.066197 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7992d-08bb-428e-9e37-29871d2e72aa None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:58.066474 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7992d-08bb-428e-9e37-29871d2e72aa None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:58.068310 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 231/458] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:58.073900 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f5089-9dcf-442c-a86b-3659e1bd91bd None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:58.074191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f5089-9dcf-442c-a86b-3659e1bd91bd None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:58.074496 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f5089-9dcf-442c-a86b-3659e1bd91bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:58.099389 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-590f5089-9dcf-442c-a86b-3659e1bd91bd None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:58.100600 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-590f5089-9dcf-442c-a86b-3659e1bd91bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:58.192801 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 228/459] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:06:58.248737 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652aa0c1-cdc5-4122-890c-736dc08f2ffb None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:58.249060 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652aa0c1-cdc5-4122-890c-736dc08f2ffb None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:58.249280 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652aa0c1-cdc5-4122-890c-736dc08f2ffb None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:58.250921 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 232/460] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:58.256292 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a7ba3-7c93-43b5-abba-24302285419b None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:58.256587 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a7ba3-7c93-43b5-abba-24302285419b None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:58.256868 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a7ba3-7c93-43b5-abba-24302285419b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:58.286582 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-6e9a7ba3-7c93-43b5-abba-24302285419b None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:58.287791 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-6e9a7ba3-7c93-43b5-abba-24302285419b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:58.379978 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 229/461] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:06:58.409710 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652aa0c1-cdc5-4122-890c-736dc08f2ffb None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:58.598466 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a7ba3-7c93-43b5-abba-24302285419b None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:58.615689 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652aa0c1-cdc5-4122-890c-736dc08f2ffb None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:58.655782 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:58.676074 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e97496-6756-4d07-9d8c-5b210b43213f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:58.676727 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e97496-6756-4d07-9d8c-5b210b43213f None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:58.677024 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e97496-6756-4d07-9d8c-5b210b43213f None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:58.677285 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e97496-6756-4d07-9d8c-5b210b43213f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:58.689515 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e97496-6756-4d07-9d8c-5b210b43213f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:58.691019 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e97496-6756-4d07-9d8c-5b210b43213f None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:58.707768 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-c4e97496-6756-4d07-9d8c-5b210b43213f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:06:58.707768 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:58.707768 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:58.707768 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:58.707768 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:58.707768 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:58.707768 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:58.707768 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:58.707768 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:58.707768 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:58.707768 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:58.707768 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:58.707768 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:06:58.707768 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:06:58.707768 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:06:58.707768 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:06:58.708710 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:58.708710 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:58.708710 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:58.708710 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:58.708710 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:58.708710 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:58.708710 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:58.708710 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:58.708710 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:58.708710 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:58.708710 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:58.708710 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:58.708710 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:58.708710 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:58.708710 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:58.708710 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:58.708710 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:06:58.709562 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:06:58.709562 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:06:58.709562 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:06:58.709562 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 233/462] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:06:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:06:58.710201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e97496-6756-4d07-9d8c-5b210b43213f None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:58.746619 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:58.754637 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a7ba3-7c93-43b5-abba-24302285419b None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:58.797680 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d404a-531b-4e4f-8b7d-a11b7e3643bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:58.798718 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d404a-531b-4e4f-8b7d-a11b7e3643bc None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:58.799197 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d404a-531b-4e4f-8b7d-a11b7e3643bc None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:58.799690 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d404a-531b-4e4f-8b7d-a11b7e3643bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:58.812240 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d404a-531b-4e4f-8b7d-a11b7e3643bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:58.814017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d404a-531b-4e4f-8b7d-a11b7e3643bc None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:58.830921 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-b93d404a-531b-4e4f-8b7d-a11b7e3643bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:06:58.830921 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:58.830921 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:58.830921 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:58.830921 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:58.830921 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:58.830921 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:58.830921 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:58.830921 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:58.830921 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:58.830921 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:58.830921 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:58.830921 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:06:58.830921 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:06:58.830921 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:06:58.830921 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:06:58.831837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:58.831837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:58.831837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:58.831837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:58.831837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:58.831837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:58.831837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:58.831837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:58.831837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:58.831837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:58.831837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:58.831837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:58.831837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:58.831837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:58.831837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:58.831837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:58.831837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:06:58.832684 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:06:58.832684 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:06:58.832684 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:06:58.834476 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 230/463] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:06:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:06:58.835478 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d404a-531b-4e4f-8b7d-a11b7e3643bc None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:58.847679 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e97496-6756-4d07-9d8c-5b210b43213f None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:58.885885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a4924-2577-4d95-adb2-d0269e4d179e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:58.887365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a4924-2577-4d95-adb2-d0269e4d179e None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:58.887888 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a4924-2577-4d95-adb2-d0269e4d179e None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:58.888606 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a4924-2577-4d95-adb2-d0269e4d179e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:58.902532 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a4924-2577-4d95-adb2-d0269e4d179e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:58.904306 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a4924-2577-4d95-adb2-d0269e4d179e None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:58.922442 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-c20a4924-2577-4d95-adb2-d0269e4d179e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:06:58.922442 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:06:58.922442 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:06:58.922442 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:06:58.922442 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:06:58.922442 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:06:58.922442 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:06:58.922442 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:06:58.922442 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:06:58.922442 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:06:58.922442 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:06:58.922442 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:06:58.922442 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:06:58.922442 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:06:58.922442 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:06:58.922442 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:06:58.923374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:06:58.923374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:06:58.923374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:06:58.923374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:06:58.923374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:06:58.923374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:06:58.923374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:06:58.923374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:06:58.923374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:06:58.923374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:06:58.923374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:06:58.923374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:06:58.923374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:06:58.923374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:06:58.923374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:06:58.923374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:06:58.923374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:06:58.924218 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:06:58.924218 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:06:58.924218 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:06:58.931189 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 234/464] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:06:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:06:58.931440 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a4924-2577-4d95-adb2-d0269e4d179e None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:58.952962 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:58.979632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d404a-531b-4e4f-8b7d-a11b7e3643bc None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:59.033469 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e5ba9-fc47-4846-bf96-2494328f1421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:59.034089 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e5ba9-fc47-4846-bf96-2494328f1421 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:59.034401 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e5ba9-fc47-4846-bf96-2494328f1421 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:59.034691 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e5ba9-fc47-4846-bf96-2494328f1421 None admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:59.035340 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e5ba9-fc47-4846-bf96-2494328f1421 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:59.035645 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e5ba9-fc47-4846-bf96-2494328f1421 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:59.037008 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:59.038752 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e5ba9-fc47-4846-bf96-2494328f1421 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:59.061232 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 231/465] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:06:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:59.061232 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e5ba9-fc47-4846-bf96-2494328f1421 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:59.070890 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a4924-2577-4d95-adb2-d0269e4d179e None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:59.119829 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b330636-fb7b-489e-8d66-5949143282ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:59.120406 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b330636-fb7b-489e-8d66-5949143282ad None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:59.120688 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b330636-fb7b-489e-8d66-5949143282ad None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:59.120960 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b330636-fb7b-489e-8d66-5949143282ad None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:59.121686 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b330636-fb7b-489e-8d66-5949143282ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:59.122076 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b330636-fb7b-489e-8d66-5949143282ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:59.123821 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b330636-fb7b-489e-8d66-5949143282ad None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:59.149563 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 235/466] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:06:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:59.149563 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b330636-fb7b-489e-8d66-5949143282ad None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:59.180566 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e5ba9-fc47-4846-bf96-2494328f1421 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:59.218578 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a51b78f-5493-40bb-9345-61c170813399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:59.219247 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51b78f-5493-40bb-9345-61c170813399 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:59.219642 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51b78f-5493-40bb-9345-61c170813399 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:59.219918 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51b78f-5493-40bb-9345-61c170813399 None admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:59.220722 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a51b78f-5493-40bb-9345-61c170813399 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:06:59.221060 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a51b78f-5493-40bb-9345-61c170813399 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:59.222449 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a51b78f-5493-40bb-9345-61c170813399 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:59.232063 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:59.237235 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 232/467] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:06:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:06:59.238629 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f9353-d918-4055-ba81-dac8820a484e None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:59.238989 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f9353-d918-4055-ba81-dac8820a484e None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:59.239202 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f9353-d918-4055-ba81-dac8820a484e None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:59.242426 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 233/468] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:59.242426 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f9353-d918-4055-ba81-dac8820a484e None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:59.267745 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b330636-fb7b-489e-8d66-5949143282ad None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:59.305497 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f6e0f-17bd-4557-b3a8-3eb48239468a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:59.306100 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f6e0f-17bd-4557-b3a8-3eb48239468a None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:59.306406 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f6e0f-17bd-4557-b3a8-3eb48239468a None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:59.306694 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f6e0f-17bd-4557-b3a8-3eb48239468a None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:59.307334 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f6e0f-17bd-4557-b3a8-3eb48239468a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:59.308775 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f6e0f-17bd-4557-b3a8-3eb48239468a None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:59.317690 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:59.331246 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 236/469] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Sep 21 12:06:59 2022] POST /identity/v3/users => generated 246 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:06:59.332055 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f6e0f-17bd-4557-b3a8-3eb48239468a None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:06:59.362640 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f9353-d918-4055-ba81-dac8820a484e None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:59.413201 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c669ec-cb8b-4c9f-b345-bcd480d7d0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:59.413846 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c669ec-cb8b-4c9f-b345-bcd480d7d0bb None admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:59.414191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c669ec-cb8b-4c9f-b345-bcd480d7d0bb None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:59.415051 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c669ec-cb8b-4c9f-b345-bcd480d7d0bb None admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:59.415786 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c669ec-cb8b-4c9f-b345-bcd480d7d0bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:59.418013 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c669ec-cb8b-4c9f-b345-bcd480d7d0bb None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:59.450604 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 234/470] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Sep 21 12:06:59 2022] POST /identity/v3/users => generated 248 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:06:59.452655 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea275d7b-ef3f-417c-a47b-c54064269bfd None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:59.453147 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea275d7b-ef3f-417c-a47b-c54064269bfd None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:59.453588 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea275d7b-ef3f-417c-a47b-c54064269bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:59.499059 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-ea275d7b-ef3f-417c-a47b-c54064269bfd None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:59.502300 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-ea275d7b-ef3f-417c-a47b-c54064269bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:59.513316 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f6e0f-17bd-4557-b3a8-3eb48239468a None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:06:59.580479 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318312e5-4cc8-4de1-ae9c-ad64487c909c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:06:59.580998 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:59.582184 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318312e5-4cc8-4de1-ae9c-ad64487c909c None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:59.582728 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318312e5-4cc8-4de1-ae9c-ad64487c909c None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:59.583284 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318312e5-4cc8-4de1-ae9c-ad64487c909c None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:59.584115 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318312e5-4cc8-4de1-ae9c-ad64487c909c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:06:59.587339 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318312e5-4cc8-4de1-ae9c-ad64487c909c None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:06:59.605776 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 235/471] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:06:59.615836 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 237/472] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Sep 21 12:06:59 2022] POST /identity/v3/users => generated 248 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:06:59.659333 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd26b94-1c8c-4a9d-9322-7c1667d8a3e0 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:59.659616 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd26b94-1c8c-4a9d-9322-7c1667d8a3e0 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:59.659892 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd26b94-1c8c-4a9d-9322-7c1667d8a3e0 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:59.661622 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 236/473] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:06:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:06:59.667906 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da81b34-57f3-4695-8f9c-d5c71e8bac36 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:06:59.668145 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da81b34-57f3-4695-8f9c-d5c71e8bac36 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:06:59.668377 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da81b34-57f3-4695-8f9c-d5c71e8bac36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:06:59.689343 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-3da81b34-57f3-4695-8f9c-d5c71e8bac36 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:06:59.690647 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-3da81b34-57f3-4695-8f9c-d5c71e8bac36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:06:59.741866 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:06:59.769224 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 238/474] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:06:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:06:59.910716 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd26b94-1c8c-4a9d-9322-7c1667d8a3e0 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:00.020954 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd26b94-1c8c-4a9d-9322-7c1667d8a3e0 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:00.049290 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da81b34-57f3-4695-8f9c-d5c71e8bac36 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:00.057498 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15336a1-e156-45eb-8997-7f6b94c6c6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:00.058143 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15336a1-e156-45eb-8997-7f6b94c6c6c1 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:00.058446 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15336a1-e156-45eb-8997-7f6b94c6c6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:00.058724 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15336a1-e156-45eb-8997-7f6b94c6c6c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:00.070038 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15336a1-e156-45eb-8997-7f6b94c6c6c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:00.071751 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15336a1-e156-45eb-8997-7f6b94c6c6c1 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:00.091325 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-e15336a1-e156-45eb-8997-7f6b94c6c6c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:00.091325 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:00.091325 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:00.091325 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:00.091325 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:00.091325 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:00.091325 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:00.091325 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:00.091325 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:00.091325 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:00.091325 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:00.091325 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:00.091325 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:00.091325 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:00.091325 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:00.091325 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:00.092264 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:00.092264 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:00.092264 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:00.092264 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:00.092264 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:00.092264 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:00.092264 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:00.092264 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:00.092264 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:00.092264 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:00.092264 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:00.092264 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:00.092264 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:00.092264 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:00.092264 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:00.092264 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:00.092264 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:00.093115 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:00.093115 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:00.093115 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:00.093115 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 237/475] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:06:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:00.098628 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15336a1-e156-45eb-8997-7f6b94c6c6c1 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:00.144386 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:00.203027 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da81b34-57f3-4695-8f9c-d5c71e8bac36 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:00.217120 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15336a1-e156-45eb-8997-7f6b94c6c6c1 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:00.255375 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e6dcb-73a1-479b-aef9-79766b262846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:00.255991 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e6dcb-73a1-479b-aef9-79766b262846 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:00.256264 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e6dcb-73a1-479b-aef9-79766b262846 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:00.256522 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e6dcb-73a1-479b-aef9-79766b262846 None admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:00.257201 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e6dcb-73a1-479b-aef9-79766b262846 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:00.257471 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e6dcb-73a1-479b-aef9-79766b262846 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:00.259243 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e6dcb-73a1-479b-aef9-79766b262846 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:00.272128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 238/476] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:07:00.277168 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e6dcb-73a1-479b-aef9-79766b262846 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:00.279375 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b179ad1-0b5f-4447-9bfa-be008e5b2183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:00.280177 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b179ad1-0b5f-4447-9bfa-be008e5b2183 None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:00.280679 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b179ad1-0b5f-4447-9bfa-be008e5b2183 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:00.281093 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b179ad1-0b5f-4447-9bfa-be008e5b2183 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:00.282019 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b179ad1-0b5f-4447-9bfa-be008e5b2183 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:00.283565 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b179ad1-0b5f-4447-9bfa-be008e5b2183 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:00.300454 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.sql.core [None req-2b179ad1-0b5f-4447-9bfa-be008e5b2183 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 21 12:07:00.300454 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 21 12:07:00.300454 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [parameters: {'id': 'f70344b15e104b1b908370f685e58c88', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 21 12:07:00.300454 dv-cinder-858678-1-smb devstack@keystone.service[81378]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81378) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 21 12:07:00.329545 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-2b179ad1-0b5f-4447-9bfa-be008e5b2183 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 21 12:07:00.329545 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:00.329545 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 21 12:07:00.329545 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 21 12:07:00.329545 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 21 12:07:00.329545 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 21 12:07:00.329545 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 21 12:07:00.329545 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application result = self._query(query) Sep 21 12:07:00.329545 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 21 12:07:00.329545 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application conn.query(q) Sep 21 12:07:00.329545 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 21 12:07:00.329545 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 21 12:07:00.329545 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 21 12:07:00.329545 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application result.read() Sep 21 12:07:00.329545 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 21 12:07:00.330664 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 21 12:07:00.330664 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 21 12:07:00.330664 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 21 12:07:00.330664 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 21 12:07:00.330664 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 21 12:07:00.330664 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 21 12:07:00.330664 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 21 12:07:00.330664 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 21 12:07:00.330664 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:00.330664 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 21 12:07:00.330664 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:00.330664 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:00.330664 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 21 12:07:00.330664 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 21 12:07:00.330664 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 21 12:07:00.330664 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return ref.to_dict() Sep 21 12:07:00.330664 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 21 12:07:00.330664 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application next(self.gen) Sep 21 12:07:00.331796 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 21 12:07:00.331796 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application yield resource Sep 21 12:07:00.331796 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 21 12:07:00.331796 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application next(self.gen) Sep 21 12:07:00.331796 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 21 12:07:00.331796 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self.session.rollback() Sep 21 12:07:00.331796 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 21 12:07:00.331796 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self.force_reraise() Sep 21 12:07:00.331796 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 21 12:07:00.331796 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise self.value Sep 21 12:07:00.331796 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 21 12:07:00.331796 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 21 12:07:00.331796 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 21 12:07:00.331796 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application session.commit() Sep 21 12:07:00.331796 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 21 12:07:00.331796 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 21 12:07:00.331796 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 21 12:07:00.332868 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._prepare_impl() Sep 21 12:07:00.332868 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 21 12:07:00.332868 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self.session.flush() Sep 21 12:07:00.332868 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 21 12:07:00.332868 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._flush(objects) Sep 21 12:07:00.332868 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 21 12:07:00.332868 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 21 12:07:00.332868 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 21 12:07:00.332868 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application compat.raise_( Sep 21 12:07:00.332868 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 21 12:07:00.332868 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception Sep 21 12:07:00.332868 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 21 12:07:00.332868 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application flush_context.execute() Sep 21 12:07:00.332868 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 21 12:07:00.332868 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rec.execute(self) Sep 21 12:07:00.332868 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 21 12:07:00.332868 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 21 12:07:00.333875 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 21 12:07:00.333875 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 21 12:07:00.333875 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 21 12:07:00.333875 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 21 12:07:00.333875 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 21 12:07:00.333875 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 21 12:07:00.333875 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 21 12:07:00.333875 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 21 12:07:00.333875 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 21 12:07:00.333875 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 21 12:07:00.333875 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 21 12:07:00.333875 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 21 12:07:00.333875 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 21 12:07:00.333875 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 21 12:07:00.333875 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 21 12:07:00.333875 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception Sep 21 12:07:00.343036 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 21 12:07:00.343036 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 21 12:07:00.343036 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 21 12:07:00.343036 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 21 12:07:00.343036 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 21 12:07:00.343036 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application result = self._query(query) Sep 21 12:07:00.343036 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 21 12:07:00.343036 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application conn.query(q) Sep 21 12:07:00.343036 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 21 12:07:00.343036 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 21 12:07:00.343036 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 21 12:07:00.343036 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application result.read() Sep 21 12:07:00.343036 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 21 12:07:00.343036 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 21 12:07:00.343036 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 21 12:07:00.343036 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 21 12:07:00.344018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 21 12:07:00.344018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 21 12:07:00.344018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 21 12:07:00.344018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 21 12:07:00.344018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 21 12:07:00.344018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 21 12:07:00.344018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [parameters: {'id': 'f70344b15e104b1b908370f685e58c88', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 21 12:07:00.344018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 21 12:07:00.344018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:00.344018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 12:07:00.344018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:00.344018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:00.344018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:00.344018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:00.344018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:00.344018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:00.344989 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:00.344989 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:00.344989 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:00.344989 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:00.344989 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:00.344989 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:00.344989 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 21 12:07:00.344989 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 21 12:07:00.344989 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:00.344989 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:00.344989 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 21 12:07:00.344989 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 21 12:07:00.344989 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 21 12:07:00.344989 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 21 12:07:00.344989 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 21 12:07:00.344989 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:00.347965 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 239/477] 10.222.0.60 () {60 vars in 1131 bytes} [Wed Sep 21 12:07:00 2022] POST /identity/v3/roles => generated 144 bytes in 299 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:00.356054 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b179ad1-0b5f-4447-9bfa-be008e5b2183 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:00.423962 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:00.461100 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:00.472508 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e6dcb-73a1-479b-aef9-79766b262846 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:00.489468 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b179ad1-0b5f-4447-9bfa-be008e5b2183 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:00.526198 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8acde-52e5-43b2-936b-a1f5507ebb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:00.526885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8acde-52e5-43b2-936b-a1f5507ebb7c None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:00.527239 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8acde-52e5-43b2-936b-a1f5507ebb7c None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:00.527585 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8acde-52e5-43b2-936b-a1f5507ebb7c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:00.538849 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8acde-52e5-43b2-936b-a1f5507ebb7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:07:00.544783 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-a8c8acde-52e5-43b2-936b-a1f5507ebb7c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 12:07:00.544783 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:00.544783 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:00.544783 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:00.544783 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:00.544783 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:00.544783 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:00.544783 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:00.544783 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:00.544783 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:00.544783 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:00.544783 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:00.544783 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:07:00.544783 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:07:00.544783 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:07:00.544783 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:07:00.545680 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:07:00.545680 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:07:00.545680 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:07:00.545680 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:07:00.545680 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:00.545680 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:00.545680 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:00.545680 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:00.545680 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:00.545680 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:00.545680 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:00.545680 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:00.545680 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:00.545680 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:00.545680 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:00.545680 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:00.546499 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:00.546499 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:00.546499 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:00.546499 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:00.546499 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:07:00.546499 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:07:00.546499 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:07:00.546499 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:07:00.546499 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:07:00.546499 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:07:00.546499 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 21 12:07:00.546499 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:00.546499 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 240/478] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Sep 21 12:07:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 12:07:00.552557 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8acde-52e5-43b2-936b-a1f5507ebb7c None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:00.627179 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a093e-69e0-4a4f-9e29-4fb8add959f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:00.627814 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a093e-69e0-4a4f-9e29-4fb8add959f6 None admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:00.628096 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a093e-69e0-4a4f-9e29-4fb8add959f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:00.628369 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a093e-69e0-4a4f-9e29-4fb8add959f6 None admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:00.629035 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a093e-69e0-4a4f-9e29-4fb8add959f6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:00.630520 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a093e-69e0-4a4f-9e29-4fb8add959f6 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:00.666448 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8acde-52e5-43b2-936b-a1f5507ebb7c None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:00.669331 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:00.697269 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 239/479] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Sep 21 12:07:00 2022] POST /identity/v3/users => generated 249 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:07:00.705745 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa904f49-4870-44a8-8f8a-e02cb3398f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:00.706384 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa904f49-4870-44a8-8f8a-e02cb3398f8d None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:00.706677 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa904f49-4870-44a8-8f8a-e02cb3398f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:00.706947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa904f49-4870-44a8-8f8a-e02cb3398f8d None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:00.707631 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa904f49-4870-44a8-8f8a-e02cb3398f8d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:00.707930 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa904f49-4870-44a8-8f8a-e02cb3398f8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:00.709353 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa904f49-4870-44a8-8f8a-e02cb3398f8d None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:00.719316 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 241/480] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:07:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:07:02.084786 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17aac49-deed-4140-a05b-b4a1db7d0cea None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:02.085558 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17aac49-deed-4140-a05b-b4a1db7d0cea None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:02.085558 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17aac49-deed-4140-a05b-b4a1db7d0cea None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:02.087611 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 240/481] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:07:02.094305 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46ce6b-4051-4cbc-8659-7df62960f10c None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:02.095784 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46ce6b-4051-4cbc-8659-7df62960f10c None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:02.096557 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46ce6b-4051-4cbc-8659-7df62960f10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:02.137642 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-db46ce6b-4051-4cbc-8659-7df62960f10c None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:02.140342 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-db46ce6b-4051-4cbc-8659-7df62960f10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:02.303921 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 242/482] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 12:07:02.660671 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17aac49-deed-4140-a05b-b4a1db7d0cea None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:02.765431 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08888ecb-9f50-44ef-a803-a68356e446e1 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:02.765869 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08888ecb-9f50-44ef-a803-a68356e446e1 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:02.766233 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08888ecb-9f50-44ef-a803-a68356e446e1 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:02.767815 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 243/483] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:07:02.780122 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7b5ae-1a09-4f0a-a640-ea52749b4be9 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:02.780546 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7b5ae-1a09-4f0a-a640-ea52749b4be9 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:02.780914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7b5ae-1a09-4f0a-a640-ea52749b4be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:02.822009 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-5aa7b5ae-1a09-4f0a-a640-ea52749b4be9 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:02.823670 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-5aa7b5ae-1a09-4f0a-a640-ea52749b4be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:02.864169 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17aac49-deed-4140-a05b-b4a1db7d0cea None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:02.927141 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3055cc-5fc8-456f-af67-88265c329a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:02.928054 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3055cc-5fc8-456f-af67-88265c329a0f None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:02.929107 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3055cc-5fc8-456f-af67-88265c329a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:02.929522 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3055cc-5fc8-456f-af67-88265c329a0f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:02.944560 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 244/484] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 12:07:02.945025 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3055cc-5fc8-456f-af67-88265c329a0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:07:02.947114 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd1e96-ffc0-4673-9b87-2050af6630db None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:02.947676 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd1e96-ffc0-4673-9b87-2050af6630db None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:02.948215 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd1e96-ffc0-4673-9b87-2050af6630db None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:02.949954 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 245/485] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:07:02.955369 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-6a3055cc-5fc8-456f-af67-88265c329a0f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 12:07:02.955369 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:02.955369 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:02.955369 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:02.955369 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:02.955369 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:02.955369 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:02.955369 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:02.955369 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:02.955369 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:02.955369 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:02.955369 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:02.955369 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:07:02.955369 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:07:02.955369 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:07:02.955369 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:07:02.956272 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:07:02.956272 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:07:02.956272 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:07:02.956272 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:07:02.956272 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:02.956272 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:02.956272 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:02.956272 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:02.956272 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:02.956272 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:02.956272 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:02.956272 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:02.956272 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:02.956272 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:02.956272 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:02.956272 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:02.957071 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:02.957071 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:02.957071 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:02.957071 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:02.957071 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:07:02.957071 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:07:02.957071 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:07:02.957071 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:07:02.957071 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:07:02.957071 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:07:02.957071 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 12:07:02.957071 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:02.959652 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 241/486] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Sep 21 12:07:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:02.970440 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d809f-faf8-40af-8f41-8a1ac1f6627a None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:02.970440 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d809f-faf8-40af-8f41-8a1ac1f6627a None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:02.970440 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d809f-faf8-40af-8f41-8a1ac1f6627a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:02.971919 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3055cc-5fc8-456f-af67-88265c329a0f None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:02.999040 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:03.002385 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-a58d809f-faf8-40af-8f41-8a1ac1f6627a None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:03.003787 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a58d809f-faf8-40af-8f41-8a1ac1f6627a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:03.043079 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:03.092170 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3055cc-5fc8-456f-af67-88265c329a0f None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:03.127329 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 246/487] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:07:03.135645 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88c0ed-38de-4496-9291-48b567bc271f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:03.136264 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88c0ed-38de-4496-9291-48b567bc271f None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:03.136542 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88c0ed-38de-4496-9291-48b567bc271f None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:03.136812 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88c0ed-38de-4496-9291-48b567bc271f None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:03.137474 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd88c0ed-38de-4496-9291-48b567bc271f None admin] RBAC: Adding query filter params (name=service) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:03.137771 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd88c0ed-38de-4496-9291-48b567bc271f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:03.139437 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd88c0ed-38de-4496-9291-48b567bc271f None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:03.154316 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 242/488] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Sep 21 12:07:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:03.159621 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d809f-faf8-40af-8f41-8a1ac1f6627a None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:03.270103 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d809f-faf8-40af-8f41-8a1ac1f6627a None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:03.307132 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556b70d-900a-4542-adfb-4d12c5c3930d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:03.308141 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556b70d-900a-4542-adfb-4d12c5c3930d None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:03.308626 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556b70d-900a-4542-adfb-4d12c5c3930d None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:03.309123 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556b70d-900a-4542-adfb-4d12c5c3930d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:03.320209 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d556b70d-900a-4542-adfb-4d12c5c3930d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:03.322015 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d556b70d-900a-4542-adfb-4d12c5c3930d None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:03.333008 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88c0ed-38de-4496-9291-48b567bc271f None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:03.338709 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-d556b70d-900a-4542-adfb-4d12c5c3930d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:03.338709 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:03.338709 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:03.338709 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:03.338709 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:03.338709 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:03.338709 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:03.338709 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:03.338709 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:03.338709 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:03.338709 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:03.338709 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:03.338709 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:03.338709 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:03.338709 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:03.338709 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:03.339829 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:03.339829 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:03.339829 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:03.339829 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:03.339829 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:03.339829 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:03.339829 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:03.339829 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:03.339829 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:03.339829 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:03.339829 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:03.339829 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:03.339829 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:03.339829 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:03.339829 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:03.339829 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:03.339829 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:03.340955 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:03.340955 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:03.340955 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:03.343103 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 247/489] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:03.350384 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556b70d-900a-4542-adfb-4d12c5c3930d None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:03.362500 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:03.459382 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:03.492296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88c0ed-38de-4496-9291-48b567bc271f None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:03.541930 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757636be-b4df-4347-b3da-58d33d17d244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:03.542784 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757636be-b4df-4347-b3da-58d33d17d244 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:03.543065 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757636be-b4df-4347-b3da-58d33d17d244 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:03.543337 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757636be-b4df-4347-b3da-58d33d17d244 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:03.547605 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556b70d-900a-4542-adfb-4d12c5c3930d None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:03.564964 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757636be-b4df-4347-b3da-58d33d17d244 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:07:03.580871 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-757636be-b4df-4347-b3da-58d33d17d244 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 12:07:03.580871 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:03.580871 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:03.580871 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:03.580871 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:03.580871 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:03.580871 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:03.580871 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:03.580871 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:03.580871 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:03.580871 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:03.580871 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:03.580871 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:07:03.580871 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:07:03.580871 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:07:03.580871 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:07:03.581894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:07:03.581894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:07:03.581894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:07:03.581894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:07:03.581894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:03.581894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:03.581894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:03.581894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:03.581894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:03.581894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:03.581894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:03.581894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:03.581894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:03.581894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:03.581894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:03.581894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:03.582737 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:03.582737 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:03.582737 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:03.582737 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:03.582737 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:07:03.582737 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:07:03.582737 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:07:03.582737 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:07:03.582737 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:07:03.582737 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:07:03.582737 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 12:07:03.582737 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:03.583348 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 243/490] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Sep 21 12:07:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:03.584269 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757636be-b4df-4347-b3da-58d33d17d244 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:03.595063 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f30982-ac64-4a79-9c22-da7a114f58d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:03.596037 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f30982-ac64-4a79-9c22-da7a114f58d2 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:03.596545 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f30982-ac64-4a79-9c22-da7a114f58d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:03.597030 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f30982-ac64-4a79-9c22-da7a114f58d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:03.597910 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f30982-ac64-4a79-9c22-da7a114f58d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:03.598470 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f30982-ac64-4a79-9c22-da7a114f58d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:03.600682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f30982-ac64-4a79-9c22-da7a114f58d2 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:03.615204 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 248/491] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:03.616361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f30982-ac64-4a79-9c22-da7a114f58d2 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:03.722819 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:03.731586 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757636be-b4df-4347-b3da-58d33d17d244 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:03.743787 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f30982-ac64-4a79-9c22-da7a114f58d2 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:03.771230 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e199c4-0b0e-49e9-80d9-b021c671948d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:03.771853 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e199c4-0b0e-49e9-80d9-b021c671948d None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:03.772146 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e199c4-0b0e-49e9-80d9-b021c671948d None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:03.772395 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e199c4-0b0e-49e9-80d9-b021c671948d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:03.776030 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:03.781189 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa41628-f9da-49dc-82b3-02d526380877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:03.781905 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa41628-f9da-49dc-82b3-02d526380877 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:03.782266 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa41628-f9da-49dc-82b3-02d526380877 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:03.782596 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa41628-f9da-49dc-82b3-02d526380877 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:03.783265 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa41628-f9da-49dc-82b3-02d526380877 None admin] RBAC: Adding query filter params (name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:03.783569 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa41628-f9da-49dc-82b3-02d526380877 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:03.784936 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa41628-f9da-49dc-82b3-02d526380877 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:03.785330 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e199c4-0b0e-49e9-80d9-b021c671948d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:07:03.792381 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-a1e199c4-0b0e-49e9-80d9-b021c671948d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 12:07:03.792381 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:03.792381 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:03.792381 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:03.792381 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:03.792381 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:03.792381 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:03.792381 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:03.792381 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:03.792381 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:03.792381 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:03.792381 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:03.792381 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:07:03.792381 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:07:03.792381 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:07:03.792381 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:07:03.793273 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:07:03.793273 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:07:03.793273 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:07:03.793273 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:07:03.793273 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:03.793273 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:03.793273 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:03.793273 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:03.793273 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:03.793273 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:03.793273 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:03.793273 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:03.793273 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:03.793273 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:03.793273 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:03.793273 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:03.794041 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:03.794041 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:03.794041 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:03.794041 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:03.794041 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:07:03.794041 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:07:03.794041 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:07:03.794041 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:07:03.794041 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:07:03.794041 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:07:03.794041 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 12:07:03.794041 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:03.794041 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 244/492] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Sep 21 12:07:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:03.795385 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e199c4-0b0e-49e9-80d9-b021c671948d None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:03.805637 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 249/493] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Sep 21 12:07:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:03.805637 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f7858-84e0-471d-a862-105e463d3641 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:03.805637 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f7858-84e0-471d-a862-105e463d3641 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:03.805637 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f7858-84e0-471d-a862-105e463d3641 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:03.805637 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 250/494] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:07:03.805637 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f7858-84e0-471d-a862-105e463d3641 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:03.896892 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e199c4-0b0e-49e9-80d9-b021c671948d None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:03.907897 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f7858-84e0-471d-a862-105e463d3641 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:03.930264 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c83dd8-1663-4d1c-ba87-483d0ee0b4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:03.930919 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c83dd8-1663-4d1c-ba87-483d0ee0b4c7 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:03.931191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c83dd8-1663-4d1c-ba87-483d0ee0b4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:03.931469 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c83dd8-1663-4d1c-ba87-483d0ee0b4c7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:03.934693 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:03.939172 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c83dd8-1663-4d1c-ba87-483d0ee0b4c7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:03.940618 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c83dd8-1663-4d1c-ba87-483d0ee0b4c7 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:03.943425 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f06f5-35e1-4c81-ad78-ee364bfb34f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:03.944020 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f06f5-35e1-4c81-ad78-ee364bfb34f6 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:03.944297 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f06f5-35e1-4c81-ad78-ee364bfb34f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:03.944564 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f06f5-35e1-4c81-ad78-ee364bfb34f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:03.945220 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062f06f5-35e1-4c81-ad78-ee364bfb34f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:03.946064 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062f06f5-35e1-4c81-ad78-ee364bfb34f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:03.947414 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062f06f5-35e1-4c81-ad78-ee364bfb34f6 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:03.953712 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-09c83dd8-1663-4d1c-ba87-483d0ee0b4c7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 21 12:07:03.953712 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:03.953712 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:03.953712 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:03.953712 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:03.953712 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:03.953712 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:03.953712 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:03.953712 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:03.953712 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:03.953712 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:03.953712 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:03.953712 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 12:07:03.953712 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 12:07:03.953712 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 12:07:03.953712 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 12:07:03.954720 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:03.954720 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:03.954720 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 12:07:03.954720 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:03.954720 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 12:07:03.954720 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:03.954720 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:03.954720 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:03.954720 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:03.954720 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:03.954720 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:03.954720 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:03.954720 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:03.954720 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:03.954720 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:03.954720 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:03.954720 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:03.954720 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:03.955979 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:03.955979 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:03.955979 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 12:07:03.955979 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 12:07:03.955979 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 12:07:03.955979 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 12:07:03.955979 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 12:07:03.955979 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 12:07:03.955979 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 21 12:07:03.955979 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:03.955979 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 245/495] 10.222.0.60 () {56 vars in 1093 bytes} [Wed Sep 21 12:07:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:03.956533 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 251/496] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Sep 21 12:07:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:03.956598 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be82f12-46b7-4ce3-9ff9-c6872c25ff80 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:03.956598 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be82f12-46b7-4ce3-9ff9-c6872c25ff80 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:03.956727 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f06f5-35e1-4c81-ad78-ee364bfb34f6 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:03.956800 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be82f12-46b7-4ce3-9ff9-c6872c25ff80 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:03.958478 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 246/497] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:07:03.961090 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175a4fd-555d-45f0-be55-2705f033cd85 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:03.962232 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175a4fd-555d-45f0-be55-2705f033cd85 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:03.962781 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175a4fd-555d-45f0-be55-2705f033cd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:03.980904 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-6175a4fd-555d-45f0-be55-2705f033cd85 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:03.982353 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-6175a4fd-555d-45f0-be55-2705f033cd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:04.033828 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:04.050589 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 247/498] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:07:04.051728 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175a4fd-555d-45f0-be55-2705f033cd85 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:04.054500 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f06f5-35e1-4c81-ad78-ee364bfb34f6 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:04.091641 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83a1fe-aa39-485b-9007-e404efca8b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:04.092273 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83a1fe-aa39-485b-9007-e404efca8b1a None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:04.092555 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83a1fe-aa39-485b-9007-e404efca8b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:04.092832 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83a1fe-aa39-485b-9007-e404efca8b1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:04.103539 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f83a1fe-aa39-485b-9007-e404efca8b1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:04.104988 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f83a1fe-aa39-485b-9007-e404efca8b1a None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:04.119401 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-6f83a1fe-aa39-485b-9007-e404efca8b1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:04.119401 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:04.119401 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:04.119401 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:04.119401 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:04.119401 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:04.119401 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:04.119401 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:04.119401 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:04.119401 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:04.119401 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:04.119401 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:04.119401 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:04.119401 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:04.119401 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:04.119401 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:04.120366 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:04.120366 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:04.120366 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:04.120366 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:04.120366 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:04.120366 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:04.120366 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:04.120366 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:04.120366 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:04.120366 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:04.120366 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:04.120366 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:04.120366 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:04.120366 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:04.120366 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:04.120366 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:04.120366 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:04.121215 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:04.121215 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:04.121215 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:04.121215 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 252/499] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:04.121779 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2291a-405f-42e3-978e-0f247903a85f None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:04.121957 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2291a-405f-42e3-978e-0f247903a85f None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:04.122240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2291a-405f-42e3-978e-0f247903a85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:04.142001 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-7de2291a-405f-42e3-978e-0f247903a85f None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:04.143492 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7de2291a-405f-42e3-978e-0f247903a85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:04.179673 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:04.180880 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175a4fd-555d-45f0-be55-2705f033cd85 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:04.215742 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 253/500] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:07:04.216610 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2291a-405f-42e3-978e-0f247903a85f None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:04.240881 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650eed2-be25-4566-83dd-757c7e196f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:04.241834 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650eed2-be25-4566-83dd-757c7e196f63 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:04.242124 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650eed2-be25-4566-83dd-757c7e196f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:04.243088 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650eed2-be25-4566-83dd-757c7e196f63 None admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:04.243891 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1650eed2-be25-4566-83dd-757c7e196f63 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:04.244198 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1650eed2-be25-4566-83dd-757c7e196f63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:04.246183 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1650eed2-be25-4566-83dd-757c7e196f63 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:04.296253 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 248/501] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Sep 21 12:07:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:04.298132 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650eed2-be25-4566-83dd-757c7e196f63 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:04.337322 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2291a-405f-42e3-978e-0f247903a85f None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:04.358651 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:04.375034 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037c3bf-fa7f-4b02-92bc-376fefe56bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:04.375803 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037c3bf-fa7f-4b02-92bc-376fefe56bf4 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:04.376392 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037c3bf-fa7f-4b02-92bc-376fefe56bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:04.376669 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037c3bf-fa7f-4b02-92bc-376fefe56bf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:04.389068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a037c3bf-fa7f-4b02-92bc-376fefe56bf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:04.390540 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a037c3bf-fa7f-4b02-92bc-376fefe56bf4 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:04.406877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-a037c3bf-fa7f-4b02-92bc-376fefe56bf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:04.406877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:04.406877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:04.406877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:04.406877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:04.406877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:04.406877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:04.406877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:04.406877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:04.406877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:04.406877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:04.406877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:04.406877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:04.406877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:04.406877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:04.406877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:04.408018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:04.408018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:04.408018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:04.408018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:04.408018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:04.408018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:04.408018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:04.408018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:04.408018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:04.408018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:04.408018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:04.408018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:04.408018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:04.408018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:04.408018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:04.408018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:04.408018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:04.408994 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:04.408994 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:04.408994 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:04.414162 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 254/502] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:04.414162 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037c3bf-fa7f-4b02-92bc-376fefe56bf4 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:04.420871 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650eed2-be25-4566-83dd-757c7e196f63 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:04.442775 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:04.458656 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882bf06-f8b5-43ce-9e7f-ee6365e22a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:04.459267 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882bf06-f8b5-43ce-9e7f-ee6365e22a5f None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:04.459546 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882bf06-f8b5-43ce-9e7f-ee6365e22a5f None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:04.459819 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882bf06-f8b5-43ce-9e7f-ee6365e22a5f None admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:04.460464 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9882bf06-f8b5-43ce-9e7f-ee6365e22a5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:04.460770 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9882bf06-f8b5-43ce-9e7f-ee6365e22a5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:04.462754 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9882bf06-f8b5-43ce-9e7f-ee6365e22a5f None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:04.474788 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 249/503] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:04.475440 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882bf06-f8b5-43ce-9e7f-ee6365e22a5f None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:04.527928 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037c3bf-fa7f-4b02-92bc-376fefe56bf4 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:04.565969 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e921d-89b9-4e77-b130-24a7c410ffcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:04.566608 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e921d-89b9-4e77-b130-24a7c410ffcb None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:04.566883 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e921d-89b9-4e77-b130-24a7c410ffcb None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:04.567147 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e921d-89b9-4e77-b130-24a7c410ffcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:04.577318 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882bf06-f8b5-43ce-9e7f-ee6365e22a5f None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:04.580143 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:04.611991 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74231c01-8d44-42fe-9aa7-0e9a878bdeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:04.612652 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74231c01-8d44-42fe-9aa7-0e9a878bdeb9 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:04.612935 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74231c01-8d44-42fe-9aa7-0e9a878bdeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:04.613213 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74231c01-8d44-42fe-9aa7-0e9a878bdeb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:04.625289 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74231c01-8d44-42fe-9aa7-0e9a878bdeb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:04.626803 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74231c01-8d44-42fe-9aa7-0e9a878bdeb9 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:04.641434 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e921d-89b9-4e77-b130-24a7c410ffcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:04.643057 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e921d-89b9-4e77-b130-24a7c410ffcb None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:04.651329 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-74231c01-8d44-42fe-9aa7-0e9a878bdeb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:04.651329 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:04.651329 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:04.651329 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:04.651329 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:04.651329 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:04.651329 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:04.651329 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:04.651329 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:04.651329 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:04.651329 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:04.651329 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:04.651329 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:04.651329 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:04.651329 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:04.651329 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:04.652225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:04.652225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:04.652225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:04.652225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:04.652225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:04.652225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:04.652225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:04.652225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:04.652225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:04.652225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:04.652225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:04.652225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:04.652225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:04.652225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:04.652225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:04.652225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:04.652225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:04.653101 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:04.653101 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:04.653101 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:04.653413 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 250/504] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:04.654684 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74231c01-8d44-42fe-9aa7-0e9a878bdeb9 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:04.668830 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:04.743672 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 255/505] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:07:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 12:07:04.744503 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e921d-89b9-4e77-b130-24a7c410ffcb None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:04.761757 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74231c01-8d44-42fe-9aa7-0e9a878bdeb9 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:04.799592 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977dc797-818d-4bcd-925c-604ae5df063a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:04.800103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977dc797-818d-4bcd-925c-604ae5df063a None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:04.800380 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977dc797-818d-4bcd-925c-604ae5df063a None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:04.800646 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977dc797-818d-4bcd-925c-604ae5df063a None admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:04.801275 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977dc797-818d-4bcd-925c-604ae5df063a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:04.801573 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977dc797-818d-4bcd-925c-604ae5df063a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:04.802990 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977dc797-818d-4bcd-925c-604ae5df063a None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:04.815719 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 251/506] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:04.816561 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977dc797-818d-4bcd-925c-604ae5df063a None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:04.834422 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:04.850284 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e921d-89b9-4e77-b130-24a7c410ffcb None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:04.873507 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:04.884904 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8e48c-ced4-42ae-a7c1-5101819220ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:04.885602 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8e48c-ced4-42ae-a7c1-5101819220ee None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:04.885812 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8e48c-ced4-42ae-a7c1-5101819220ee None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:04.886086 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8e48c-ced4-42ae-a7c1-5101819220ee None admin] PATH_INFO: `/v3/users/glance` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:04.893463 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac8e48c-ced4-42ae-a7c1-5101819220ee None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:04.894967 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac8e48c-ced4-42ae-a7c1-5101819220ee None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:04.908273 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-4ac8e48c-ced4-42ae-a7c1-5101819220ee None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 21 12:07:04.908273 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:04.908273 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:04.908273 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:04.908273 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:04.908273 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:04.908273 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:04.908273 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:04.908273 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:04.908273 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:04.908273 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:04.908273 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:04.908273 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 12:07:04.908273 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 12:07:04.908273 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 12:07:04.908273 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 12:07:04.909361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:04.909361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:04.909361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 12:07:04.909361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:04.909361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 12:07:04.909361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:04.909361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:04.909361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:04.909361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:04.909361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:04.909361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:04.909361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:04.909361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:04.909361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:04.909361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:04.909361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:04.909361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:04.909361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:04.910298 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:04.910298 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:04.910298 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 12:07:04.910298 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 12:07:04.910298 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 12:07:04.910298 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 12:07:04.910298 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 12:07:04.910298 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 12:07:04.910298 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 21 12:07:04.910298 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:04.910298 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 256/507] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:07:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:04.910895 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8e48c-ced4-42ae-a7c1-5101819220ee None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:04.917977 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977dc797-818d-4bcd-925c-604ae5df063a None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:04.960389 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba96455-3be2-4e4f-b334-4cf365f80810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:04.961848 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba96455-3be2-4e4f-b334-4cf365f80810 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:04.962269 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba96455-3be2-4e4f-b334-4cf365f80810 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:04.962703 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba96455-3be2-4e4f-b334-4cf365f80810 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:04.977064 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba96455-3be2-4e4f-b334-4cf365f80810 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:07:04.983158 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-bba96455-3be2-4e4f-b334-4cf365f80810 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 12:07:04.983158 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:04.983158 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:04.983158 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:04.983158 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:04.983158 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:04.983158 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:04.983158 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:04.983158 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:04.983158 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:04.983158 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:04.983158 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:04.983158 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:07:04.983158 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:07:04.983158 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:07:04.983158 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:07:04.984196 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:07:04.984196 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:07:04.984196 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:07:04.984196 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:07:04.984196 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:04.984196 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:04.984196 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:04.984196 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:04.984196 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:04.984196 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:04.984196 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:04.984196 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:04.984196 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:04.984196 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:04.984196 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:04.984196 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:04.985040 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:04.985040 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:04.985040 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:04.985040 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:04.985040 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:07:04.985040 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:07:04.985040 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:07:04.985040 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:07:04.985040 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:07:04.985040 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:07:04.985040 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 12:07:04.985040 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:04.985040 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 252/508] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Sep 21 12:07:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:04.985689 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba96455-3be2-4e4f-b334-4cf365f80810 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:05.023698 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8e48c-ced4-42ae-a7c1-5101819220ee None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:05.061084 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054b25f-2c6c-4039-8423-ef7832af65f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:05.061601 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054b25f-2c6c-4039-8423-ef7832af65f4 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:05.061881 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054b25f-2c6c-4039-8423-ef7832af65f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:05.062157 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054b25f-2c6c-4039-8423-ef7832af65f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:05.062824 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054b25f-2c6c-4039-8423-ef7832af65f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:05.063122 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054b25f-2c6c-4039-8423-ef7832af65f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:05.064511 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054b25f-2c6c-4039-8423-ef7832af65f4 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:05.078395 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 257/509] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:05.079222 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054b25f-2c6c-4039-8423-ef7832af65f4 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:05.079355 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:05.104948 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba96455-3be2-4e4f-b334-4cf365f80810 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:05.127610 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:05.141238 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6addf781-3326-45ec-8a6e-91c89d8ebd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:05.141861 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6addf781-3326-45ec-8a6e-91c89d8ebd63 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:05.142139 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6addf781-3326-45ec-8a6e-91c89d8ebd63 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:05.142440 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6addf781-3326-45ec-8a6e-91c89d8ebd63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:05.152396 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6addf781-3326-45ec-8a6e-91c89d8ebd63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:05.153852 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6addf781-3326-45ec-8a6e-91c89d8ebd63 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:05.168593 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-6addf781-3326-45ec-8a6e-91c89d8ebd63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:05.168593 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:05.168593 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:05.168593 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:05.168593 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:05.168593 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:05.168593 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:05.168593 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:05.168593 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:05.168593 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:05.168593 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:05.168593 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:05.168593 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:05.168593 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:05.168593 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:05.168593 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:05.169785 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:05.169785 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:05.169785 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:05.169785 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:05.169785 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:05.169785 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:05.169785 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:05.169785 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:05.169785 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:05.169785 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:05.169785 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:05.169785 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:05.169785 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:05.169785 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:05.169785 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:05.169785 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:05.169785 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:05.171131 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:05.171131 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:05.171131 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:05.171131 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 253/510] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:05.171131 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6addf781-3326-45ec-8a6e-91c89d8ebd63 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:05.184556 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054b25f-2c6c-4039-8423-ef7832af65f4 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:05.220288 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6b0fb-50d4-402a-acf8-4093ce215642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:05.220905 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6b0fb-50d4-402a-acf8-4093ce215642 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:05.221186 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6b0fb-50d4-402a-acf8-4093ce215642 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:05.221461 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6b0fb-50d4-402a-acf8-4093ce215642 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:05.228672 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6b0fb-50d4-402a-acf8-4093ce215642 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:05.230123 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6b0fb-50d4-402a-acf8-4093ce215642 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:05.241478 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-25d6b0fb-50d4-402a-acf8-4093ce215642 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 21 12:07:05.241478 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:05.241478 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:05.241478 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:05.241478 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:05.241478 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:05.241478 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:05.241478 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:05.241478 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:05.241478 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:05.241478 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:05.241478 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:05.241478 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 12:07:05.241478 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 12:07:05.241478 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 12:07:05.241478 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 12:07:05.242982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:05.242982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:05.242982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 12:07:05.242982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:05.242982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 12:07:05.242982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:05.242982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:05.242982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:05.242982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:05.242982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:05.242982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:05.242982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:05.242982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:05.242982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:05.242982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:05.242982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:05.242982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:05.242982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:05.243881 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:05.243881 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:05.243881 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 12:07:05.243881 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 12:07:05.243881 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 12:07:05.243881 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 12:07:05.243881 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 12:07:05.243881 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 12:07:05.243881 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 21 12:07:05.243881 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:05.243881 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 258/511] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:07:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:05.243881 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6b0fb-50d4-402a-acf8-4093ce215642 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:05.271699 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6addf781-3326-45ec-8a6e-91c89d8ebd63 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:05.297249 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:05.306038 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff0da0-c009-4e5c-959b-fbd56cffcd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:05.306679 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff0da0-c009-4e5c-959b-fbd56cffcd58 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:05.306958 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff0da0-c009-4e5c-959b-fbd56cffcd58 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:05.307227 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff0da0-c009-4e5c-959b-fbd56cffcd58 None admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:05.307945 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff0da0-c009-4e5c-959b-fbd56cffcd58 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:05.308242 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff0da0-c009-4e5c-959b-fbd56cffcd58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:05.309671 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff0da0-c009-4e5c-959b-fbd56cffcd58 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:05.327054 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 254/512] 10.222.0.60 () {56 vars in 1137 bytes} [Wed Sep 21 12:07:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:05.327775 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff0da0-c009-4e5c-959b-fbd56cffcd58 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:05.354728 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6b0fb-50d4-402a-acf8-4093ce215642 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:05.357030 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:05.390311 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779a82e-ea7e-43d3-9544-dcf3addf201d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:05.390945 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779a82e-ea7e-43d3-9544-dcf3addf201d None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:05.391227 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779a82e-ea7e-43d3-9544-dcf3addf201d None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:05.391506 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779a82e-ea7e-43d3-9544-dcf3addf201d None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:05.392190 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c779a82e-ea7e-43d3-9544-dcf3addf201d None admin] RBAC: Adding query filter params (name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:05.392496 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c779a82e-ea7e-43d3-9544-dcf3addf201d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:05.393860 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c779a82e-ea7e-43d3-9544-dcf3addf201d None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:05.401678 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 259/513] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Sep 21 12:07:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:05.402513 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779a82e-ea7e-43d3-9544-dcf3addf201d None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:05.431717 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff0da0-c009-4e5c-959b-fbd56cffcd58 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:05.465992 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd920de-1785-4b58-a99e-0c4e93d5114e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:05.466617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd920de-1785-4b58-a99e-0c4e93d5114e None admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:05.466898 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd920de-1785-4b58-a99e-0c4e93d5114e None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:05.467171 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd920de-1785-4b58-a99e-0c4e93d5114e None admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:05.467801 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd920de-1785-4b58-a99e-0c4e93d5114e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:05.469228 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd920de-1785-4b58-a99e-0c4e93d5114e None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:05.490785 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 255/514] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Sep 21 12:07:05 2022] POST /identity/v3/users => generated 247 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:07:05.491730 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd920de-1785-4b58-a99e-0c4e93d5114e None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:05.507881 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779a82e-ea7e-43d3-9544-dcf3addf201d None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:05.544189 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:05.546226 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01ad6d-364a-4d5d-b2d9-1a47cd638030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:05.546876 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01ad6d-364a-4d5d-b2d9-1a47cd638030 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:05.547152 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01ad6d-364a-4d5d-b2d9-1a47cd638030 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:05.547418 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01ad6d-364a-4d5d-b2d9-1a47cd638030 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:05.548068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da01ad6d-364a-4d5d-b2d9-1a47cd638030 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:05.548366 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da01ad6d-364a-4d5d-b2d9-1a47cd638030 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:05.549781 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da01ad6d-364a-4d5d-b2d9-1a47cd638030 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:05.570253 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 260/515] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:05.570253 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01ad6d-364a-4d5d-b2d9-1a47cd638030 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:05.601865 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:05.623260 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd920de-1785-4b58-a99e-0c4e93d5114e None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:05.662981 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c48e88-37a0-4187-adcd-d15b47b49684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:05.663654 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c48e88-37a0-4187-adcd-d15b47b49684 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:05.664301 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c48e88-37a0-4187-adcd-d15b47b49684 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:05.664301 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c48e88-37a0-4187-adcd-d15b47b49684 None admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:05.665043 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c48e88-37a0-4187-adcd-d15b47b49684 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:05.665353 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c48e88-37a0-4187-adcd-d15b47b49684 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:05.666837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c48e88-37a0-4187-adcd-d15b47b49684 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:05.685740 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 256/516] 10.222.0.60 () {56 vars in 1137 bytes} [Wed Sep 21 12:07:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:05.686992 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c48e88-37a0-4187-adcd-d15b47b49684 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:05.695199 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01ad6d-364a-4d5d-b2d9-1a47cd638030 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:05.736187 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17e2ed-133d-446d-8df9-146d10d0462f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:05.737170 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17e2ed-133d-446d-8df9-146d10d0462f None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:05.737448 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17e2ed-133d-446d-8df9-146d10d0462f None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:05.737719 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17e2ed-133d-446d-8df9-146d10d0462f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:05.795311 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:05.799238 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c48e88-37a0-4187-adcd-d15b47b49684 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:05.814902 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af17e2ed-133d-446d-8df9-146d10d0462f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:05.816386 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af17e2ed-133d-446d-8df9-146d10d0462f None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:05.838544 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e19b18b-e452-430b-88da-a0a5a26cec5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:05.839181 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19b18b-e452-430b-88da-a0a5a26cec5f None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:05.839463 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19b18b-e452-430b-88da-a0a5a26cec5f None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:05.839738 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19b18b-e452-430b-88da-a0a5a26cec5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:05.850901 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e19b18b-e452-430b-88da-a0a5a26cec5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:05.852313 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:05.852424 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e19b18b-e452-430b-88da-a0a5a26cec5f None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:05.870112 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-2e19b18b-e452-430b-88da-a0a5a26cec5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:05.870112 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:05.870112 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:05.870112 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:05.870112 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:05.870112 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:05.870112 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:05.870112 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:05.870112 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:05.870112 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:05.870112 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:05.870112 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:05.870112 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:05.870112 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:05.870112 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:05.870112 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:05.871349 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:05.871349 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:05.871349 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:05.871349 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:05.871349 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:05.871349 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:05.871349 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:05.871349 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:05.871349 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:05.871349 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:05.871349 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:05.871349 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:05.871349 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:05.871349 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:05.871349 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:05.871349 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:05.871349 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:05.872506 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:05.872506 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:05.872506 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:05.875956 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 257/517] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:05.876812 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e19b18b-e452-430b-88da-a0a5a26cec5f None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:05.943306 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 261/518] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:07:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 12:07:05.944226 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17e2ed-133d-446d-8df9-146d10d0462f None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:05.981646 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e19b18b-e452-430b-88da-a0a5a26cec5f None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:06.018660 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5739b6c-4b7c-4a99-9eaa-7cf315d7b263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:06.019620 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5739b6c-4b7c-4a99-9eaa-7cf315d7b263 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:06.020080 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5739b6c-4b7c-4a99-9eaa-7cf315d7b263 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:06.020544 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5739b6c-4b7c-4a99-9eaa-7cf315d7b263 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:06.028170 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5739b6c-4b7c-4a99-9eaa-7cf315d7b263 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:06.029632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5739b6c-4b7c-4a99-9eaa-7cf315d7b263 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:06.042278 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-c5739b6c-4b7c-4a99-9eaa-7cf315d7b263 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:06.042278 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:06.042278 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:06.042278 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:06.042278 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:06.042278 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:06.042278 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:06.042278 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:06.042278 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:06.042278 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:06.042278 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:06.042278 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:06.042278 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 12:07:06.042278 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 12:07:06.042278 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 12:07:06.043169 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 12:07:06.043169 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:06.043169 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:06.043169 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:06.043169 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:06.043169 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:06.043169 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:06.043169 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:06.043169 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:06.043169 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:06.043169 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:06.043169 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:06.043169 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:06.043169 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:06.043169 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:06.043169 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:06.043169 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:06.044014 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 12:07:06.044014 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 12:07:06.044014 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 12:07:06.044014 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 12:07:06.044014 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 12:07:06.044014 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 12:07:06.044014 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:06.044014 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:06.044014 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 258/519] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:07:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:06.044496 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5739b6c-4b7c-4a99-9eaa-7cf315d7b263 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:06.059247 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17e2ed-133d-446d-8df9-146d10d0462f None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:06.059822 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:06.088794 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:06.103367 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe07be-c1b0-4c0e-b090-d9ea55ed2841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:06.104182 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe07be-c1b0-4c0e-b090-d9ea55ed2841 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:06.104602 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe07be-c1b0-4c0e-b090-d9ea55ed2841 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:06.105007 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe07be-c1b0-4c0e-b090-d9ea55ed2841 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:06.179717 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5739b6c-4b7c-4a99-9eaa-7cf315d7b263 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:06.234137 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ad17a-e273-431c-8905-bab16c97e408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:06.235221 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ad17a-e273-431c-8905-bab16c97e408 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:06.235729 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ad17a-e273-431c-8905-bab16c97e408 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:06.236259 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ad17a-e273-431c-8905-bab16c97e408 None admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:06.237243 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ad17a-e273-431c-8905-bab16c97e408 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:06.237817 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ad17a-e273-431c-8905-bab16c97e408 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:06.240391 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ad17a-e273-431c-8905-bab16c97e408 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:06.240780 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe07be-c1b0-4c0e-b090-d9ea55ed2841 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:06.245728 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe07be-c1b0-4c0e-b090-d9ea55ed2841 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:06.266576 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 259/520] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:06.268488 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ad17a-e273-431c-8905-bab16c97e408 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:06.346210 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:06.370627 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 262/521] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:07:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 12:07:06.371547 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe07be-c1b0-4c0e-b090-d9ea55ed2841 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:06.384728 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ad17a-e273-431c-8905-bab16c97e408 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:06.401429 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:06.421836 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1682ab-baa2-45c0-9fe5-2b6d6986d329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:06.422523 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1682ab-baa2-45c0-9fe5-2b6d6986d329 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:06.422811 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1682ab-baa2-45c0-9fe5-2b6d6986d329 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:06.423083 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1682ab-baa2-45c0-9fe5-2b6d6986d329 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:06.434243 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1682ab-baa2-45c0-9fe5-2b6d6986d329 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:06.435731 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1682ab-baa2-45c0-9fe5-2b6d6986d329 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:06.450632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-cd1682ab-baa2-45c0-9fe5-2b6d6986d329 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:06.450632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:06.450632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:06.450632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:06.450632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:06.450632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:06.450632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:06.450632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:06.450632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:06.450632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:06.450632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:06.450632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:06.450632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:06.450632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:06.450632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:06.450632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:06.451562 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:06.451562 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:06.451562 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:06.451562 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:06.451562 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:06.451562 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:06.451562 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:06.451562 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:06.451562 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:06.451562 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:06.451562 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:06.451562 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:06.451562 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:06.451562 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:06.451562 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:06.451562 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:06.451562 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:06.452394 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:06.452394 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:06.452394 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:06.452394 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 260/522] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:06.452615 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1682ab-baa2-45c0-9fe5-2b6d6986d329 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:06.497960 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe07be-c1b0-4c0e-b090-d9ea55ed2841 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:06.539761 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f26910-8f7d-4b38-becf-1dfe2e74cb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:06.540370 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f26910-8f7d-4b38-becf-1dfe2e74cb96 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:06.541076 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f26910-8f7d-4b38-becf-1dfe2e74cb96 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:06.541357 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f26910-8f7d-4b38-becf-1dfe2e74cb96 None admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:06.542332 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f26910-8f7d-4b38-becf-1dfe2e74cb96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:06.542660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f26910-8f7d-4b38-becf-1dfe2e74cb96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:06.544335 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f26910-8f7d-4b38-becf-1dfe2e74cb96 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:06.563616 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 263/523] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Sep 21 12:07:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:06.564577 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f26910-8f7d-4b38-becf-1dfe2e74cb96 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:06.572563 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1682ab-baa2-45c0-9fe5-2b6d6986d329 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:06.598105 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:06.610691 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da052e-eb3f-47dc-80ce-bc9a4c75e29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:06.611400 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da052e-eb3f-47dc-80ce-bc9a4c75e29d None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:06.611745 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da052e-eb3f-47dc-80ce-bc9a4c75e29d None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:06.612080 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da052e-eb3f-47dc-80ce-bc9a4c75e29d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:06.622229 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da052e-eb3f-47dc-80ce-bc9a4c75e29d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:06.623761 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da052e-eb3f-47dc-80ce-bc9a4c75e29d None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:06.635847 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-45da052e-eb3f-47dc-80ce-bc9a4c75e29d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 21 12:07:06.635847 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:06.635847 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:06.635847 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:06.635847 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:06.635847 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:06.635847 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:06.635847 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:06.635847 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:06.635847 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:06.635847 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:06.635847 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:06.635847 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 12:07:06.635847 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 12:07:06.635847 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 12:07:06.635847 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 12:07:06.636970 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:06.636970 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:06.636970 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 12:07:06.636970 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:06.636970 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 12:07:06.636970 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:06.636970 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:06.636970 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:06.636970 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:06.636970 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:06.636970 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:06.636970 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:06.636970 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:06.636970 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:06.636970 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:06.636970 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:06.636970 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:06.636970 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:06.638599 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:06.638599 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:06.638599 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 12:07:06.638599 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 12:07:06.638599 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 12:07:06.638599 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 12:07:06.638599 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 12:07:06.638599 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 12:07:06.638599 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 21 12:07:06.638599 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:06.643372 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 261/524] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Sep 21 12:07:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:06.643959 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da052e-eb3f-47dc-80ce-bc9a4c75e29d None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:06.672273 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:06.693475 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f26910-8f7d-4b38-becf-1dfe2e74cb96 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:06.733156 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53b30f-50af-411d-bc04-811ad515dda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:06.734033 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53b30f-50af-411d-bc04-811ad515dda4 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:06.734719 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53b30f-50af-411d-bc04-811ad515dda4 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:06.735092 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53b30f-50af-411d-bc04-811ad515dda4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:06.746595 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a53b30f-50af-411d-bc04-811ad515dda4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:06.748043 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a53b30f-50af-411d-bc04-811ad515dda4 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:06.758567 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da052e-eb3f-47dc-80ce-bc9a4c75e29d None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:06.765093 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-7a53b30f-50af-411d-bc04-811ad515dda4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:06.765093 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:06.765093 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:06.765093 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:06.765093 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:06.765093 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:06.765093 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:06.765093 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:06.765093 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:06.765093 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:06.765093 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:06.765093 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:06.765093 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:06.765093 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:06.765093 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:06.765093 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:06.766214 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:06.766214 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:06.766214 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:06.766214 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:06.766214 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:06.766214 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:06.766214 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:06.766214 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:06.766214 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:06.766214 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:06.766214 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:06.766214 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:06.766214 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:06.766214 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:06.766214 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:06.766214 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:06.766214 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:06.767289 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:06.767289 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:06.767289 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:06.773056 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 264/525] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:06.773056 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53b30f-50af-411d-bc04-811ad515dda4 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:06.805229 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bcb66d-a0d8-4075-a65a-f4af1ab5ee13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:06.806180 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcb66d-a0d8-4075-a65a-f4af1ab5ee13 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:06.806489 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcb66d-a0d8-4075-a65a-f4af1ab5ee13 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:06.806819 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcb66d-a0d8-4075-a65a-f4af1ab5ee13 None admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:06.807471 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bcb66d-a0d8-4075-a65a-f4af1ab5ee13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:06.807774 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bcb66d-a0d8-4075-a65a-f4af1ab5ee13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:06.809202 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bcb66d-a0d8-4075-a65a-f4af1ab5ee13 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:06.822069 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 262/526] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:06.822935 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bcb66d-a0d8-4075-a65a-f4af1ab5ee13 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:06.874250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:06.889151 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53b30f-50af-411d-bc04-811ad515dda4 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:06.926130 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9b953-51b0-4a33-9768-005f3a4719cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:06.926762 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9b953-51b0-4a33-9768-005f3a4719cf None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:06.927042 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9b953-51b0-4a33-9768-005f3a4719cf None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:06.927308 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9b953-51b0-4a33-9768-005f3a4719cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:06.928068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd9b953-51b0-4a33-9768-005f3a4719cf None admin] RBAC: Adding query filter params (role.id=327398b6ec324647b6c4ea84a59a026b, scope.project.id=b0abcc6f2ce14825bfc26e6210889c21, user.id=6cb4001f94b8439180ca2a93d3b279b1) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:06.928332 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd9b953-51b0-4a33-9768-005f3a4719cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:06.929784 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd9b953-51b0-4a33-9768-005f3a4719cf None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:06.935539 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bcb66d-a0d8-4075-a65a-f4af1ab5ee13 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:06.946434 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 265/527] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:07:06 2022] GET /identity/v3/role_assignments?user.id=6cb4001f94b8439180ca2a93d3b279b1&scope.project.id=b0abcc6f2ce14825bfc26e6210889c21&role.id=327398b6ec324647b6c4ea84a59a026b => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:06.946434 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9b953-51b0-4a33-9768-005f3a4719cf None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:06.946434 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:06.978895 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a9c930-a45b-4cdb-9c8a-6724c727d6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:06.980106 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9c930-a45b-4cdb-9c8a-6724c727d6ae None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:06.980556 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9c930-a45b-4cdb-9c8a-6724c727d6ae None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:06.980835 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9c930-a45b-4cdb-9c8a-6724c727d6ae None admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:06.981609 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a9c930-a45b-4cdb-9c8a-6724c727d6ae None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:06.981913 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a9c930-a45b-4cdb-9c8a-6724c727d6ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:06.983428 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a9c930-a45b-4cdb-9c8a-6724c727d6ae None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:07.010827 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 263/528] 10.222.0.60 () {56 vars in 1139 bytes} [Wed Sep 21 12:07:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:07.011424 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a9c930-a45b-4cdb-9c8a-6724c727d6ae None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:07.064561 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9b953-51b0-4a33-9768-005f3a4719cf None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:07.104147 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049315a7-45b2-42e9-8122-6cf35455dfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:07.105139 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049315a7-45b2-42e9-8122-6cf35455dfa1 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:07.105646 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049315a7-45b2-42e9-8122-6cf35455dfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:07.106135 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049315a7-45b2-42e9-8122-6cf35455dfa1 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:07.107032 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049315a7-45b2-42e9-8122-6cf35455dfa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:07.107548 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049315a7-45b2-42e9-8122-6cf35455dfa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:07.109147 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049315a7-45b2-42e9-8122-6cf35455dfa1 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:07.123270 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 266/529] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:07.124496 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049315a7-45b2-42e9-8122-6cf35455dfa1 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:07.146243 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a9c930-a45b-4cdb-9c8a-6724c727d6ae None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:07.147893 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:07.195158 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af6976-38e7-4494-83ba-f3ed5bf2e9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:07.195833 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af6976-38e7-4494-83ba-f3ed5bf2e9e9 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:07.196267 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af6976-38e7-4494-83ba-f3ed5bf2e9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:07.196670 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af6976-38e7-4494-83ba-f3ed5bf2e9e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:07.204663 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:07.208296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af6976-38e7-4494-83ba-f3ed5bf2e9e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:07.209937 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af6976-38e7-4494-83ba-f3ed5bf2e9e9 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:07.236166 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-89af6976-38e7-4494-83ba-f3ed5bf2e9e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:07.236166 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:07.236166 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:07.236166 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:07.236166 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:07.236166 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:07.236166 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:07.236166 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:07.236166 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:07.236166 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:07.236166 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:07.236166 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:07.236166 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 12:07:07.236166 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 12:07:07.236166 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 12:07:07.237250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 12:07:07.237250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:07.237250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:07.237250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:07.237250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:07.237250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:07.237250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:07.237250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:07.237250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:07.237250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:07.237250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:07.237250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:07.237250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:07.237250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:07.237250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:07.237250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:07.237250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:07.238315 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 12:07:07.238315 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 12:07:07.238315 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 12:07:07.238315 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 12:07:07.238315 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 12:07:07.238315 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 12:07:07.238315 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:07.238315 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:07.246510 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 264/530] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:07:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:07.247542 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af6976-38e7-4494-83ba-f3ed5bf2e9e9 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:07.262125 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049315a7-45b2-42e9-8122-6cf35455dfa1 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:07.303895 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6a40c-8919-4a24-ba23-21eec0cdcd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:07.304696 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6a40c-8919-4a24-ba23-21eec0cdcd17 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:07.305094 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6a40c-8919-4a24-ba23-21eec0cdcd17 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:07.305467 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6a40c-8919-4a24-ba23-21eec0cdcd17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:07.373161 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af6976-38e7-4494-83ba-f3ed5bf2e9e9 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:07.396128 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6a40c-8919-4a24-ba23-21eec0cdcd17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:07.398098 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6a40c-8919-4a24-ba23-21eec0cdcd17 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:07.413843 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044644b-185d-4c1b-8eeb-28fdb5e64652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:07.415039 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044644b-185d-4c1b-8eeb-28fdb5e64652 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:07.415470 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044644b-185d-4c1b-8eeb-28fdb5e64652 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:07.416366 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044644b-185d-4c1b-8eeb-28fdb5e64652 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:07.425722 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044644b-185d-4c1b-8eeb-28fdb5e64652 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:07.428147 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044644b-185d-4c1b-8eeb-28fdb5e64652 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:07.447784 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-c044644b-185d-4c1b-8eeb-28fdb5e64652 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:07.447784 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:07.447784 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:07.447784 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:07.447784 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:07.447784 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:07.447784 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:07.447784 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:07.447784 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:07.447784 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:07.447784 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:07.447784 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:07.447784 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 12:07:07.447784 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 12:07:07.447784 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 12:07:07.448877 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 12:07:07.448877 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:07.448877 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:07.448877 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:07.448877 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:07.448877 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:07.448877 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:07.448877 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:07.448877 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:07.448877 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:07.448877 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:07.448877 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:07.448877 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:07.448877 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:07.448877 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:07.448877 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:07.448877 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:07.449926 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 12:07:07.449926 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 12:07:07.449926 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 12:07:07.449926 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 12:07:07.449926 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 12:07:07.449926 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 12:07:07.449926 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:07.449926 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:07.452171 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 265/531] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:07:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:07.453674 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044644b-185d-4c1b-8eeb-28fdb5e64652 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:07.474991 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:07.489538 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:07.527265 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 267/532] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:07:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 12:07:07.528016 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6a40c-8919-4a24-ba23-21eec0cdcd17 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:07.604995 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044644b-185d-4c1b-8eeb-28fdb5e64652 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:07.656203 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe6b89-662f-4976-aa19-3aebe10925e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:07.657872 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe6b89-662f-4976-aa19-3aebe10925e4 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:07.658322 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe6b89-662f-4976-aa19-3aebe10925e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:07.659079 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe6b89-662f-4976-aa19-3aebe10925e4 None admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:07.659967 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe6b89-662f-4976-aa19-3aebe10925e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:07.660430 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe6b89-662f-4976-aa19-3aebe10925e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:07.661037 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6a40c-8919-4a24-ba23-21eec0cdcd17 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:07.662310 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe6b89-662f-4976-aa19-3aebe10925e4 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:07.696249 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 266/533] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Sep 21 12:07:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:07.696249 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe6b89-662f-4976-aa19-3aebe10925e4 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:07.714825 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65b16b-4573-4524-98d5-5c77fc539fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:07.715704 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65b16b-4573-4524-98d5-5c77fc539fa1 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:07.716301 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65b16b-4573-4524-98d5-5c77fc539fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:07.716733 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65b16b-4573-4524-98d5-5c77fc539fa1 None admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:07.717927 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65b16b-4573-4524-98d5-5c77fc539fa1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:07.718406 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65b16b-4573-4524-98d5-5c77fc539fa1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:07.720023 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65b16b-4573-4524-98d5-5c77fc539fa1 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:07.735638 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 268/534] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Sep 21 12:07:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:07.736706 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65b16b-4573-4524-98d5-5c77fc539fa1 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:07.768132 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:07.787868 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:07.808489 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe6b89-662f-4976-aa19-3aebe10925e4 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:07.844934 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492234d-641b-4f26-a0a8-3d60107633ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:07.845597 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492234d-641b-4f26-a0a8-3d60107633ac None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:07.845889 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492234d-641b-4f26-a0a8-3d60107633ac None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:07.846175 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492234d-641b-4f26-a0a8-3d60107633ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:07.855587 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65b16b-4573-4524-98d5-5c77fc539fa1 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:07.858960 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492234d-641b-4f26-a0a8-3d60107633ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:07.859854 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492234d-641b-4f26-a0a8-3d60107633ac None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:07.876256 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-0492234d-641b-4f26-a0a8-3d60107633ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:07.876256 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:07.876256 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:07.876256 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:07.876256 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:07.876256 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:07.876256 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:07.876256 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:07.876256 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:07.876256 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:07.876256 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:07.876256 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:07.876256 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:07.876256 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:07.876256 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:07.876256 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:07.877195 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:07.877195 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:07.877195 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:07.877195 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:07.877195 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:07.877195 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:07.877195 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:07.877195 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:07.877195 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:07.877195 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:07.877195 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:07.877195 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:07.877195 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:07.877195 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:07.877195 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:07.877195 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:07.877195 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:07.882932 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:07.882932 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:07.882932 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:07.882932 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 267/535] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:07.882932 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492234d-641b-4f26-a0a8-3d60107633ac None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:07.900493 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40636a34-5efe-4276-87b2-e442c2973777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:07.901129 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40636a34-5efe-4276-87b2-e442c2973777 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:07.901436 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40636a34-5efe-4276-87b2-e442c2973777 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:07.901687 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40636a34-5efe-4276-87b2-e442c2973777 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:07.902503 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40636a34-5efe-4276-87b2-e442c2973777 None admin] RBAC: Adding query filter params (role.id=327398b6ec324647b6c4ea84a59a026b, scope.project.id=b0abcc6f2ce14825bfc26e6210889c21, user.id=c513a6c91a0240de87c7b51b07617827) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:07.903238 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40636a34-5efe-4276-87b2-e442c2973777 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:07.904683 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40636a34-5efe-4276-87b2-e442c2973777 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:07.922808 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 269/536] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:07:07 2022] GET /identity/v3/role_assignments?user.id=c513a6c91a0240de87c7b51b07617827&scope.project.id=b0abcc6f2ce14825bfc26e6210889c21&role.id=327398b6ec324647b6c4ea84a59a026b => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:07.924111 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1211c-5783-44d8-9a31-cb85aaefd6b9 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:07.924406 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1211c-5783-44d8-9a31-cb85aaefd6b9 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:07.924682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1211c-5783-44d8-9a31-cb85aaefd6b9 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:07.926185 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 270/537] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:07:07.930440 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d1211c-5783-44d8-9a31-cb85aaefd6b9 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:07.998700 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492234d-641b-4f26-a0a8-3d60107633ac None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:08.040312 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:08.042654 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5a530-679c-4ba1-92f1-7cb58a341b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:08.043487 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5a530-679c-4ba1-92f1-7cb58a341b1a None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:08.043817 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5a530-679c-4ba1-92f1-7cb58a341b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:08.044095 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5a530-679c-4ba1-92f1-7cb58a341b1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:08.044836 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d5a530-679c-4ba1-92f1-7cb58a341b1a None admin] RBAC: Adding query filter params (role.id=327398b6ec324647b6c4ea84a59a026b, scope.project.id=b0abcc6f2ce14825bfc26e6210889c21, user.id=1b44dd2471684d358018f36ec0afc063) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:08.045143 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d5a530-679c-4ba1-92f1-7cb58a341b1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:08.047458 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d5a530-679c-4ba1-92f1-7cb58a341b1a None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:08.049587 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:08.058553 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 268/538] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:07:07 2022] GET /identity/v3/role_assignments?user.id=1b44dd2471684d358018f36ec0afc063&scope.project.id=b0abcc6f2ce14825bfc26e6210889c21&role.id=327398b6ec324647b6c4ea84a59a026b => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:08.061049 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08f9f8-69fd-4312-a22d-6d92f99c1793 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:08.061755 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08f9f8-69fd-4312-a22d-6d92f99c1793 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:08.063621 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08f9f8-69fd-4312-a22d-6d92f99c1793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:08.068835 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d1211c-5783-44d8-9a31-cb85aaefd6b9 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:08.103326 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-9a08f9f8-69fd-4312-a22d-6d92f99c1793 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:08.106826 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-9a08f9f8-69fd-4312-a22d-6d92f99c1793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:08.145055 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4876d-6665-4ffd-9b02-18bf4b96dd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:08.145810 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4876d-6665-4ffd-9b02-18bf4b96dd83 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:08.146119 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4876d-6665-4ffd-9b02-18bf4b96dd83 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:08.146661 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4876d-6665-4ffd-9b02-18bf4b96dd83 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:08.147398 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4876d-6665-4ffd-9b02-18bf4b96dd83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:08.147792 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4876d-6665-4ffd-9b02-18bf4b96dd83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:08.149883 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4876d-6665-4ffd-9b02-18bf4b96dd83 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:08.167500 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 271/539] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:08.174780 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4876d-6665-4ffd-9b02-18bf4b96dd83 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:08.209852 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 269/540] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:07:08.284267 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4876d-6665-4ffd-9b02-18bf4b96dd83 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:08.319650 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dad8f8-8d0b-435f-9c67-f50fef8922bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:08.320308 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dad8f8-8d0b-435f-9c67-f50fef8922bf None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:08.320586 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dad8f8-8d0b-435f-9c67-f50fef8922bf None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:08.320855 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dad8f8-8d0b-435f-9c67-f50fef8922bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:08.327739 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dad8f8-8d0b-435f-9c67-f50fef8922bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:08.329214 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dad8f8-8d0b-435f-9c67-f50fef8922bf None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:08.341799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-33dad8f8-8d0b-435f-9c67-f50fef8922bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:08.341799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:08.341799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:08.341799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:08.341799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:08.341799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:08.341799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:08.341799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:08.341799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:08.341799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:08.341799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:08.341799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:08.341799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 12:07:08.341799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 12:07:08.341799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 12:07:08.342716 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 12:07:08.342716 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:08.342716 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:08.342716 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:08.342716 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:08.342716 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:08.342716 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:08.342716 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:08.342716 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:08.342716 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:08.342716 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:08.342716 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:08.342716 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:08.342716 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:08.342716 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:08.342716 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:08.342716 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:08.343575 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 12:07:08.343575 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 12:07:08.343575 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 12:07:08.343575 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 12:07:08.343575 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 12:07:08.343575 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 12:07:08.343575 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:08.343575 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:08.343575 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 272/541] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:07:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:08.348899 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08f9f8-69fd-4312-a22d-6d92f99c1793 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:08.465353 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08f9f8-69fd-4312-a22d-6d92f99c1793 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:08.495962 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:08.504781 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e66ee0-7840-4557-b852-00f4e03cfa93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:08.505389 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e66ee0-7840-4557-b852-00f4e03cfa93 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:08.505662 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e66ee0-7840-4557-b852-00f4e03cfa93 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:08.505926 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e66ee0-7840-4557-b852-00f4e03cfa93 None admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:08.506702 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e66ee0-7840-4557-b852-00f4e03cfa93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:08.506998 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e66ee0-7840-4557-b852-00f4e03cfa93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:08.508578 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e66ee0-7840-4557-b852-00f4e03cfa93 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:08.522420 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 270/542] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Sep 21 12:07:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:08.528475 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dad8f8-8d0b-435f-9c67-f50fef8922bf None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:08.538225 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:08.549110 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e66ee0-7840-4557-b852-00f4e03cfa93 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:08.670477 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dad8f8-8d0b-435f-9c67-f50fef8922bf None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:08.708754 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53faf1-e944-4e2d-8e87-8305161ae550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:08.714047 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53faf1-e944-4e2d-8e87-8305161ae550 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:08.714412 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53faf1-e944-4e2d-8e87-8305161ae550 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:08.714751 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53faf1-e944-4e2d-8e87-8305161ae550 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:08.715596 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce53faf1-e944-4e2d-8e87-8305161ae550 None admin] RBAC: Adding query filter params (role.id=327398b6ec324647b6c4ea84a59a026b, scope.project.id=b0abcc6f2ce14825bfc26e6210889c21, user.id=ab0521c25c2d4417944efa4745588f1e) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:08.715912 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce53faf1-e944-4e2d-8e87-8305161ae550 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:08.717415 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce53faf1-e944-4e2d-8e87-8305161ae550 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:08.730163 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 273/543] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:07:08 2022] GET /identity/v3/role_assignments?user.id=ab0521c25c2d4417944efa4745588f1e&scope.project.id=b0abcc6f2ce14825bfc26e6210889c21&role.id=327398b6ec324647b6c4ea84a59a026b => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:08.761833 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e66ee0-7840-4557-b852-00f4e03cfa93 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:08.806908 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c35288-d860-4df9-87c3-bf16ac9b5407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:08.807652 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c35288-d860-4df9-87c3-bf16ac9b5407 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:08.807998 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c35288-d860-4df9-87c3-bf16ac9b5407 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:08.809449 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c35288-d860-4df9-87c3-bf16ac9b5407 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:08.830410 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c35288-d860-4df9-87c3-bf16ac9b5407 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:07:08.833492 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-62c35288-d860-4df9-87c3-bf16ac9b5407 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 12:07:08.833492 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:08.833492 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:08.833492 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:08.833492 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:08.833492 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:08.833492 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:08.833492 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:08.833492 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:08.833492 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:08.833492 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:08.833492 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:08.833492 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:07:08.833492 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:07:08.833492 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:07:08.833492 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:07:08.834625 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:07:08.834625 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:07:08.834625 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:07:08.834625 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:07:08.834625 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:08.834625 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:08.834625 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:08.834625 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:08.834625 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:08.834625 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:08.834625 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:08.834625 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:08.834625 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:08.834625 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:08.834625 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:08.834625 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:08.835650 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:08.835650 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:08.835650 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:08.835650 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:08.835650 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:07:08.835650 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:07:08.835650 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:07:08.835650 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:07:08.835650 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:07:08.835650 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:07:08.835650 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 12:07:08.835650 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:08.838184 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 271/544] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Sep 21 12:07:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 12:07:08.844542 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53faf1-e944-4e2d-8e87-8305161ae550 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:08.939199 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:08.988016 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53faf1-e944-4e2d-8e87-8305161ae550 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:09.036847 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2418e-4230-4805-ac49-90369166d6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:09.037445 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2418e-4230-4805-ac49-90369166d6e8 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:09.037721 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2418e-4230-4805-ac49-90369166d6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:09.037989 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2418e-4230-4805-ac49-90369166d6e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:09.038668 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2418e-4230-4805-ac49-90369166d6e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:09.038985 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2418e-4230-4805-ac49-90369166d6e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:09.040910 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2418e-4230-4805-ac49-90369166d6e8 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:09.050581 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 274/545] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Sep 21 12:07:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:09.056649 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c35288-d860-4df9-87c3-bf16ac9b5407 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:09.153197 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:09.216190 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c35288-d860-4df9-87c3-bf16ac9b5407 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:09.260289 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e455fdb-7a91-4b2f-8bc0-088ba3fcad6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:09.260863 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e455fdb-7a91-4b2f-8bc0-088ba3fcad6a None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:09.261146 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e455fdb-7a91-4b2f-8bc0-088ba3fcad6a None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:09.261420 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e455fdb-7a91-4b2f-8bc0-088ba3fcad6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:09.279016 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e455fdb-7a91-4b2f-8bc0-088ba3fcad6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:09.280497 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e455fdb-7a91-4b2f-8bc0-088ba3fcad6a None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:09.298592 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-5e455fdb-7a91-4b2f-8bc0-088ba3fcad6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:09.298592 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:09.298592 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:09.298592 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:09.298592 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:09.298592 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:09.298592 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:09.298592 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:09.298592 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:09.298592 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:09.298592 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:09.298592 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:09.298592 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:09.298592 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:09.298592 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:09.298592 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:09.299535 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:09.299535 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:09.299535 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:09.299535 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:09.299535 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:09.299535 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:09.299535 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:09.299535 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:09.299535 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:09.299535 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:09.299535 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:09.299535 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:09.299535 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:09.299535 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:09.299535 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:09.299535 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:09.299535 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:09.300788 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:09.300788 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:09.300788 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:09.300788 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 272/546] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:09.306926 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2418e-4230-4805-ac49-90369166d6e8 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:09.431819 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2418e-4230-4805-ac49-90369166d6e8 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:09.452785 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169b8c6-db1d-4101-9013-fbae7169de2a None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:09.453099 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169b8c6-db1d-4101-9013-fbae7169de2a None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:09.453349 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169b8c6-db1d-4101-9013-fbae7169de2a None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:09.455241 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 273/547] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:07:09.460349 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5b696-655d-4b7c-9dd1-de657a35514c None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:09.460636 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5b696-655d-4b7c-9dd1-de657a35514c None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:09.461556 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5b696-655d-4b7c-9dd1-de657a35514c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:09.485174 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:09.486929 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-1df5b696-655d-4b7c-9dd1-de657a35514c None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:09.488223 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-1df5b696-655d-4b7c-9dd1-de657a35514c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:09.494883 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa1dbf-7092-4280-bac8-c7e557805ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:09.495497 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa1dbf-7092-4280-bac8-c7e557805ba2 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:09.495777 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa1dbf-7092-4280-bac8-c7e557805ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:09.496052 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa1dbf-7092-4280-bac8-c7e557805ba2 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:09.496701 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa1dbf-7092-4280-bac8-c7e557805ba2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:09.497005 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa1dbf-7092-4280-bac8-c7e557805ba2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:09.498385 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa1dbf-7092-4280-bac8-c7e557805ba2 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:09.524675 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 275/548] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:09.531228 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa1dbf-7092-4280-bac8-c7e557805ba2 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:09.630086 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 274/549] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 12:07:09.706521 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa1dbf-7092-4280-bac8-c7e557805ba2 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:09.756159 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2427c-6163-4f35-81b6-ac8fa170b1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:09.756800 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2427c-6163-4f35-81b6-ac8fa170b1c4 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:09.757083 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2427c-6163-4f35-81b6-ac8fa170b1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:09.757355 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2427c-6163-4f35-81b6-ac8fa170b1c4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:09.768602 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2427c-6163-4f35-81b6-ac8fa170b1c4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:09.770056 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2427c-6163-4f35-81b6-ac8fa170b1c4 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:09.788813 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-6de2427c-6163-4f35-81b6-ac8fa170b1c4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 21 12:07:09.788813 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:09.788813 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:09.788813 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:09.788813 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:09.788813 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:09.788813 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:09.788813 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:09.788813 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:09.788813 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:09.788813 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:09.788813 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:09.788813 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 12:07:09.788813 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 12:07:09.788813 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 12:07:09.788813 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 12:07:09.790339 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:09.790339 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:09.790339 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 12:07:09.790339 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:09.790339 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 12:07:09.790339 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:09.790339 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:09.790339 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:09.790339 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:09.790339 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:09.790339 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:09.790339 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:09.790339 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:09.790339 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:09.790339 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:09.790339 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:09.790339 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:09.790339 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:09.791356 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:09.791356 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:09.791356 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 12:07:09.791356 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 12:07:09.791356 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 12:07:09.791356 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 12:07:09.791356 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 12:07:09.791356 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 12:07:09.791356 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 21 12:07:09.791356 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:09.791356 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 276/550] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Sep 21 12:07:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 12:07:09.796388 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5b696-655d-4b7c-9dd1-de657a35514c None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:09.840993 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:09.932702 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5b696-655d-4b7c-9dd1-de657a35514c None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:09.976195 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43d677-ab17-479a-91f6-d60e4c3ee82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:09.977350 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43d677-ab17-479a-91f6-d60e4c3ee82c None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:09.977631 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43d677-ab17-479a-91f6-d60e4c3ee82c None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:09.977905 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43d677-ab17-479a-91f6-d60e4c3ee82c None admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:09.978667 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43d677-ab17-479a-91f6-d60e4c3ee82c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:09.978974 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43d677-ab17-479a-91f6-d60e4c3ee82c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:09.980418 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43d677-ab17-479a-91f6-d60e4c3ee82c None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:10.005912 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 275/551] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Sep 21 12:07:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:10.011281 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2427c-6163-4f35-81b6-ac8fa170b1c4 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:10.036040 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43d677-ab17-479a-91f6-d60e4c3ee82c None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:10.101118 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:10.142563 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:10.170208 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43d677-ab17-479a-91f6-d60e4c3ee82c None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:10.217938 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2427c-6163-4f35-81b6-ac8fa170b1c4 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:10.244082 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd6924-fb9f-4f2b-af5a-d694eea56e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:10.244721 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd6924-fb9f-4f2b-af5a-d694eea56e1f None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:10.245000 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd6924-fb9f-4f2b-af5a-d694eea56e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:10.245270 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd6924-fb9f-4f2b-af5a-d694eea56e1f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:10.273256 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045e556-d908-4ab4-bd9d-7d20fa1534c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:10.274602 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045e556-d908-4ab4-bd9d-7d20fa1534c3 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:10.275025 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045e556-d908-4ab4-bd9d-7d20fa1534c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:10.275291 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd6924-fb9f-4f2b-af5a-d694eea56e1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:07:10.275399 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045e556-d908-4ab4-bd9d-7d20fa1534c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:10.280117 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-6cbd6924-fb9f-4f2b-af5a-d694eea56e1f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 12:07:10.280117 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:10.280117 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:10.280117 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:10.280117 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:10.280117 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:10.280117 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:10.280117 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:10.280117 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:10.280117 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:10.280117 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:10.280117 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:10.280117 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:07:10.280117 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:07:10.280117 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:07:10.280117 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:07:10.281113 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:07:10.281113 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:07:10.281113 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:07:10.281113 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:07:10.281113 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:10.281113 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:10.281113 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:10.281113 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:10.281113 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:10.281113 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:10.281113 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:10.281113 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:10.281113 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:10.281113 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:10.281113 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:10.281113 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:10.281910 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:10.281910 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:10.281910 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:10.281910 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:10.281910 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:07:10.281910 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:07:10.281910 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:07:10.281910 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:07:10.281910 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:07:10.281910 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:07:10.281910 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 12:07:10.281910 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:10.281910 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 276/552] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Sep 21 12:07:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 12:07:10.295715 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd6924-fb9f-4f2b-af5a-d694eea56e1f None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:10.356420 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045e556-d908-4ab4-bd9d-7d20fa1534c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:10.357800 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045e556-d908-4ab4-bd9d-7d20fa1534c3 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:10.437362 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:10.498077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd6924-fb9f-4f2b-af5a-d694eea56e1f None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:10.541625 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 277/553] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:07:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 12:07:10.546170 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87828a58-9ed8-4631-805f-510d66b21d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:10.546830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87828a58-9ed8-4631-805f-510d66b21d9a None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:10.547115 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87828a58-9ed8-4631-805f-510d66b21d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:10.547391 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87828a58-9ed8-4631-805f-510d66b21d9a None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:10.548148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87828a58-9ed8-4631-805f-510d66b21d9a None admin] RBAC: Adding query filter params (name=service) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:10.548449 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87828a58-9ed8-4631-805f-510d66b21d9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:10.549826 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87828a58-9ed8-4631-805f-510d66b21d9a None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:10.557099 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045e556-d908-4ab4-bd9d-7d20fa1534c3 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:10.565686 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 277/554] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Sep 21 12:07:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:07:10.566975 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87828a58-9ed8-4631-805f-510d66b21d9a None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:10.583621 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:10.703735 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87828a58-9ed8-4631-805f-510d66b21d9a None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:10.727505 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045e556-d908-4ab4-bd9d-7d20fa1534c3 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:10.747098 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d6c6e-162f-45b0-9057-035caff4b872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:10.748115 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d6c6e-162f-45b0-9057-035caff4b872 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:10.748468 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d6c6e-162f-45b0-9057-035caff4b872 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:10.748870 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d6c6e-162f-45b0-9057-035caff4b872 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:10.767010 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d6c6e-162f-45b0-9057-035caff4b872 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:10.768987 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d6c6e-162f-45b0-9057-035caff4b872 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:10.776214 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31d9a0-52e0-4848-8bba-35a2176b2b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:10.777186 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31d9a0-52e0-4848-8bba-35a2176b2b20 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:10.777648 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31d9a0-52e0-4848-8bba-35a2176b2b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:10.778126 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31d9a0-52e0-4848-8bba-35a2176b2b20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:10.788391 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-890d6c6e-162f-45b0-9057-035caff4b872 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:10.788391 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:10.788391 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:10.788391 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:10.788391 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:10.788391 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:10.788391 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:10.788391 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:10.788391 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:10.788391 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:10.788391 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:10.788391 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:10.788391 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:10.788391 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:10.788391 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:10.788391 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:10.789954 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:10.789954 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:10.789954 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:10.789954 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:10.789954 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:10.789954 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:10.789954 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:10.789954 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:10.789954 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:10.789954 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:10.789954 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:10.789954 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:10.789954 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:10.789954 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:10.789954 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:10.789954 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:10.789954 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:10.790865 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:10.790865 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:10.790865 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:10.790865 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 278/555] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:10.792836 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5704a0a-a3fb-48c7-9ad8-91e727595aef None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:10.793123 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5704a0a-a3fb-48c7-9ad8-91e727595aef None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:10.793394 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5704a0a-a3fb-48c7-9ad8-91e727595aef None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:10.794821 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31d9a0-52e0-4848-8bba-35a2176b2b20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:10.799255 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 279/556] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:07:10.799255 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5704a0a-a3fb-48c7-9ad8-91e727595aef None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:10.801951 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31d9a0-52e0-4848-8bba-35a2176b2b20 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:10.821595 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-8f31d9a0-52e0-4848-8bba-35a2176b2b20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:10.821595 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:10.821595 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:10.821595 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:10.821595 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:10.821595 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:10.821595 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:10.821595 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:10.821595 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:10.821595 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:10.821595 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:10.821595 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:10.821595 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:10.821595 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:10.821595 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:10.821595 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:10.823125 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:10.823125 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:10.823125 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:10.823125 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:10.823125 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:10.823125 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:10.823125 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:10.823125 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:10.823125 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:10.823125 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:10.823125 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:10.823125 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:10.823125 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:10.823125 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:10.823125 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:10.823125 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:10.823125 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:10.823990 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:10.823990 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:10.823990 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:10.826510 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 278/557] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:10.828398 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92abb2-5356-4554-ba96-1bd41f321d62 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:10.828847 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92abb2-5356-4554-ba96-1bd41f321d62 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:10.829550 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92abb2-5356-4554-ba96-1bd41f321d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:10.841398 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:10.858201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-ac92abb2-5356-4554-ba96-1bd41f321d62 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:10.859877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ac92abb2-5356-4554-ba96-1bd41f321d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:10.878679 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:10.924617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5704a0a-a3fb-48c7-9ad8-91e727595aef None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:10.939088 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 279/558] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:07:10.947342 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac92abb2-5356-4554-ba96-1bd41f321d62 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:10.968923 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a8673-1dfe-43e3-96c1-053af590b006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:10.969509 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a8673-1dfe-43e3-96c1-053af590b006 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:10.969801 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a8673-1dfe-43e3-96c1-053af590b006 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:10.970392 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a8673-1dfe-43e3-96c1-053af590b006 None admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:10.971211 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a8673-1dfe-43e3-96c1-053af590b006 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:10.971520 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a8673-1dfe-43e3-96c1-053af590b006 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:10.973413 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a8673-1dfe-43e3-96c1-053af590b006 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:10.990086 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 280/559] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:10.991375 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29b2d7-96bb-466d-ab90-9d4b08217dd2 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:10.991657 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29b2d7-96bb-466d-ab90-9d4b08217dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:10.991931 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29b2d7-96bb-466d-ab90-9d4b08217dd2 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:10.994482 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 281/560] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:07:10.995690 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29b2d7-96bb-466d-ab90-9d4b08217dd2 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:11.087893 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac92abb2-5356-4554-ba96-1bd41f321d62 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:11.136226 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef01df6-5331-4224-b01f-556868a8cb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:11.136847 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef01df6-5331-4224-b01f-556868a8cb2f None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:11.137130 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef01df6-5331-4224-b01f-556868a8cb2f None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:11.137369 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29b2d7-96bb-466d-ab90-9d4b08217dd2 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:11.137478 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef01df6-5331-4224-b01f-556868a8cb2f None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:11.138303 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef01df6-5331-4224-b01f-556868a8cb2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:11.138635 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef01df6-5331-4224-b01f-556868a8cb2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:11.140360 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef01df6-5331-4224-b01f-556868a8cb2f None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:11.143032 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:11.157826 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 280/561] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:11.159391 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3dbf4b-8c02-40e8-9b55-7fc954a20fa1 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:11.159677 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3dbf4b-8c02-40e8-9b55-7fc954a20fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:11.160009 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3dbf4b-8c02-40e8-9b55-7fc954a20fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:11.166622 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:11.182530 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-fc3dbf4b-8c02-40e8-9b55-7fc954a20fa1 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:11.184111 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-fc3dbf4b-8c02-40e8-9b55-7fc954a20fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:11.186873 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da333c-92ca-4a7d-a7ab-a85b92e57de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:11.188497 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da333c-92ca-4a7d-a7ab-a85b92e57de9 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:11.188933 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da333c-92ca-4a7d-a7ab-a85b92e57de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:11.189348 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da333c-92ca-4a7d-a7ab-a85b92e57de9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:11.198986 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65da333c-92ca-4a7d-a7ab-a85b92e57de9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:11.201257 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65da333c-92ca-4a7d-a7ab-a85b92e57de9 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:11.215084 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-65da333c-92ca-4a7d-a7ab-a85b92e57de9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 21 12:07:11.215084 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:11.215084 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:11.215084 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:11.215084 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:11.215084 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:11.215084 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:11.215084 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:11.215084 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:11.215084 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:11.215084 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:11.215084 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:11.215084 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 12:07:11.215084 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 12:07:11.215084 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 12:07:11.215084 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 12:07:11.216046 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:11.216046 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:11.216046 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 12:07:11.216046 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:11.216046 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 12:07:11.216046 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:11.216046 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:11.216046 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:11.216046 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:11.216046 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:11.216046 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:11.216046 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:11.216046 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:11.216046 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:11.216046 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:11.216046 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:11.216046 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:11.216046 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:11.216972 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:11.216972 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:11.216972 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 12:07:11.216972 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 12:07:11.216972 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 12:07:11.216972 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 12:07:11.216972 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 12:07:11.216972 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 12:07:11.216972 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 21 12:07:11.216972 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:11.216972 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 282/562] 10.222.0.60 () {56 vars in 1093 bytes} [Wed Sep 21 12:07:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 12:07:11.216972 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da333c-92ca-4a7d-a7ab-a85b92e57de9 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:11.266476 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 281/563] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:07:11.266476 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3dbf4b-8c02-40e8-9b55-7fc954a20fa1 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:11.352140 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da333c-92ca-4a7d-a7ab-a85b92e57de9 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:11.375900 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3dbf4b-8c02-40e8-9b55-7fc954a20fa1 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:11.399684 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3d189-4f00-4be3-aee6-9ed637ebb204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:11.400324 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3d189-4f00-4be3-aee6-9ed637ebb204 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:11.400603 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3d189-4f00-4be3-aee6-9ed637ebb204 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:11.400870 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3d189-4f00-4be3-aee6-9ed637ebb204 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:11.408488 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3d189-4f00-4be3-aee6-9ed637ebb204 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:11.410040 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3d189-4f00-4be3-aee6-9ed637ebb204 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:11.411024 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:11.424630 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34a89a-df13-4ea3-b124-3472b4291f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:11.424973 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-67c3d189-4f00-4be3-aee6-9ed637ebb204 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:11.424973 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:11.424973 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:11.424973 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:11.424973 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:11.424973 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:11.424973 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:11.424973 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:11.424973 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:11.424973 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:11.424973 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:11.424973 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:11.424973 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 12:07:11.424973 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 12:07:11.424973 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 12:07:11.425818 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 12:07:11.425818 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:11.425818 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:11.425818 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:11.425818 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:11.425818 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:11.425818 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:11.425818 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:11.425818 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:11.425818 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:11.425818 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:11.425818 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:11.425818 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:11.425818 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:11.425818 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:11.425818 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:11.425818 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:11.426929 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 12:07:11.426929 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 12:07:11.426929 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 12:07:11.426929 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 12:07:11.426929 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 12:07:11.426929 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 12:07:11.426929 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:11.426929 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:11.427441 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34a89a-df13-4ea3-b124-3472b4291f18 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:11.427441 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34a89a-df13-4ea3-b124-3472b4291f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:11.427441 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34a89a-df13-4ea3-b124-3472b4291f18 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:11.427658 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 283/564] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:07:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:11.427658 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3d189-4f00-4be3-aee6-9ed637ebb204 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:11.441098 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b34a89a-df13-4ea3-b124-3472b4291f18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:07:11.446067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-9b34a89a-df13-4ea3-b124-3472b4291f18 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 12:07:11.446067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:11.446067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:11.446067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:11.446067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:11.446067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:11.446067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:11.446067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:11.446067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:11.446067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:11.446067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:11.446067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:11.446067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:07:11.446067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:07:11.446067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:07:11.446067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:07:11.447069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:07:11.447069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:07:11.447069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:07:11.447069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:07:11.447069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:11.447069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:11.447069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:11.447069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:11.447069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:11.447069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:11.447069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:11.447069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:11.447069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:11.447069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:11.447069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:11.447069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:11.447923 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:11.447923 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:11.447923 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:11.447923 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:11.447923 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:07:11.447923 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:07:11.447923 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:07:11.447923 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:07:11.447923 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:07:11.447923 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:07:11.447923 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 12:07:11.447923 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:11.447923 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 282/565] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Sep 21 12:07:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:11.448622 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4d814-d67b-4db2-8709-95c50d8b051d None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:11.448622 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4d814-d67b-4db2-8709-95c50d8b051d None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:11.449537 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4d814-d67b-4db2-8709-95c50d8b051d None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:11.455774 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 283/566] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:07:11.455774 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c4d814-d67b-4db2-8709-95c50d8b051d None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:11.484398 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:11.546431 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3d189-4f00-4be3-aee6-9ed637ebb204 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:11.572204 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c4d814-d67b-4db2-8709-95c50d8b051d None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:11.582449 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a30d3e-81e8-495e-929d-97d9aa3e5cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:11.583056 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a30d3e-81e8-495e-929d-97d9aa3e5cf8 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:11.583343 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a30d3e-81e8-495e-929d-97d9aa3e5cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:11.583615 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a30d3e-81e8-495e-929d-97d9aa3e5cf8 None admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:11.584347 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a30d3e-81e8-495e-929d-97d9aa3e5cf8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:11.584651 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a30d3e-81e8-495e-929d-97d9aa3e5cf8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:11.586721 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a30d3e-81e8-495e-929d-97d9aa3e5cf8 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:11.604039 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 284/567] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Sep 21 12:07:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:11.604847 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a30d3e-81e8-495e-929d-97d9aa3e5cf8 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:11.611301 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b2af1-cee2-4be7-a22d-4a9d9855cfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:11.611902 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b2af1-cee2-4be7-a22d-4a9d9855cfa2 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:11.612177 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b2af1-cee2-4be7-a22d-4a9d9855cfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:11.612445 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b2af1-cee2-4be7-a22d-4a9d9855cfa2 None admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:11.613126 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b2af1-cee2-4be7-a22d-4a9d9855cfa2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:11.613424 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b2af1-cee2-4be7-a22d-4a9d9855cfa2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:11.614898 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b2af1-cee2-4be7-a22d-4a9d9855cfa2 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:11.626546 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 284/568] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Sep 21 12:07:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:11.627607 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee020f9-7c85-4c6e-a9f1-2d2c66eee5ea None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:11.628061 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee020f9-7c85-4c6e-a9f1-2d2c66eee5ea None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:11.628436 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee020f9-7c85-4c6e-a9f1-2d2c66eee5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:11.647618 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-0ee020f9-7c85-4c6e-a9f1-2d2c66eee5ea None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:11.649419 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-0ee020f9-7c85-4c6e-a9f1-2d2c66eee5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:11.689507 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:11.718507 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 285/569] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:07:11.719515 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:11.719668 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee020f9-7c85-4c6e-a9f1-2d2c66eee5ea None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:11.723565 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a30d3e-81e8-495e-929d-97d9aa3e5cf8 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:11.759585 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64518f9c-5656-4774-b692-c4ae84f01094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:11.760185 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64518f9c-5656-4774-b692-c4ae84f01094 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:11.760478 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64518f9c-5656-4774-b692-c4ae84f01094 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:11.760735 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64518f9c-5656-4774-b692-c4ae84f01094 None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:11.761428 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64518f9c-5656-4774-b692-c4ae84f01094 None admin] RBAC: Adding query filter params (name=service) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:11.761725 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64518f9c-5656-4774-b692-c4ae84f01094 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:11.763387 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64518f9c-5656-4774-b692-c4ae84f01094 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:11.772218 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 285/570] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Sep 21 12:07:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:11.773006 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64518f9c-5656-4774-b692-c4ae84f01094 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:11.832411 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee020f9-7c85-4c6e-a9f1-2d2c66eee5ea None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:11.869812 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed456a-8164-4d09-9581-477345a2bc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:11.870387 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed456a-8164-4d09-9581-477345a2bc30 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:11.870665 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed456a-8164-4d09-9581-477345a2bc30 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:11.870934 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed456a-8164-4d09-9581-477345a2bc30 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:11.878207 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64518f9c-5656-4774-b692-c4ae84f01094 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:11.882044 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed456a-8164-4d09-9581-477345a2bc30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:07:11.887369 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-deed456a-8164-4d09-9581-477345a2bc30 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 12:07:11.887369 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:11.887369 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:11.887369 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:11.887369 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:11.887369 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:11.887369 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:11.887369 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:11.887369 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:11.887369 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:11.887369 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:11.887369 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:11.887369 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:07:11.887369 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:07:11.887369 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:07:11.887369 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:07:11.888688 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:07:11.888688 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:07:11.888688 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:07:11.888688 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:07:11.888688 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:11.888688 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:11.888688 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:11.888688 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:11.888688 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:11.888688 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:11.888688 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:11.888688 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:11.888688 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:11.888688 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:11.888688 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:11.888688 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:11.889597 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:11.889597 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:11.889597 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:11.889597 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:11.889597 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:07:11.889597 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:07:11.889597 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:07:11.889597 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:07:11.889597 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:07:11.889597 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:07:11.889597 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 12:07:11.889597 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:11.889597 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 286/571] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Sep 21 12:07:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:11.889597 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed456a-8164-4d09-9581-477345a2bc30 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:11.919107 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcdce16-5887-490c-9c05-eb5b22bcf9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:11.919741 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcdce16-5887-490c-9c05-eb5b22bcf9ef None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:11.920017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcdce16-5887-490c-9c05-eb5b22bcf9ef None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:11.920294 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcdce16-5887-490c-9c05-eb5b22bcf9ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:11.927751 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:11.933267 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcdce16-5887-490c-9c05-eb5b22bcf9ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:11.934750 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcdce16-5887-490c-9c05-eb5b22bcf9ef None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:11.950296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-6fcdce16-5887-490c-9c05-eb5b22bcf9ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:11.950296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:11.950296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:11.950296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:11.950296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:11.950296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:11.950296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:11.950296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:11.950296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:11.950296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:11.950296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:11.950296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:11.950296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:11.950296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:11.950296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:11.950296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:11.951474 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:11.951474 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:11.951474 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:11.951474 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:11.951474 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:11.951474 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:11.951474 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:11.951474 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:11.951474 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:11.951474 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:11.951474 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:11.951474 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:11.951474 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:11.951474 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:11.951474 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:11.951474 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:11.951474 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:11.952433 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:11.952433 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:11.952433 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:11.952433 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 286/572] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:11.952672 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcdce16-5887-490c-9c05-eb5b22bcf9ef None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:11.971514 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:12.005024 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed456a-8164-4d09-9581-477345a2bc30 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:12.040034 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607e0fc-8df5-469b-b3ee-ecb582a441a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:12.040630 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607e0fc-8df5-469b-b3ee-ecb582a441a4 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:12.040931 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607e0fc-8df5-469b-b3ee-ecb582a441a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:12.041198 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607e0fc-8df5-469b-b3ee-ecb582a441a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:12.041915 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c607e0fc-8df5-469b-b3ee-ecb582a441a4 None admin] RBAC: Adding query filter params (role.id=327398b6ec324647b6c4ea84a59a026b, scope.project.id=b0abcc6f2ce14825bfc26e6210889c21, user.id=cbc2bab11b264196859802907b93ac37) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:12.042214 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c607e0fc-8df5-469b-b3ee-ecb582a441a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:12.043653 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c607e0fc-8df5-469b-b3ee-ecb582a441a4 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:12.049828 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 287/573] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:07:11 2022] GET /identity/v3/role_assignments?user.id=cbc2bab11b264196859802907b93ac37&scope.project.id=b0abcc6f2ce14825bfc26e6210889c21&role.id=327398b6ec324647b6c4ea84a59a026b => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:12.051032 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607e0fc-8df5-469b-b3ee-ecb582a441a4 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:12.063091 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcdce16-5887-490c-9c05-eb5b22bcf9ef None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:12.112012 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196daeee-dfce-419a-ba68-236f40556d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:12.113042 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196daeee-dfce-419a-ba68-236f40556d82 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:12.113589 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196daeee-dfce-419a-ba68-236f40556d82 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:12.114897 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196daeee-dfce-419a-ba68-236f40556d82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:12.131177 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196daeee-dfce-419a-ba68-236f40556d82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:12.134234 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196daeee-dfce-419a-ba68-236f40556d82 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:12.153899 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-196daeee-dfce-419a-ba68-236f40556d82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:12.153899 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:12.153899 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:12.153899 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:12.153899 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:12.153899 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:12.153899 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:12.153899 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:12.153899 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:12.153899 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:12.153899 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:12.153899 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:12.153899 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:12.153899 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:12.153899 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:12.153899 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:12.155145 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:12.155145 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:12.155145 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:12.155145 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:12.155145 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:12.155145 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:12.155145 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:12.155145 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:12.155145 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:12.155145 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:12.155145 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:12.155145 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:12.155145 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:12.155145 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:12.155145 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:12.155145 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:12.155145 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:12.156159 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:12.156159 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:12.156159 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:12.163326 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 287/574] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:12.163326 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196daeee-dfce-419a-ba68-236f40556d82 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:12.183496 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:12.188639 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607e0fc-8df5-469b-b3ee-ecb582a441a4 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:12.229375 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71540a2-d8c5-490d-9d3a-cf6327113ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:12.230072 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71540a2-d8c5-490d-9d3a-cf6327113ced None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:12.230448 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71540a2-d8c5-490d-9d3a-cf6327113ced None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:12.230781 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71540a2-d8c5-490d-9d3a-cf6327113ced None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:12.231508 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71540a2-d8c5-490d-9d3a-cf6327113ced None admin] RBAC: Adding query filter params (name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:12.232383 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71540a2-d8c5-490d-9d3a-cf6327113ced None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:12.233571 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71540a2-d8c5-490d-9d3a-cf6327113ced None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:12.239611 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:12.252777 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 288/575] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Sep 21 12:07:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:12.253424 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71540a2-d8c5-490d-9d3a-cf6327113ced None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:12.282152 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196daeee-dfce-419a-ba68-236f40556d82 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:12.319564 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1885b-d315-4fc9-9b9e-e109e94182a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:12.320277 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1885b-d315-4fc9-9b9e-e109e94182a6 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:12.320604 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1885b-d315-4fc9-9b9e-e109e94182a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:12.320933 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1885b-d315-4fc9-9b9e-e109e94182a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:12.321575 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1885b-d315-4fc9-9b9e-e109e94182a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:12.321869 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1885b-d315-4fc9-9b9e-e109e94182a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:12.323252 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1885b-d315-4fc9-9b9e-e109e94182a6 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:12.340165 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 288/576] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:12.340165 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1885b-d315-4fc9-9b9e-e109e94182a6 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:12.366652 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71540a2-d8c5-490d-9d3a-cf6327113ced None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:12.402922 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26345b6b-8f96-44c4-b9b6-53ac332c508b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:12.403700 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26345b6b-8f96-44c4-b9b6-53ac332c508b None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:12.404081 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26345b6b-8f96-44c4-b9b6-53ac332c508b None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:12.404443 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26345b6b-8f96-44c4-b9b6-53ac332c508b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:12.416831 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26345b6b-8f96-44c4-b9b6-53ac332c508b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:07:12.423265 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-26345b6b-8f96-44c4-b9b6-53ac332c508b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 12:07:12.423265 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:12.423265 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:12.423265 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:12.423265 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:12.423265 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:12.423265 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:12.423265 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:12.423265 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:12.423265 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:12.423265 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:12.423265 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:12.423265 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:07:12.423265 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:07:12.423265 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:07:12.423265 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:07:12.424397 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:07:12.424397 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:07:12.424397 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:07:12.424397 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:07:12.424397 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:12.424397 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:12.424397 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:12.424397 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:12.424397 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:12.424397 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:12.424397 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:12.424397 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:12.424397 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:12.424397 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:12.424397 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:12.424397 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:12.425347 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:12.425347 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:12.425347 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:12.425347 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:12.425347 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:07:12.425347 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:07:12.425347 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:07:12.425347 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:07:12.425347 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:07:12.425347 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:07:12.425347 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 12:07:12.425347 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:12.425347 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 289/577] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Sep 21 12:07:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:12.425347 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26345b6b-8f96-44c4-b9b6-53ac332c508b None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:12.447780 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1885b-d315-4fc9-9b9e-e109e94182a6 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:12.448245 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:12.483421 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:12.494056 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2fa05-5363-4e68-bbdd-b5d4fd313e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:12.494715 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2fa05-5363-4e68-bbdd-b5d4fd313e92 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:12.494988 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2fa05-5363-4e68-bbdd-b5d4fd313e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:12.495267 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2fa05-5363-4e68-bbdd-b5d4fd313e92 None admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:12.495905 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2fa05-5363-4e68-bbdd-b5d4fd313e92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:12.496215 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2fa05-5363-4e68-bbdd-b5d4fd313e92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:12.497633 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2fa05-5363-4e68-bbdd-b5d4fd313e92 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:12.515649 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 289/578] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:12.515649 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2fa05-5363-4e68-bbdd-b5d4fd313e92 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:12.536822 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26345b6b-8f96-44c4-b9b6-53ac332c508b None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:12.587188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe8afe-d927-47c4-be2d-8a15f1c12773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:12.587828 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe8afe-d927-47c4-be2d-8a15f1c12773 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:12.588150 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe8afe-d927-47c4-be2d-8a15f1c12773 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:12.588413 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe8afe-d927-47c4-be2d-8a15f1c12773 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:12.599865 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe8afe-d927-47c4-be2d-8a15f1c12773 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:12.601943 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe8afe-d927-47c4-be2d-8a15f1c12773 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:12.617031 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-71fe8afe-d927-47c4-be2d-8a15f1c12773 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:12.617031 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:12.617031 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:12.617031 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:12.617031 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:12.617031 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:12.617031 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:12.617031 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:12.617031 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:12.617031 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:12.617031 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:12.617031 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:12.617031 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:12.617031 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:12.617031 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:12.617031 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:12.617996 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:12.617996 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:12.617996 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:12.617996 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:12.617996 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:12.617996 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:12.617996 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:12.617996 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:12.617996 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:12.617996 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:12.617996 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:12.617996 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:12.617996 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:12.617996 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:12.617996 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:12.617996 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:12.617996 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:12.618932 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:12.618932 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:12.618932 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:12.618932 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 290/579] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:12.618932 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe8afe-d927-47c4-be2d-8a15f1c12773 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:12.634079 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2fa05-5363-4e68-bbdd-b5d4fd313e92 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:12.669514 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff868c2-d94a-49ba-8026-5cf0df634cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:12.670144 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff868c2-d94a-49ba-8026-5cf0df634cca None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:12.670444 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff868c2-d94a-49ba-8026-5cf0df634cca None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:12.670724 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff868c2-d94a-49ba-8026-5cf0df634cca None admin] PATH_INFO: `/v3/projects/service` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:12.678966 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff868c2-d94a-49ba-8026-5cf0df634cca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:12.680684 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff868c2-d94a-49ba-8026-5cf0df634cca None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:12.693210 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-3ff868c2-d94a-49ba-8026-5cf0df634cca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:12.693210 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:12.693210 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:12.693210 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:12.693210 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:12.693210 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:12.693210 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:12.693210 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:12.693210 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:12.693210 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:12.693210 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:12.693210 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:12.693210 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 12:07:12.693210 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 12:07:12.693210 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 12:07:12.694133 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 12:07:12.694133 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:12.694133 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:12.694133 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:12.694133 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:12.694133 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:12.694133 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:12.694133 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:12.694133 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:12.694133 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:12.694133 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:12.694133 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:12.694133 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:12.694133 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:12.694133 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:12.694133 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:12.694133 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:12.696045 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 12:07:12.696045 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 12:07:12.696045 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 12:07:12.696045 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 12:07:12.696045 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 12:07:12.696045 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 12:07:12.696045 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:12.696045 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:12.696045 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 290/580] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:07:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:12.696045 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff868c2-d94a-49ba-8026-5cf0df634cca None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:12.702641 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:12.736807 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe8afe-d927-47c4-be2d-8a15f1c12773 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:12.752547 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:12.773995 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81701442-9134-4e52-a688-847287446cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:12.774892 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81701442-9134-4e52-a688-847287446cfc None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:12.775167 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81701442-9134-4e52-a688-847287446cfc None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:12.775433 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81701442-9134-4e52-a688-847287446cfc None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:12.776265 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81701442-9134-4e52-a688-847287446cfc None admin] RBAC: Adding query filter params (name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:12.776564 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81701442-9134-4e52-a688-847287446cfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:12.778581 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81701442-9134-4e52-a688-847287446cfc None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:12.788661 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 291/581] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Sep 21 12:07:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:12.790261 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81701442-9134-4e52-a688-847287446cfc None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:12.814860 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff868c2-d94a-49ba-8026-5cf0df634cca None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:12.852424 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee1505-99fe-4e83-9626-0392685665fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:12.853063 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee1505-99fe-4e83-9626-0392685665fd None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:12.853339 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee1505-99fe-4e83-9626-0392685665fd None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:12.853607 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee1505-99fe-4e83-9626-0392685665fd None admin] PATH_INFO: `/v3/users/glance` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:12.861766 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee1505-99fe-4e83-9626-0392685665fd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:12.863264 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee1505-99fe-4e83-9626-0392685665fd None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:12.877212 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-bcee1505-99fe-4e83-9626-0392685665fd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 21 12:07:12.877212 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:12.877212 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:12.877212 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:12.877212 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:12.877212 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:12.877212 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:12.877212 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:12.877212 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:12.877212 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:12.877212 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:12.877212 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:12.877212 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 12:07:12.877212 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 12:07:12.877212 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 12:07:12.877212 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 12:07:12.878316 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:12.878316 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:12.878316 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 12:07:12.878316 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:12.878316 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 12:07:12.878316 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:12.878316 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:12.878316 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:12.878316 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:12.878316 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:12.878316 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:12.878316 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:12.878316 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:12.878316 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:12.878316 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:12.878316 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:12.878316 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:12.878316 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:12.879341 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:12.879341 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:12.879341 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 12:07:12.879341 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 12:07:12.879341 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 12:07:12.879341 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 12:07:12.879341 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 12:07:12.879341 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 12:07:12.879341 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 21 12:07:12.879341 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:12.883541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 291/582] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:07:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:12.884671 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee1505-99fe-4e83-9626-0392685665fd None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:12.922685 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81701442-9134-4e52-a688-847287446cfc None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:12.969562 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab927e56-7b00-4d0f-8435-6711d0f2fc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:12.970178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab927e56-7b00-4d0f-8435-6711d0f2fc60 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:12.970489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab927e56-7b00-4d0f-8435-6711d0f2fc60 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:12.970766 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab927e56-7b00-4d0f-8435-6711d0f2fc60 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:12.971591 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab927e56-7b00-4d0f-8435-6711d0f2fc60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:12.971901 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab927e56-7b00-4d0f-8435-6711d0f2fc60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:12.973809 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab927e56-7b00-4d0f-8435-6711d0f2fc60 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:12.975498 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:12.990236 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 292/583] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:12.990915 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab927e56-7b00-4d0f-8435-6711d0f2fc60 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:13.013052 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee1505-99fe-4e83-9626-0392685665fd None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:13.020418 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:13.049182 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c67ee-5b7c-4a0d-87d7-8bd5c52cb722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:13.049793 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c67ee-5b7c-4a0d-87d7-8bd5c52cb722 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:13.050073 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c67ee-5b7c-4a0d-87d7-8bd5c52cb722 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:13.050348 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c67ee-5b7c-4a0d-87d7-8bd5c52cb722 None admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:13.051056 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804c67ee-5b7c-4a0d-87d7-8bd5c52cb722 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:13.051360 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804c67ee-5b7c-4a0d-87d7-8bd5c52cb722 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:13.052790 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804c67ee-5b7c-4a0d-87d7-8bd5c52cb722 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:13.065176 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 292/584] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Sep 21 12:07:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:13.066159 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c67ee-5b7c-4a0d-87d7-8bd5c52cb722 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:13.107406 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab927e56-7b00-4d0f-8435-6711d0f2fc60 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:13.146157 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84fd8e3-4e77-4488-91d8-83af4e6d86b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:13.146733 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84fd8e3-4e77-4488-91d8-83af4e6d86b2 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:13.147014 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84fd8e3-4e77-4488-91d8-83af4e6d86b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:13.147287 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84fd8e3-4e77-4488-91d8-83af4e6d86b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:13.159300 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84fd8e3-4e77-4488-91d8-83af4e6d86b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:13.160817 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84fd8e3-4e77-4488-91d8-83af4e6d86b2 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:13.174108 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c67ee-5b7c-4a0d-87d7-8bd5c52cb722 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:13.176904 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-e84fd8e3-4e77-4488-91d8-83af4e6d86b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:13.176904 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:13.176904 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:13.176904 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:13.176904 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:13.176904 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:13.176904 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:13.176904 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:13.176904 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:13.176904 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:13.176904 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:13.176904 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:13.176904 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:13.176904 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:13.176904 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:13.176904 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:13.177844 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:13.177844 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:13.177844 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:13.177844 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:13.177844 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:13.177844 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:13.177844 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:13.177844 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:13.177844 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:13.177844 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:13.177844 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:13.177844 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:13.177844 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:13.177844 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:13.177844 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:13.177844 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:13.177844 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:13.179775 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:13.179775 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:13.179775 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:13.179775 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 293/585] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:13.179775 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84fd8e3-4e77-4488-91d8-83af4e6d86b2 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:13.216384 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb109324-016e-43ba-a4db-82af19e7ce97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:13.217060 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb109324-016e-43ba-a4db-82af19e7ce97 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:13.217343 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb109324-016e-43ba-a4db-82af19e7ce97 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:13.217615 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb109324-016e-43ba-a4db-82af19e7ce97 None admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:13.218338 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb109324-016e-43ba-a4db-82af19e7ce97 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:13.218689 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb109324-016e-43ba-a4db-82af19e7ce97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:13.220117 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb109324-016e-43ba-a4db-82af19e7ce97 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:13.231818 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:13.246406 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 293/586] 10.222.0.60 () {56 vars in 1137 bytes} [Wed Sep 21 12:07:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:13.246406 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb109324-016e-43ba-a4db-82af19e7ce97 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:13.275757 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:13.304045 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84fd8e3-4e77-4488-91d8-83af4e6d86b2 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:13.340341 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b039163-2071-4277-98f7-ff4893e6dad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:13.340970 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b039163-2071-4277-98f7-ff4893e6dad5 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:13.341252 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b039163-2071-4277-98f7-ff4893e6dad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:13.341527 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b039163-2071-4277-98f7-ff4893e6dad5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:13.351532 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b039163-2071-4277-98f7-ff4893e6dad5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:13.352979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b039163-2071-4277-98f7-ff4893e6dad5 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:13.361580 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb109324-016e-43ba-a4db-82af19e7ce97 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:13.364523 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-0b039163-2071-4277-98f7-ff4893e6dad5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 21 12:07:13.364523 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:13.364523 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:13.364523 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:13.364523 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:13.364523 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:13.364523 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:13.364523 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:13.364523 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:13.364523 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:13.364523 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:13.364523 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:13.364523 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 12:07:13.364523 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 12:07:13.364523 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 12:07:13.364523 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 12:07:13.365662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:13.365662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:13.365662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 12:07:13.365662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:13.365662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 12:07:13.365662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:13.365662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:13.365662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:13.365662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:13.365662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:13.365662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:13.365662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:13.365662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:13.365662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:13.365662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:13.365662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:13.365662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:13.365662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:13.367500 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:13.367500 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:13.367500 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 12:07:13.367500 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 12:07:13.367500 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 12:07:13.367500 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 12:07:13.367500 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 12:07:13.367500 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 12:07:13.367500 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 21 12:07:13.367500 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:13.370706 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 294/587] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:07:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:13.371535 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b039163-2071-4277-98f7-ff4893e6dad5 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:13.403235 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980085d-6113-400e-a103-1d9edc70da0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:13.403811 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980085d-6113-400e-a103-1d9edc70da0b None admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:13.404082 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980085d-6113-400e-a103-1d9edc70da0b None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:13.404357 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980085d-6113-400e-a103-1d9edc70da0b None admin] PATH_INFO: `/v3/projects/b0abcc6f2ce14825bfc26e6210889c21/users/6cb4001f94b8439180ca2a93d3b279b1/roles/327398b6ec324647b6c4ea84a59a026b` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:13.419819 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980085d-6113-400e-a103-1d9edc70da0b None admin] RBAC: Authorizing `identity:create_grant(project_id=b0abcc6f2ce14825bfc26e6210889c21, user_id=6cb4001f94b8439180ca2a93d3b279b1, role_id=327398b6ec324647b6c4ea84a59a026b)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:13.421367 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980085d-6113-400e-a103-1d9edc70da0b None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:13.446478 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 294/588] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Sep 21 12:07:13 2022] PUT /identity/v3/projects/b0abcc6f2ce14825bfc26e6210889c21/users/6cb4001f94b8439180ca2a93d3b279b1/roles/327398b6ec324647b6c4ea84a59a026b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:07:13.447782 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980085d-6113-400e-a103-1d9edc70da0b None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:13.487589 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b039163-2071-4277-98f7-ff4893e6dad5 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:13.506754 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:13.537001 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f575a1-fd5a-466d-9554-7163da0a59f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:13.537680 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f575a1-fd5a-466d-9554-7163da0a59f9 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:13.537967 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f575a1-fd5a-466d-9554-7163da0a59f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:13.538243 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f575a1-fd5a-466d-9554-7163da0a59f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:13.539955 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f575a1-fd5a-466d-9554-7163da0a59f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:13.540323 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f575a1-fd5a-466d-9554-7163da0a59f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:13.542557 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f575a1-fd5a-466d-9554-7163da0a59f9 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:13.563555 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 295/589] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:13.564434 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f575a1-fd5a-466d-9554-7163da0a59f9 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:13.566008 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:13.609872 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980085d-6113-400e-a103-1d9edc70da0b None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:13.653177 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743dc24-f64b-449b-bc54-d2acf98b56e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:13.653879 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743dc24-f64b-449b-bc54-d2acf98b56e9 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:13.654231 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743dc24-f64b-449b-bc54-d2acf98b56e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:13.654529 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743dc24-f64b-449b-bc54-d2acf98b56e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:13.665293 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743dc24-f64b-449b-bc54-d2acf98b56e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:13.666848 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743dc24-f64b-449b-bc54-d2acf98b56e9 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:13.682430 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-2743dc24-f64b-449b-bc54-d2acf98b56e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:13.682430 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:13.682430 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:13.682430 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:13.682430 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:13.682430 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:13.682430 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:13.682430 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:13.682430 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:13.682430 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:13.682430 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:13.682430 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:13.682430 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:13.682430 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:13.682430 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:13.682430 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:13.683450 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:13.683450 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:13.683450 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:13.683450 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:13.683450 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:13.683450 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:13.683450 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:13.683450 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:13.683450 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:13.683450 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:13.683450 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:13.683450 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:13.683450 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:13.683450 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:13.683450 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:13.683450 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:13.683450 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:13.684723 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:13.684723 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:13.684723 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:13.684723 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 295/590] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:13.684723 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743dc24-f64b-449b-bc54-d2acf98b56e9 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:13.705003 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f575a1-fd5a-466d-9554-7163da0a59f9 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:13.745990 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0983c0-b66c-4947-9c76-23003177d165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:13.746678 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0983c0-b66c-4947-9c76-23003177d165 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:13.746953 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0983c0-b66c-4947-9c76-23003177d165 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:13.747221 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0983c0-b66c-4947-9c76-23003177d165 None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:13.747997 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0983c0-b66c-4947-9c76-23003177d165 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:13.748305 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0983c0-b66c-4947-9c76-23003177d165 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:13.749981 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0983c0-b66c-4947-9c76-23003177d165 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:13.801756 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743dc24-f64b-449b-bc54-d2acf98b56e9 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:13.802751 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 296/591] 10.222.0.60 () {56 vars in 1137 bytes} [Wed Sep 21 12:07:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:13.803721 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0983c0-b66c-4947-9c76-23003177d165 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:13.830881 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:13.840843 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d696468-ef2f-4907-b29f-07362f282e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:13.841809 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d696468-ef2f-4907-b29f-07362f282e76 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:13.842322 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d696468-ef2f-4907-b29f-07362f282e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:13.842821 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d696468-ef2f-4907-b29f-07362f282e76 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:13.851781 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d696468-ef2f-4907-b29f-07362f282e76 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:13.853598 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d696468-ef2f-4907-b29f-07362f282e76 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:13.866013 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-5d696468-ef2f-4907-b29f-07362f282e76 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 21 12:07:13.866013 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:13.866013 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:13.866013 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:13.866013 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:13.866013 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:13.866013 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:13.866013 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:13.866013 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:13.866013 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:13.866013 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:13.866013 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:13.866013 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 12:07:13.866013 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 12:07:13.866013 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 12:07:13.866013 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 12:07:13.867348 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:13.867348 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:13.867348 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 12:07:13.867348 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:13.867348 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 12:07:13.867348 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:13.867348 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:13.867348 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:13.867348 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:13.867348 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:13.867348 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:13.867348 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:13.867348 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:13.867348 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:13.867348 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:13.867348 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:13.867348 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:13.867348 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:13.868268 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:13.868268 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:13.868268 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 12:07:13.868268 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 12:07:13.868268 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 12:07:13.868268 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 12:07:13.868268 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 12:07:13.868268 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 12:07:13.868268 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 21 12:07:13.868268 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:13.871036 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 296/592] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Sep 21 12:07:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:13.872132 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d696468-ef2f-4907-b29f-07362f282e76 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:13.874739 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:13.937463 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0983c0-b66c-4947-9c76-23003177d165 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:13.978285 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9658439-2a05-422e-a0ff-a2f40ac0d11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:13.978805 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9658439-2a05-422e-a0ff-a2f40ac0d11b None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:13.979080 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9658439-2a05-422e-a0ff-a2f40ac0d11b None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:13.979348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9658439-2a05-422e-a0ff-a2f40ac0d11b None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:13.980054 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9658439-2a05-422e-a0ff-a2f40ac0d11b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:13.980280 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9658439-2a05-422e-a0ff-a2f40ac0d11b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:13.981642 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9658439-2a05-422e-a0ff-a2f40ac0d11b None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:13.985867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d696468-ef2f-4907-b29f-07362f282e76 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:13.995668 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 297/593] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:13.996519 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9658439-2a05-422e-a0ff-a2f40ac0d11b None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:14.025103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d003a-0cdc-427e-aa4b-a416189c42fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:14.026154 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d003a-0cdc-427e-aa4b-a416189c42fd None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:14.026689 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d003a-0cdc-427e-aa4b-a416189c42fd None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:14.027166 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d003a-0cdc-427e-aa4b-a416189c42fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:14.038968 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745d003a-0cdc-427e-aa4b-a416189c42fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:14.040779 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745d003a-0cdc-427e-aa4b-a416189c42fd None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:14.056725 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-745d003a-0cdc-427e-aa4b-a416189c42fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:14.056725 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:14.056725 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:14.056725 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:14.056725 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:14.056725 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:14.056725 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:14.056725 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:14.056725 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:14.056725 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:14.056725 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:14.056725 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:14.056725 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:14.056725 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:14.056725 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:14.056725 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:14.057726 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:14.057726 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:14.057726 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:14.057726 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:14.057726 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:14.057726 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:14.057726 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:14.057726 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:14.057726 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:14.057726 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:14.057726 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:14.057726 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:14.057726 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:14.057726 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:14.057726 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:14.057726 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:14.057726 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:14.058665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:14.058665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:14.058665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:14.060492 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 297/594] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:14.061691 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d003a-0cdc-427e-aa4b-a416189c42fd None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:14.098712 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:14.119178 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:14.121254 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9658439-2a05-422e-a0ff-a2f40ac0d11b None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:14.166994 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079577f0-e7ca-4fd2-8529-b2c491f41f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:14.167972 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079577f0-e7ca-4fd2-8529-b2c491f41f16 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:14.168478 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079577f0-e7ca-4fd2-8529-b2c491f41f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:14.168972 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079577f0-e7ca-4fd2-8529-b2c491f41f16 None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:14.170099 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079577f0-e7ca-4fd2-8529-b2c491f41f16 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:14.170642 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079577f0-e7ca-4fd2-8529-b2c491f41f16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:14.172300 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079577f0-e7ca-4fd2-8529-b2c491f41f16 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:14.198602 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 298/595] 10.222.0.60 () {56 vars in 1139 bytes} [Wed Sep 21 12:07:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:14.199857 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079577f0-e7ca-4fd2-8529-b2c491f41f16 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:14.208205 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d003a-0cdc-427e-aa4b-a416189c42fd None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:14.246567 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94b276-ae9b-4e50-92cb-205ae3fbd944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:14.247733 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94b276-ae9b-4e50-92cb-205ae3fbd944 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:14.248299 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94b276-ae9b-4e50-92cb-205ae3fbd944 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:14.248818 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94b276-ae9b-4e50-92cb-205ae3fbd944 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:14.257940 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b94b276-ae9b-4e50-92cb-205ae3fbd944 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:14.259747 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b94b276-ae9b-4e50-92cb-205ae3fbd944 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:14.272235 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-8b94b276-ae9b-4e50-92cb-205ae3fbd944 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:14.272235 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:14.272235 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:14.272235 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:14.272235 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:14.272235 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:14.272235 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:14.272235 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:14.272235 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:14.272235 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:14.272235 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:14.272235 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:14.272235 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 12:07:14.272235 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 12:07:14.272235 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 12:07:14.273658 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 12:07:14.273658 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:14.273658 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:14.273658 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:14.273658 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:14.273658 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:14.273658 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:14.273658 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:14.273658 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:14.273658 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:14.273658 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:14.273658 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:14.273658 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:14.273658 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:14.273658 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:14.273658 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:14.273658 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:14.274578 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 12:07:14.274578 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 12:07:14.274578 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 12:07:14.274578 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 12:07:14.274578 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 12:07:14.274578 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 12:07:14.274578 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:14.274578 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:14.274578 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 298/596] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:07:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:14.275858 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94b276-ae9b-4e50-92cb-205ae3fbd944 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:14.321485 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079577f0-e7ca-4fd2-8529-b2c491f41f16 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:14.356685 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d51de8-22b6-4a0a-a241-4df8e2401382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:14.357280 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d51de8-22b6-4a0a-a241-4df8e2401382 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:14.357560 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d51de8-22b6-4a0a-a241-4df8e2401382 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:14.357829 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d51de8-22b6-4a0a-a241-4df8e2401382 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:14.358495 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d51de8-22b6-4a0a-a241-4df8e2401382 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:14.358792 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d51de8-22b6-4a0a-a241-4df8e2401382 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:14.360152 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d51de8-22b6-4a0a-a241-4df8e2401382 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:14.372473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 299/597] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:14.373657 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b399c3-929d-4461-acdd-f0e540bb2bfd None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:14.373943 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b399c3-929d-4461-acdd-f0e540bb2bfd None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:14.374216 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b399c3-929d-4461-acdd-f0e540bb2bfd None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:14.378725 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 300/598] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:07:14.379729 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b399c3-929d-4461-acdd-f0e540bb2bfd None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:14.383340 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:14.391710 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:14.396120 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94b276-ae9b-4e50-92cb-205ae3fbd944 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:14.437074 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da83fa2-c682-4ba1-a2f4-3e06ed899e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:14.437981 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da83fa2-c682-4ba1-a2f4-3e06ed899e1e None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:14.438533 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da83fa2-c682-4ba1-a2f4-3e06ed899e1e None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:14.438847 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da83fa2-c682-4ba1-a2f4-3e06ed899e1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:14.451215 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da83fa2-c682-4ba1-a2f4-3e06ed899e1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:14.452834 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da83fa2-c682-4ba1-a2f4-3e06ed899e1e None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:14.469052 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-9da83fa2-c682-4ba1-a2f4-3e06ed899e1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:14.469052 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:14.469052 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:14.469052 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:14.469052 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:14.469052 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:14.469052 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:14.469052 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:14.469052 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:14.469052 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:14.469052 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:14.469052 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:14.469052 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:14.469052 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:14.469052 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:14.469052 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:14.470178 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:14.470178 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:14.470178 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:14.470178 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:14.470178 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:14.470178 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:14.470178 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:14.470178 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:14.470178 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:14.470178 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:14.470178 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:14.470178 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:14.470178 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:14.470178 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:14.470178 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:14.470178 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:14.470178 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:14.471275 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:14.471275 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:14.471275 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:14.474497 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 299/599] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:14.475625 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da83fa2-c682-4ba1-a2f4-3e06ed899e1e None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:14.499580 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b399c3-929d-4461-acdd-f0e540bb2bfd None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:14.543110 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc873d-98c1-405a-a16c-2df39c6f0b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:14.543762 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc873d-98c1-405a-a16c-2df39c6f0b89 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:14.544076 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc873d-98c1-405a-a16c-2df39c6f0b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:14.544379 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc873d-98c1-405a-a16c-2df39c6f0b89 None admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:14.545166 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc873d-98c1-405a-a16c-2df39c6f0b89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:14.545474 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc873d-98c1-405a-a16c-2df39c6f0b89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:14.547942 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc873d-98c1-405a-a16c-2df39c6f0b89 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:14.571570 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 301/600] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Sep 21 12:07:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:14.571570 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8df82-805a-49b5-977b-cdc7858d30d7 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:14.571570 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8df82-805a-49b5-977b-cdc7858d30d7 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:14.571570 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8df82-805a-49b5-977b-cdc7858d30d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:14.590595 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-87a8df82-805a-49b5-977b-cdc7858d30d7 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:14.591958 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-87a8df82-805a-49b5-977b-cdc7858d30d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:14.595996 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da83fa2-c682-4ba1-a2f4-3e06ed899e1e None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:14.631317 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7edd229-48a0-490c-bff6-26e687948ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:14.632949 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edd229-48a0-490c-bff6-26e687948ed1 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:14.633404 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edd229-48a0-490c-bff6-26e687948ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:14.633826 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edd229-48a0-490c-bff6-26e687948ed1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:14.642544 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7edd229-48a0-490c-bff6-26e687948ed1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:14.644700 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7edd229-48a0-490c-bff6-26e687948ed1 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:14.654474 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:14.657632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-c7edd229-48a0-490c-bff6-26e687948ed1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:14.657632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:14.657632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:14.657632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:14.657632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:14.657632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:14.657632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:14.657632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:14.657632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:14.657632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:14.657632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:14.657632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:14.657632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 12:07:14.657632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 12:07:14.657632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 12:07:14.664311 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 12:07:14.664311 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:14.664311 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:14.664311 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:14.664311 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:14.664311 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:14.664311 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:14.664311 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:14.664311 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:14.664311 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:14.664311 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:14.664311 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:14.664311 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:14.664311 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:14.664311 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:14.664311 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:14.664311 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:14.665190 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 12:07:14.665190 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 12:07:14.665190 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 12:07:14.665190 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 12:07:14.665190 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 12:07:14.665190 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 12:07:14.665190 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:14.665190 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:14.665190 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 300/601] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:07:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:14.665190 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7edd229-48a0-490c-bff6-26e687948ed1 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:14.674426 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 302/602] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:07:14.675188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8df82-805a-49b5-977b-cdc7858d30d7 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:14.688947 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:14.785770 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8df82-805a-49b5-977b-cdc7858d30d7 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:14.799884 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7edd229-48a0-490c-bff6-26e687948ed1 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:14.824874 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b050b13-e942-4a4e-819d-bb6926ad1bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:14.825537 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b050b13-e942-4a4e-819d-bb6926ad1bb1 None admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:14.825819 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b050b13-e942-4a4e-819d-bb6926ad1bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:14.826091 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b050b13-e942-4a4e-819d-bb6926ad1bb1 None admin] PATH_INFO: `/v3/projects/b0abcc6f2ce14825bfc26e6210889c21/users/c513a6c91a0240de87c7b51b07617827/roles/327398b6ec324647b6c4ea84a59a026b` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:14.842531 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b050b13-e942-4a4e-819d-bb6926ad1bb1 None admin] RBAC: Authorizing `identity:create_grant(project_id=b0abcc6f2ce14825bfc26e6210889c21, user_id=c513a6c91a0240de87c7b51b07617827, role_id=327398b6ec324647b6c4ea84a59a026b)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:14.844424 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b050b13-e942-4a4e-819d-bb6926ad1bb1 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:14.845978 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec073db-3c51-4ae2-8ff3-4664a1af24bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:14.847103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec073db-3c51-4ae2-8ff3-4664a1af24bf None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:14.848056 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec073db-3c51-4ae2-8ff3-4664a1af24bf None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:14.848706 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec073db-3c51-4ae2-8ff3-4664a1af24bf None admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:14.849367 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec073db-3c51-4ae2-8ff3-4664a1af24bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:14.850105 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec073db-3c51-4ae2-8ff3-4664a1af24bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:14.852894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec073db-3c51-4ae2-8ff3-4664a1af24bf None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:14.860259 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 303/603] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Sep 21 12:07:14 2022] PUT /identity/v3/projects/b0abcc6f2ce14825bfc26e6210889c21/users/c513a6c91a0240de87c7b51b07617827/roles/327398b6ec324647b6c4ea84a59a026b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:07:14.861565 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b050b13-e942-4a4e-819d-bb6926ad1bb1 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:14.877019 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 301/604] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:14.879091 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec073db-3c51-4ae2-8ff3-4664a1af24bf None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:14.923317 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:14.987296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:14.996323 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b050b13-e942-4a4e-819d-bb6926ad1bb1 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:15.032810 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec073db-3c51-4ae2-8ff3-4664a1af24bf None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:15.059911 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790f505-2981-45fd-834c-cde0ccdb32ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:15.060972 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790f505-2981-45fd-834c-cde0ccdb32ab None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:15.061451 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790f505-2981-45fd-834c-cde0ccdb32ab None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:15.061938 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790f505-2981-45fd-834c-cde0ccdb32ab None admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:15.063197 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a790f505-2981-45fd-834c-cde0ccdb32ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:15.063711 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a790f505-2981-45fd-834c-cde0ccdb32ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:15.065376 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a790f505-2981-45fd-834c-cde0ccdb32ab None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:15.094757 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 304/605] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Sep 21 12:07:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:15.096368 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790f505-2981-45fd-834c-cde0ccdb32ab None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:15.124773 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467661b2-be2c-40f3-92ff-c53e9d308387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:15.125128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467661b2-be2c-40f3-92ff-c53e9d308387 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:15.126616 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467661b2-be2c-40f3-92ff-c53e9d308387 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:15.126894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467661b2-be2c-40f3-92ff-c53e9d308387 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:15.146097 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467661b2-be2c-40f3-92ff-c53e9d308387 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:15.147729 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467661b2-be2c-40f3-92ff-c53e9d308387 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:15.165582 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-467661b2-be2c-40f3-92ff-c53e9d308387 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:15.165582 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:15.165582 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:15.165582 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:15.165582 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:15.165582 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:15.165582 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:15.165582 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:15.165582 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:15.165582 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:15.165582 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:15.165582 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:15.165582 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 12:07:15.165582 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 12:07:15.165582 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 12:07:15.166559 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 12:07:15.166559 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:15.166559 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:15.166559 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:15.166559 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:15.166559 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:15.166559 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:15.166559 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:15.166559 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:15.166559 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:15.166559 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:15.166559 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:15.166559 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:15.166559 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:15.166559 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:15.166559 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:15.166559 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:15.168844 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 12:07:15.168844 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 12:07:15.168844 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 12:07:15.168844 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 12:07:15.168844 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 12:07:15.168844 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 12:07:15.168844 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:15.168844 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:15.168844 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 302/606] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:07:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 12:07:15.168844 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467661b2-be2c-40f3-92ff-c53e9d308387 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:15.224232 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790f505-2981-45fd-834c-cde0ccdb32ab None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:15.226033 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:15.265786 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3273c88-a7d1-449b-bee1-efb08ddaf98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:15.266464 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3273c88-a7d1-449b-bee1-efb08ddaf98d None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:15.266769 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3273c88-a7d1-449b-bee1-efb08ddaf98d None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:15.267046 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3273c88-a7d1-449b-bee1-efb08ddaf98d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:15.278835 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3273c88-a7d1-449b-bee1-efb08ddaf98d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:07:15.285330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-f3273c88-a7d1-449b-bee1-efb08ddaf98d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 12:07:15.285330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:15.285330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:15.285330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:15.285330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:15.285330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:15.285330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:15.285330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:15.285330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:15.285330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:15.285330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:15.285330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:15.285330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:07:15.285330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:07:15.285330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:07:15.285330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:07:15.286310 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:07:15.286310 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:07:15.286310 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:07:15.286310 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:07:15.286310 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:15.286310 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:15.286310 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:15.286310 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:15.286310 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:15.286310 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:15.286310 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:15.286310 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:15.286310 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:15.286310 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:15.286310 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:15.286310 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:15.287178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:15.287178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:15.287178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:15.287178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:15.287178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:07:15.287178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:07:15.287178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:07:15.287178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:07:15.287178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:07:15.287178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:07:15.287178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 12:07:15.287178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:15.287178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 305/607] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Sep 21 12:07:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:15.287955 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3273c88-a7d1-449b-bee1-efb08ddaf98d None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:15.339202 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467661b2-be2c-40f3-92ff-c53e9d308387 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:15.377600 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:15.392245 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220b1f0-a209-451a-b1cc-d3382399a52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:15.392916 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220b1f0-a209-451a-b1cc-d3382399a52f None admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:15.393190 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220b1f0-a209-451a-b1cc-d3382399a52f None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:15.393456 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7220b1f0-a209-451a-b1cc-d3382399a52f None admin] PATH_INFO: `/v3/projects/b0abcc6f2ce14825bfc26e6210889c21/users/1b44dd2471684d358018f36ec0afc063/roles/327398b6ec324647b6c4ea84a59a026b` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:15.420141 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7220b1f0-a209-451a-b1cc-d3382399a52f None admin] RBAC: Authorizing `identity:create_grant(project_id=b0abcc6f2ce14825bfc26e6210889c21, user_id=1b44dd2471684d358018f36ec0afc063, role_id=327398b6ec324647b6c4ea84a59a026b)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:15.424391 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7220b1f0-a209-451a-b1cc-d3382399a52f None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:15.454710 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 303/608] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Sep 21 12:07:15 2022] PUT /identity/v3/projects/b0abcc6f2ce14825bfc26e6210889c21/users/1b44dd2471684d358018f36ec0afc063/roles/327398b6ec324647b6c4ea84a59a026b => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:07:15.455881 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220b1f0-a209-451a-b1cc-d3382399a52f None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:15.474167 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3273c88-a7d1-449b-bee1-efb08ddaf98d None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:15.619783 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f0f5e-3b69-46c2-ac70-610d28209297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:15.627589 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f0f5e-3b69-46c2-ac70-610d28209297 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:15.628342 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f0f5e-3b69-46c2-ac70-610d28209297 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:15.628854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f0f5e-3b69-46c2-ac70-610d28209297 None admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:15.630963 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f0f5e-3b69-46c2-ac70-610d28209297 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:15.633524 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f0f5e-3b69-46c2-ac70-610d28209297 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:15.635533 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f0f5e-3b69-46c2-ac70-610d28209297 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:15.680899 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 306/609] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Sep 21 12:07:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:15.688521 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f0f5e-3b69-46c2-ac70-610d28209297 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:15.733344 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:15.758775 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7220b1f0-a209-451a-b1cc-d3382399a52f None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:15.821556 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f0f5e-3b69-46c2-ac70-610d28209297 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:15.830626 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fcbf8-a52e-4d49-8ec1-84d07ab0cb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:15.831219 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fcbf8-a52e-4d49-8ec1-84d07ab0cb05 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:15.831496 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fcbf8-a52e-4d49-8ec1-84d07ab0cb05 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:15.831760 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fcbf8-a52e-4d49-8ec1-84d07ab0cb05 None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:15.833020 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295fcbf8-a52e-4d49-8ec1-84d07ab0cb05 None admin] RBAC: Adding query filter params (name=service) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:15.833328 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295fcbf8-a52e-4d49-8ec1-84d07ab0cb05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:15.835193 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295fcbf8-a52e-4d49-8ec1-84d07ab0cb05 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:15.850463 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 304/610] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Sep 21 12:07:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:15.852019 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8ea14-b29f-4b83-a9b2-91132eecd7df None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:15.852307 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8ea14-b29f-4b83-a9b2-91132eecd7df None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:15.852582 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8ea14-b29f-4b83-a9b2-91132eecd7df None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:15.853995 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 305/611] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:07:15.854593 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb8ea14-b29f-4b83-a9b2-91132eecd7df None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:15.869974 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba017f-19a3-4190-92cf-be0b695ef7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:15.870986 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba017f-19a3-4190-92cf-be0b695ef7f3 None admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:15.871464 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba017f-19a3-4190-92cf-be0b695ef7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:15.871882 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba017f-19a3-4190-92cf-be0b695ef7f3 None admin] PATH_INFO: `/v3/projects/b0abcc6f2ce14825bfc26e6210889c21/users/ab0521c25c2d4417944efa4745588f1e/roles/327398b6ec324647b6c4ea84a59a026b` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:15.887992 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba017f-19a3-4190-92cf-be0b695ef7f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=b0abcc6f2ce14825bfc26e6210889c21, user_id=ab0521c25c2d4417944efa4745588f1e, role_id=327398b6ec324647b6c4ea84a59a026b)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:15.889675 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba017f-19a3-4190-92cf-be0b695ef7f3 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:15.910999 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 307/612] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Sep 21 12:07:15 2022] PUT /identity/v3/projects/b0abcc6f2ce14825bfc26e6210889c21/users/ab0521c25c2d4417944efa4745588f1e/roles/327398b6ec324647b6c4ea84a59a026b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:07:15.915590 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57cfab-ec89-43e1-9659-ced8fad63361 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:15.918105 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57cfab-ec89-43e1-9659-ced8fad63361 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:15.920028 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57cfab-ec89-43e1-9659-ced8fad63361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:15.920592 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:15.955762 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-8f57cfab-ec89-43e1-9659-ced8fad63361 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:15.957176 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-8f57cfab-ec89-43e1-9659-ced8fad63361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:16.040310 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 308/613] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:07:16.044582 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb8ea14-b29f-4b83-a9b2-91132eecd7df None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:16.094930 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2cf1b-dbf2-48e7-b253-ecc8377b7e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:16.095644 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2cf1b-dbf2-48e7-b253-ecc8377b7e91 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:16.095959 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2cf1b-dbf2-48e7-b253-ecc8377b7e91 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:16.096243 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2cf1b-dbf2-48e7-b253-ecc8377b7e91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:16.110813 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb2cf1b-dbf2-48e7-b253-ecc8377b7e91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:16.112344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb2cf1b-dbf2-48e7-b253-ecc8377b7e91 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:16.133012 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-adb2cf1b-dbf2-48e7-b253-ecc8377b7e91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:16.133012 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:16.133012 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:16.133012 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:16.133012 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:16.133012 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:16.133012 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:16.133012 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:16.133012 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:16.133012 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:16.133012 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:16.133012 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:16.133012 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:16.133012 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:16.133012 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:16.133012 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:16.133958 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:16.133958 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:16.133958 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:16.133958 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:16.133958 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:16.133958 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:16.133958 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:16.133958 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:16.133958 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:16.133958 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:16.133958 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:16.133958 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:16.133958 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:16.133958 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:16.133958 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:16.133958 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:16.133958 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:16.135224 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:16.135224 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:16.135224 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:16.141601 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 306/614] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:16.143302 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57cfab-ec89-43e1-9659-ced8fad63361 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:16.146238 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:16.270288 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57cfab-ec89-43e1-9659-ced8fad63361 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:16.315078 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c259a6-93a9-4621-b592-da9261b7a67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:16.315694 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c259a6-93a9-4621-b592-da9261b7a67a None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:16.315977 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c259a6-93a9-4621-b592-da9261b7a67a None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:16.316251 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c259a6-93a9-4621-b592-da9261b7a67a None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:16.316893 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c259a6-93a9-4621-b592-da9261b7a67a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:16.317196 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c259a6-93a9-4621-b592-da9261b7a67a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:16.318595 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c259a6-93a9-4621-b592-da9261b7a67a None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:16.328100 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2cf1b-dbf2-48e7-b253-ecc8377b7e91 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:16.338322 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 309/615] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:16.344014 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c259a6-93a9-4621-b592-da9261b7a67a None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:16.433593 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:16.441905 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2cf1b-dbf2-48e7-b253-ecc8377b7e91 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:16.481910 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727b9c6-5202-43a2-a0dc-4521de351417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:16.482767 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727b9c6-5202-43a2-a0dc-4521de351417 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:16.483646 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727b9c6-5202-43a2-a0dc-4521de351417 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:16.484022 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727b9c6-5202-43a2-a0dc-4521de351417 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:16.496445 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7727b9c6-5202-43a2-a0dc-4521de351417 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:07:16.502089 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-7727b9c6-5202-43a2-a0dc-4521de351417 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 12:07:16.502089 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:16.502089 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:16.502089 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:16.502089 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:16.502089 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:16.502089 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:16.502089 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:16.502089 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:16.502089 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:16.502089 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:16.502089 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:16.502089 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:07:16.502089 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:07:16.502089 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:07:16.502089 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:07:16.503180 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:07:16.503180 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:07:16.503180 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:07:16.503180 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:07:16.503180 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:16.503180 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:16.503180 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:16.503180 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:16.503180 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:16.503180 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:16.503180 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:16.503180 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:16.503180 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:16.503180 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:16.503180 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:16.503180 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:16.504175 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:16.504175 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:16.504175 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:16.504175 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:16.504175 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:07:16.504175 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:07:16.504175 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:07:16.504175 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:07:16.504175 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:07:16.504175 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:07:16.504175 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 12:07:16.504175 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:16.506148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 307/616] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Sep 21 12:07:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 12:07:16.513419 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727b9c6-5202-43a2-a0dc-4521de351417 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:16.515937 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:16.633054 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c259a6-93a9-4621-b592-da9261b7a67a None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:16.639049 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727b9c6-5202-43a2-a0dc-4521de351417 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:16.669904 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0397b0-f1ac-4288-b66d-c55d8c2a7d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:16.670565 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0397b0-f1ac-4288-b66d-c55d8c2a7d50 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:16.670849 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0397b0-f1ac-4288-b66d-c55d8c2a7d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:16.671122 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0397b0-f1ac-4288-b66d-c55d8c2a7d50 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:16.684504 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0397b0-f1ac-4288-b66d-c55d8c2a7d50 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:16.685882 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0397b0-f1ac-4288-b66d-c55d8c2a7d50 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:16.693597 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a49907-bf14-42f1-acea-02efc5cbe492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:16.694205 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a49907-bf14-42f1-acea-02efc5cbe492 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:16.698429 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a49907-bf14-42f1-acea-02efc5cbe492 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:16.698720 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a49907-bf14-42f1-acea-02efc5cbe492 None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:16.699392 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a49907-bf14-42f1-acea-02efc5cbe492 None admin] RBAC: Adding query filter params (name=service) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:16.699700 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a49907-bf14-42f1-acea-02efc5cbe492 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:16.701066 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a49907-bf14-42f1-acea-02efc5cbe492 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:16.708349 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-df0397b0-f1ac-4288-b66d-c55d8c2a7d50 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 21 12:07:16.708349 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:16.708349 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:16.708349 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:16.708349 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:16.708349 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:16.708349 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:16.708349 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:16.708349 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:16.708349 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:16.708349 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:16.708349 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:16.708349 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 12:07:16.708349 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 12:07:16.708349 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 12:07:16.708349 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 12:07:16.709253 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:16.709253 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:16.709253 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 12:07:16.709253 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:16.709253 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 12:07:16.709253 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:16.709253 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:16.709253 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:16.709253 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:16.709253 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:16.709253 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:16.709253 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:16.709253 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:16.709253 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:16.709253 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:16.709253 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:16.709253 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:16.709253 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:16.710459 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:16.710459 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:16.710459 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 12:07:16.710459 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 12:07:16.710459 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 12:07:16.710459 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 12:07:16.710459 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 12:07:16.710459 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 12:07:16.710459 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 21 12:07:16.710459 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:16.710459 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 310/617] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Sep 21 12:07:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:16.720121 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0397b0-f1ac-4288-b66d-c55d8c2a7d50 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:16.720755 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 308/618] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Sep 21 12:07:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:07:16.726208 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a49907-bf14-42f1-acea-02efc5cbe492 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:16.756086 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:16.849647 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a49907-bf14-42f1-acea-02efc5cbe492 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:16.881050 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0397b0-f1ac-4288-b66d-c55d8c2a7d50 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:16.890189 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff616697-8107-4d7c-aafd-dcade4f0d069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:16.891200 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff616697-8107-4d7c-aafd-dcade4f0d069 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:16.891784 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff616697-8107-4d7c-aafd-dcade4f0d069 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:16.892253 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff616697-8107-4d7c-aafd-dcade4f0d069 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:16.904298 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:16.905885 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff616697-8107-4d7c-aafd-dcade4f0d069 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:16.908140 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff616697-8107-4d7c-aafd-dcade4f0d069 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:16.925575 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-ff616697-8107-4d7c-aafd-dcade4f0d069 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:16.925575 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:16.925575 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:16.925575 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:16.925575 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:16.925575 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:16.925575 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:16.925575 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:16.925575 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:16.925575 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:16.925575 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:16.925575 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:16.925575 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:16.925575 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:16.925575 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:16.925575 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:16.926629 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:16.926629 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:16.926629 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:16.926629 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:16.926629 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:16.926629 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:16.926629 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:16.926629 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:16.926629 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:16.926629 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:16.926629 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:16.926629 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:16.926629 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:16.926629 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:16.926629 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:16.926629 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:16.926629 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:16.927510 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:16.927510 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:16.927510 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:16.931549 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 309/619] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:16.936860 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e6e8a-a5d0-423a-8540-286b7dc3c081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:16.937422 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e6e8a-a5d0-423a-8540-286b7dc3c081 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:16.937704 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e6e8a-a5d0-423a-8540-286b7dc3c081 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:16.937980 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e6e8a-a5d0-423a-8540-286b7dc3c081 None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:16.938302 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff616697-8107-4d7c-aafd-dcade4f0d069 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:16.938745 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e6e8a-a5d0-423a-8540-286b7dc3c081 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:16.939055 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e6e8a-a5d0-423a-8540-286b7dc3c081 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:16.940484 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e6e8a-a5d0-423a-8540-286b7dc3c081 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:16.974525 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 311/620] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Sep 21 12:07:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:16.978387 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e6e8a-a5d0-423a-8540-286b7dc3c081 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:17.014670 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:17.052673 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff616697-8107-4d7c-aafd-dcade4f0d069 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:17.091104 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0634c721-3f22-47f9-9fe9-89ab9d2efca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:17.092123 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634c721-3f22-47f9-9fe9-89ab9d2efca3 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:17.092641 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634c721-3f22-47f9-9fe9-89ab9d2efca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:17.093138 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634c721-3f22-47f9-9fe9-89ab9d2efca3 None admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:17.094088 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0634c721-3f22-47f9-9fe9-89ab9d2efca3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:17.094711 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0634c721-3f22-47f9-9fe9-89ab9d2efca3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:17.096283 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0634c721-3f22-47f9-9fe9-89ab9d2efca3 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:17.110447 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 310/621] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:17.116321 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0634c721-3f22-47f9-9fe9-89ab9d2efca3 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:17.129180 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e6e8a-a5d0-423a-8540-286b7dc3c081 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:17.167040 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8329e-b992-4e1c-994d-72073113e3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:17.167664 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8329e-b992-4e1c-994d-72073113e3b9 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:17.167941 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8329e-b992-4e1c-994d-72073113e3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:17.169683 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8329e-b992-4e1c-994d-72073113e3b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:17.194453 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f8329e-b992-4e1c-994d-72073113e3b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:17.196987 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f8329e-b992-4e1c-994d-72073113e3b9 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:17.235599 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-24f8329e-b992-4e1c-994d-72073113e3b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:17.235599 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:17.235599 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:17.235599 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:17.235599 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:17.235599 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:17.235599 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:17.235599 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:17.235599 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:17.235599 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:17.235599 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:17.235599 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:17.235599 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:17.235599 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:17.235599 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:17.235599 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:17.236608 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:17.236608 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:17.236608 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:17.236608 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:17.236608 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:17.236608 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:17.236608 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:17.236608 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:17.236608 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:17.236608 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:17.236608 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:17.236608 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:17.236608 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:17.236608 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:17.236608 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:17.236608 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:17.236608 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:17.237488 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:17.237488 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:17.237488 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:17.237488 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 312/622] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:17.255409 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8329e-b992-4e1c-994d-72073113e3b9 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:17.277064 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0634c721-3f22-47f9-9fe9-89ab9d2efca3 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:17.310733 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:17.316197 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c840e-1d44-44f3-af17-15d260a8a0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:17.316911 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c840e-1d44-44f3-af17-15d260a8a0e7 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:17.317254 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c840e-1d44-44f3-af17-15d260a8a0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:17.317591 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c840e-1d44-44f3-af17-15d260a8a0e7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:17.328314 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c840e-1d44-44f3-af17-15d260a8a0e7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:17.329958 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c840e-1d44-44f3-af17-15d260a8a0e7 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:17.343023 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-ea0c840e-1d44-44f3-af17-15d260a8a0e7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 21 12:07:17.343023 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:17.343023 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:17.343023 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:17.343023 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:17.343023 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:17.343023 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:17.343023 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:17.343023 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:17.343023 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:17.343023 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:17.343023 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:17.343023 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 12:07:17.343023 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 12:07:17.343023 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 12:07:17.343023 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 12:07:17.344169 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:17.344169 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:17.344169 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 12:07:17.344169 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:17.344169 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 12:07:17.344169 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:17.344169 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:17.344169 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:17.344169 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:17.344169 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:17.344169 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:17.344169 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:17.344169 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:17.344169 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:17.344169 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:17.344169 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:17.344169 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:17.344169 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:17.345330 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:17.345330 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:17.345330 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 12:07:17.345330 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 12:07:17.345330 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 12:07:17.345330 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 12:07:17.345330 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 12:07:17.345330 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 12:07:17.345330 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 21 12:07:17.345330 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:17.346074 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 311/623] 10.222.0.60 () {56 vars in 1093 bytes} [Wed Sep 21 12:07:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:17.353525 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c840e-1d44-44f3-af17-15d260a8a0e7 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:17.361032 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:17.471719 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8329e-b992-4e1c-994d-72073113e3b9 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:17.543783 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc426cc-4a2a-489f-b2c6-2118947e11a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:17.544525 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc426cc-4a2a-489f-b2c6-2118947e11a8 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:17.544810 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc426cc-4a2a-489f-b2c6-2118947e11a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:17.545135 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc426cc-4a2a-489f-b2c6-2118947e11a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:17.545788 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc426cc-4a2a-489f-b2c6-2118947e11a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:17.546092 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc426cc-4a2a-489f-b2c6-2118947e11a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:17.547501 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc426cc-4a2a-489f-b2c6-2118947e11a8 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:17.581644 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 313/624] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:17.583722 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c840e-1d44-44f3-af17-15d260a8a0e7 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:17.586331 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc426cc-4a2a-489f-b2c6-2118947e11a8 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:17.635301 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e422ab2-7288-41f0-9c17-88eee5259501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:17.639141 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e422ab2-7288-41f0-9c17-88eee5259501 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:17.639889 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e422ab2-7288-41f0-9c17-88eee5259501 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:17.640469 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e422ab2-7288-41f0-9c17-88eee5259501 None admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:17.642155 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e422ab2-7288-41f0-9c17-88eee5259501 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:17.642932 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e422ab2-7288-41f0-9c17-88eee5259501 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:17.645768 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e422ab2-7288-41f0-9c17-88eee5259501 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:17.675900 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 312/625] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Sep 21 12:07:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:17.677483 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73180315-1a31-44f9-b0f8-5a0152add220 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:17.677871 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73180315-1a31-44f9-b0f8-5a0152add220 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:17.678600 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73180315-1a31-44f9-b0f8-5a0152add220 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:17.681049 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 313/626] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:07:17.686710 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99571b-6009-493c-9ae2-e46ca418cd6a None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:17.686989 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99571b-6009-493c-9ae2-e46ca418cd6a None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:17.687272 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99571b-6009-493c-9ae2-e46ca418cd6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:17.711556 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-6d99571b-6009-493c-9ae2-e46ca418cd6a None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:17.713426 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-6d99571b-6009-493c-9ae2-e46ca418cd6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:17.722733 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:17.740751 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc426cc-4a2a-489f-b2c6-2118947e11a8 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:17.774159 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:17.790063 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd508891-4951-456a-b229-520cad2feb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:17.790807 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd508891-4951-456a-b229-520cad2feb1a None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:17.791161 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd508891-4951-456a-b229-520cad2feb1a None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:17.791777 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd508891-4951-456a-b229-520cad2feb1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:17.801861 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd508891-4951-456a-b229-520cad2feb1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:17.803618 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd508891-4951-456a-b229-520cad2feb1a None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:17.807366 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 314/627] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 21 12:07:17.808395 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d99571b-6009-493c-9ae2-e46ca418cd6a None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:17.829169 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-cd508891-4951-456a-b229-520cad2feb1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:17.829169 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:17.829169 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:17.829169 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:17.829169 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:17.829169 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:17.829169 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:17.829169 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:17.829169 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:17.829169 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:17.829169 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:17.829169 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:17.829169 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 12:07:17.829169 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 12:07:17.829169 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 12:07:17.830269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 12:07:17.830269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:17.830269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:17.830269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:17.830269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:17.830269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:17.830269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:17.830269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:17.830269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:17.830269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:17.830269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:17.830269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:17.830269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:17.830269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:17.830269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:17.830269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:17.830269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:17.831240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 12:07:17.831240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 12:07:17.831240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 12:07:17.831240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 12:07:17.831240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 12:07:17.831240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 12:07:17.831240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:17.831240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:17.835123 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 314/628] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:07:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:17.841030 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd508891-4951-456a-b229-520cad2feb1a None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:17.988464 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd508891-4951-456a-b229-520cad2feb1a None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:17.999805 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d99571b-6009-493c-9ae2-e46ca418cd6a None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:18.030777 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a772100-1f34-4556-a85e-51ff40ddc9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:18.031710 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a772100-1f34-4556-a85e-51ff40ddc9ab None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:18.032186 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a772100-1f34-4556-a85e-51ff40ddc9ab None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:18.032815 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a772100-1f34-4556-a85e-51ff40ddc9ab None admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:18.033723 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a772100-1f34-4556-a85e-51ff40ddc9ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:18.034178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a772100-1f34-4556-a85e-51ff40ddc9ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:18.035994 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a772100-1f34-4556-a85e-51ff40ddc9ab None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:18.052331 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 315/629] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Sep 21 12:07:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:07:18.059594 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a772100-1f34-4556-a85e-51ff40ddc9ab None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:18.077430 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:18.079291 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae37a5-8b73-4044-bab1-7f0f23d4dece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:18.080101 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae37a5-8b73-4044-bab1-7f0f23d4dece None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:18.080401 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae37a5-8b73-4044-bab1-7f0f23d4dece None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:18.080678 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae37a5-8b73-4044-bab1-7f0f23d4dece None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:18.149923 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:18.175077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edae37a5-8b73-4044-bab1-7f0f23d4dece None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:18.177389 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edae37a5-8b73-4044-bab1-7f0f23d4dece None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:18.192686 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a772100-1f34-4556-a85e-51ff40ddc9ab None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:18.237397 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6b500-1975-4347-8b07-1c0ef96e5886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:18.238400 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6b500-1975-4347-8b07-1c0ef96e5886 None admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:18.238736 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6b500-1975-4347-8b07-1c0ef96e5886 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:18.238951 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6b500-1975-4347-8b07-1c0ef96e5886 None admin] PATH_INFO: `/v3/projects/b0abcc6f2ce14825bfc26e6210889c21/users/cbc2bab11b264196859802907b93ac37/roles/327398b6ec324647b6c4ea84a59a026b` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:18.255578 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f6b500-1975-4347-8b07-1c0ef96e5886 None admin] RBAC: Authorizing `identity:create_grant(project_id=b0abcc6f2ce14825bfc26e6210889c21, user_id=cbc2bab11b264196859802907b93ac37, role_id=327398b6ec324647b6c4ea84a59a026b)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:18.257041 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f6b500-1975-4347-8b07-1c0ef96e5886 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:18.271132 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 316/630] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Sep 21 12:07:18 2022] PUT /identity/v3/projects/b0abcc6f2ce14825bfc26e6210889c21/users/cbc2bab11b264196859802907b93ac37/roles/327398b6ec324647b6c4ea84a59a026b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:07:18.272281 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6b500-1975-4347-8b07-1c0ef96e5886 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:18.298353 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 315/631] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:07:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 12:07:18.301016 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3866dc1-3619-4f37-b424-156c7988738d None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:18.301684 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3866dc1-3619-4f37-b424-156c7988738d None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:18.302385 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3866dc1-3619-4f37-b424-156c7988738d None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:18.305308 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 316/632] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:07:18.306680 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3866dc1-3619-4f37-b424-156c7988738d None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:18.352405 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:18.397898 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6b500-1975-4347-8b07-1c0ef96e5886 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:18.422775 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:18.438511 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde9752-2a7b-465b-8567-bd81db4367de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:18.439365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde9752-2a7b-465b-8567-bd81db4367de None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:18.439581 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde9752-2a7b-465b-8567-bd81db4367de None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:18.439856 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde9752-2a7b-465b-8567-bd81db4367de None admin] PATH_INFO: `/v3/roles/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:18.443616 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3866dc1-3619-4f37-b424-156c7988738d None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:18.453231 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde9752-2a7b-465b-8567-bd81db4367de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:07:18.460285 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-abde9752-2a7b-465b-8567-bd81db4367de None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 12:07:18.460285 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:18.460285 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:18.460285 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:18.460285 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:18.460285 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:18.460285 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:18.460285 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:18.460285 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:18.460285 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:18.460285 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:18.460285 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:18.460285 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:07:18.460285 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:07:18.460285 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:07:18.460285 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:07:18.461323 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:07:18.461323 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:07:18.461323 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:07:18.461323 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:07:18.461323 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:18.461323 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:18.461323 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:18.461323 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:18.461323 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:18.461323 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:18.461323 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:18.461323 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:18.461323 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:18.461323 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:18.461323 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:18.461323 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:18.463141 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:18.463141 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:18.463141 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:18.463141 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:18.463141 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:07:18.463141 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:07:18.463141 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:07:18.463141 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:07:18.463141 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:07:18.463141 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:07:18.463141 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 12:07:18.463141 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:18.463141 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 317/633] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Sep 21 12:07:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:18.463141 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa2a84-3131-4e33-b88b-26c30ab060cb None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:18.463908 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa2a84-3131-4e33-b88b-26c30ab060cb None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:18.463908 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa2a84-3131-4e33-b88b-26c30ab060cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:18.485464 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-f3aa2a84-3131-4e33-b88b-26c30ab060cb None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:18.486572 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f3aa2a84-3131-4e33-b88b-26c30ab060cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:18.496705 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20642651-0384-4236-9d77-0041b98470bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:18.497406 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20642651-0384-4236-9d77-0041b98470bd None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:18.500546 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20642651-0384-4236-9d77-0041b98470bd None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:18.500546 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20642651-0384-4236-9d77-0041b98470bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:18.516713 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20642651-0384-4236-9d77-0041b98470bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:18.518196 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20642651-0384-4236-9d77-0041b98470bd None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:18.536300 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-20642651-0384-4236-9d77-0041b98470bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:18.536300 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:18.536300 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:18.536300 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:18.536300 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:18.536300 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:18.536300 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:18.536300 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:18.536300 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:18.536300 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:18.536300 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:18.536300 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:18.536300 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:18.536300 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:18.536300 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:18.536300 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:18.537288 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:18.537288 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:18.537288 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:18.537288 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:18.537288 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:18.537288 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:18.537288 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:18.537288 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:18.537288 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:18.537288 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:18.537288 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:18.537288 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:18.537288 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:18.537288 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:18.537288 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:18.537288 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:18.537288 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:18.538181 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:18.538181 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:18.538181 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:18.538181 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 317/634] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:18.538910 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20642651-0384-4236-9d77-0041b98470bd None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:18.572036 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 318/635] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:07:18.572915 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa2a84-3131-4e33-b88b-26c30ab060cb None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:18.628158 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:18.657766 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20642651-0384-4236-9d77-0041b98470bd None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:18.678392 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa2a84-3131-4e33-b88b-26c30ab060cb None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:18.688161 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:18.698465 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c45ae9-a9a4-4ab3-811b-a033ccf4e71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:18.699081 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c45ae9-a9a4-4ab3-811b-a033ccf4e71e None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:18.699367 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c45ae9-a9a4-4ab3-811b-a033ccf4e71e None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:18.699644 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c45ae9-a9a4-4ab3-811b-a033ccf4e71e None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:18.700458 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c45ae9-a9a4-4ab3-811b-a033ccf4e71e None admin] RBAC: Adding query filter params (name=service) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:18.700771 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c45ae9-a9a4-4ab3-811b-a033ccf4e71e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:18.702163 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c45ae9-a9a4-4ab3-811b-a033ccf4e71e None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:18.712353 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 318/636] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Sep 21 12:07:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:18.713694 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85c1ce-bd88-4273-9034-de62997673fd None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:18.714072 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85c1ce-bd88-4273-9034-de62997673fd None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:18.714369 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85c1ce-bd88-4273-9034-de62997673fd None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:18.716270 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 319/637] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:07:18.722205 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc60785d-91ea-4025-bd9e-43825fe8e5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:18.722858 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60785d-91ea-4025-bd9e-43825fe8e5e1 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:18.723416 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60785d-91ea-4025-bd9e-43825fe8e5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:18.723522 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60785d-91ea-4025-bd9e-43825fe8e5e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:18.724131 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc60785d-91ea-4025-bd9e-43825fe8e5e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:18.724430 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc60785d-91ea-4025-bd9e-43825fe8e5e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:18.727942 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc60785d-91ea-4025-bd9e-43825fe8e5e1 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:18.728074 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85c1ce-bd88-4273-9034-de62997673fd None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:18.740944 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 319/638] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:18.742322 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbcba2-0b16-4a84-8cb3-06466f6618b0 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:18.742635 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbcba2-0b16-4a84-8cb3-06466f6618b0 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:18.742908 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbcba2-0b16-4a84-8cb3-06466f6618b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:18.764889 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-b8bbcba2-0b16-4a84-8cb3-06466f6618b0 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:18.766011 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b8bbcba2-0b16-4a84-8cb3-06466f6618b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:18.837467 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 320/639] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:07:18.838458 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bbcba2-0b16-4a84-8cb3-06466f6618b0 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:18.882955 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85c1ce-bd88-4273-9034-de62997673fd None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:18.886904 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:18.924064 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584701dd-57c7-43bb-8452-b7cbe22352e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:18.924751 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584701dd-57c7-43bb-8452-b7cbe22352e8 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:18.925131 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584701dd-57c7-43bb-8452-b7cbe22352e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:18.925409 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584701dd-57c7-43bb-8452-b7cbe22352e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:18.940568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584701dd-57c7-43bb-8452-b7cbe22352e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:18.942216 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584701dd-57c7-43bb-8452-b7cbe22352e8 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:18.946180 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bbcba2-0b16-4a84-8cb3-06466f6618b0 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:18.958830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-584701dd-57c7-43bb-8452-b7cbe22352e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:18.958830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:18.958830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:18.958830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:18.958830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:18.958830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:18.958830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:18.958830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:18.958830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:18.958830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:18.958830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:18.958830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:18.958830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:18.958830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:18.958830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:18.958830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:18.959866 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:18.959866 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:18.959866 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:18.959866 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:18.959866 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:18.959866 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:18.959866 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:18.959866 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:18.959866 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:18.959866 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:18.959866 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:18.959866 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:18.959866 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:18.959866 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:18.959866 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:18.959866 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:18.959866 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:18.961359 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:18.961359 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:18.961359 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:18.961359 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 320/640] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:18.961986 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584701dd-57c7-43bb-8452-b7cbe22352e8 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:18.987646 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55e870-5b19-406d-83ad-579753472f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:18.988401 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55e870-5b19-406d-83ad-579753472f23 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:18.988678 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55e870-5b19-406d-83ad-579753472f23 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:18.988982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55e870-5b19-406d-83ad-579753472f23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:18.996631 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e55e870-5b19-406d-83ad-579753472f23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:18.998083 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e55e870-5b19-406d-83ad-579753472f23 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:19.009103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:19.013607 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-3e55e870-5b19-406d-83ad-579753472f23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:19.013607 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:19.013607 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:19.013607 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:19.013607 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:19.013607 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:19.013607 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:19.013607 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:19.013607 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:19.013607 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:19.013607 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:19.013607 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:19.013607 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 12:07:19.013607 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 12:07:19.013607 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 12:07:19.014685 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 12:07:19.014685 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:19.014685 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:19.014685 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:19.014685 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:19.014685 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:19.014685 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:19.014685 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:19.014685 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:19.014685 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:19.014685 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:19.014685 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:19.014685 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:19.014685 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:19.014685 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:19.014685 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:19.014685 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:19.015822 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 12:07:19.015822 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 12:07:19.015822 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 12:07:19.015822 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 12:07:19.015822 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 12:07:19.015822 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 12:07:19.015822 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:19.015822 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:19.018593 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 321/641] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:07:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:19.019753 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55e870-5b19-406d-83ad-579753472f23 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:19.089584 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584701dd-57c7-43bb-8452-b7cbe22352e8 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:19.125367 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2c595-abfd-4f7d-82ed-9e1708f23c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:19.126108 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2c595-abfd-4f7d-82ed-9e1708f23c77 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:19.126410 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2c595-abfd-4f7d-82ed-9e1708f23c77 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:19.126688 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2c595-abfd-4f7d-82ed-9e1708f23c77 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:19.132843 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55e870-5b19-406d-83ad-579753472f23 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:19.134712 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:19.140060 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2c595-abfd-4f7d-82ed-9e1708f23c77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:07:19.146401 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-a2f2c595-abfd-4f7d-82ed-9e1708f23c77 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 12:07:19.146401 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:19.146401 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:19.146401 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:19.146401 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:19.146401 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:19.146401 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:19.146401 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:19.146401 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:19.146401 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:19.146401 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:19.146401 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:19.146401 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:07:19.146401 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:07:19.146401 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:07:19.146401 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:07:19.147573 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:07:19.147573 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:07:19.147573 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:07:19.147573 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:07:19.147573 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:19.147573 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:19.147573 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:19.147573 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:19.147573 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:19.147573 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:19.147573 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:19.147573 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:19.147573 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:19.147573 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:19.147573 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:19.147573 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:19.148984 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:19.148984 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:19.148984 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:19.148984 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:19.148984 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:07:19.148984 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:07:19.148984 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:07:19.148984 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:07:19.148984 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:07:19.148984 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:07:19.148984 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 12:07:19.148984 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:19.148984 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 321/642] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Sep 21 12:07:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:19.149693 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2c595-abfd-4f7d-82ed-9e1708f23c77 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:19.186143 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b2c17-20ee-4cd6-ab6a-0cdb53e21707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:19.187022 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b2c17-20ee-4cd6-ab6a-0cdb53e21707 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:19.187305 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b2c17-20ee-4cd6-ab6a-0cdb53e21707 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:19.188528 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b2c17-20ee-4cd6-ab6a-0cdb53e21707 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:19.189186 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b2c17-20ee-4cd6-ab6a-0cdb53e21707 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:19.189489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b2c17-20ee-4cd6-ab6a-0cdb53e21707 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:19.190882 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b2c17-20ee-4cd6-ab6a-0cdb53e21707 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:19.206444 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 322/643] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:19.207729 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b2c17-20ee-4cd6-ab6a-0cdb53e21707 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:19.263591 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2c595-abfd-4f7d-82ed-9e1708f23c77 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:19.265317 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:19.301792 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19094c-424f-41d6-ae07-363226db18b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:19.302419 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19094c-424f-41d6-ae07-363226db18b4 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:19.302699 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19094c-424f-41d6-ae07-363226db18b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:19.303227 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19094c-424f-41d6-ae07-363226db18b4 None admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:19.303651 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19094c-424f-41d6-ae07-363226db18b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:19.303957 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19094c-424f-41d6-ae07-363226db18b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:19.305906 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19094c-424f-41d6-ae07-363226db18b4 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:19.315536 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b2c17-20ee-4cd6-ab6a-0cdb53e21707 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:19.319247 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 322/644] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Sep 21 12:07:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:19.320766 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19094c-424f-41d6-ae07-363226db18b4 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:19.351848 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4cffb3-be65-4849-89d1-b7bed9db3fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:19.352440 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cffb3-be65-4849-89d1-b7bed9db3fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:19.352712 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cffb3-be65-4849-89d1-b7bed9db3fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:19.352981 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cffb3-be65-4849-89d1-b7bed9db3fb7 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:19.353635 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4cffb3-be65-4849-89d1-b7bed9db3fb7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:19.353929 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4cffb3-be65-4849-89d1-b7bed9db3fb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:19.355309 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4cffb3-be65-4849-89d1-b7bed9db3fb7 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:19.363480 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 323/645] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Sep 21 12:07:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:19.369157 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4cffb3-be65-4849-89d1-b7bed9db3fb7 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:19.397568 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:19.438347 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19094c-424f-41d6-ae07-363226db18b4 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:19.475381 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c0e9c-544c-44c0-8646-c0da6714ea69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:19.476006 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c0e9c-544c-44c0-8646-c0da6714ea69 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:19.476299 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c0e9c-544c-44c0-8646-c0da6714ea69 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:19.476549 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c0e9c-544c-44c0-8646-c0da6714ea69 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:19.486080 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4cffb3-be65-4849-89d1-b7bed9db3fb7 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:19.487199 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c0e9c-544c-44c0-8646-c0da6714ea69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:07:19.492505 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-b49c0e9c-544c-44c0-8646-c0da6714ea69 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 12:07:19.492505 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:19.492505 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:19.492505 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:19.492505 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:19.492505 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:19.492505 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:19.492505 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:19.492505 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:19.492505 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:19.492505 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:19.492505 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:19.492505 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:07:19.492505 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:07:19.492505 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:07:19.492505 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:07:19.493450 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:07:19.493450 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:07:19.493450 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:07:19.493450 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:07:19.493450 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:19.493450 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:19.493450 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:19.493450 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:19.493450 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:19.493450 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:19.493450 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:19.493450 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:19.493450 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:19.493450 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:19.493450 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:19.493450 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:19.495478 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:19.495478 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:19.495478 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:19.495478 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:19.495478 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:07:19.495478 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:07:19.495478 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:07:19.495478 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:07:19.495478 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:07:19.495478 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:07:19.495478 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 12:07:19.495478 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:19.495478 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 323/646] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Sep 21 12:07:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:19.495478 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c0e9c-544c-44c0-8646-c0da6714ea69 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:19.524620 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:19.530505 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8853c-b7d4-4dbd-8130-8000465c49f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:19.531139 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8853c-b7d4-4dbd-8130-8000465c49f6 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:19.531417 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8853c-b7d4-4dbd-8130-8000465c49f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:19.531689 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8853c-b7d4-4dbd-8130-8000465c49f6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:19.541416 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8853c-b7d4-4dbd-8130-8000465c49f6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:19.542901 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8853c-b7d4-4dbd-8130-8000465c49f6 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:19.555624 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-30d8853c-b7d4-4dbd-8130-8000465c49f6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 21 12:07:19.555624 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:19.555624 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:19.555624 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:19.555624 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:19.555624 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:19.555624 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:19.555624 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:19.555624 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:19.555624 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:19.555624 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:19.555624 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:19.555624 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 12:07:19.555624 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 12:07:19.555624 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 12:07:19.555624 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 12:07:19.556554 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:19.556554 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:19.556554 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 12:07:19.556554 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:19.556554 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 12:07:19.556554 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:19.556554 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:19.556554 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:19.556554 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:19.556554 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:19.556554 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:19.556554 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:19.556554 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:19.556554 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:19.556554 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:19.556554 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:19.556554 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:19.556554 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:19.557492 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:19.557492 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:19.557492 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 12:07:19.557492 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 12:07:19.557492 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 12:07:19.557492 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 12:07:19.557492 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 12:07:19.557492 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 12:07:19.557492 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 21 12:07:19.557492 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:19.561305 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 324/647] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:07:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:19.562156 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8853c-b7d4-4dbd-8130-8000465c49f6 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:19.613577 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c0e9c-544c-44c0-8646-c0da6714ea69 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:19.651464 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a07819-9b8e-428f-b8bd-28c02127f2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:19.652064 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a07819-9b8e-428f-b8bd-28c02127f2ae None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:19.652334 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a07819-9b8e-428f-b8bd-28c02127f2ae None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:19.652643 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a07819-9b8e-428f-b8bd-28c02127f2ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:19.653594 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a07819-9b8e-428f-b8bd-28c02127f2ae None admin] RBAC: Adding query filter params (role.id=327398b6ec324647b6c4ea84a59a026b, scope.project.id=b0abcc6f2ce14825bfc26e6210889c21, user.id=6cb4001f94b8439180ca2a93d3b279b1) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:19.653897 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a07819-9b8e-428f-b8bd-28c02127f2ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:19.655446 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a07819-9b8e-428f-b8bd-28c02127f2ae None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:19.658068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:19.661385 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 324/648] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:07:19 2022] GET /identity/v3/role_assignments?user.id=6cb4001f94b8439180ca2a93d3b279b1&scope.project.id=b0abcc6f2ce14825bfc26e6210889c21&role.id=327398b6ec324647b6c4ea84a59a026b => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:19.662418 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a07819-9b8e-428f-b8bd-28c02127f2ae None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:19.690800 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8853c-b7d4-4dbd-8130-8000465c49f6 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:19.739995 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b156c-69ac-4288-a748-89d3278cbd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:19.742057 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b156c-69ac-4288-a748-89d3278cbd95 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:19.742549 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b156c-69ac-4288-a748-89d3278cbd95 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:19.743284 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b156c-69ac-4288-a748-89d3278cbd95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:19.758456 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b156c-69ac-4288-a748-89d3278cbd95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:19.760560 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b156c-69ac-4288-a748-89d3278cbd95 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:19.784650 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-a78b156c-69ac-4288-a748-89d3278cbd95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:19.784650 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:19.784650 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:19.784650 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:19.784650 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:19.784650 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:19.784650 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:19.784650 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:19.784650 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:19.784650 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:19.784650 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:19.784650 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:19.784650 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:19.784650 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:19.784650 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:19.784650 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:19.786067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:19.786067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:19.786067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:19.786067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:19.786067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:19.786067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:19.786067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:19.786067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:19.786067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:19.786067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:19.786067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:19.786067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:19.786067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:19.786067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:19.786067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:19.786067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:19.786067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:19.787211 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:19.787211 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:19.787211 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:19.787211 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 325/649] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:19.787211 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b156c-69ac-4288-a748-89d3278cbd95 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:19.791281 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:19.810216 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a07819-9b8e-428f-b8bd-28c02127f2ae None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:19.850495 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d51d6-a5ac-4be8-a3ea-6b0e55b15b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:19.851522 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d51d6-a5ac-4be8-a3ea-6b0e55b15b01 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:19.851969 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d51d6-a5ac-4be8-a3ea-6b0e55b15b01 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:19.852417 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d51d6-a5ac-4be8-a3ea-6b0e55b15b01 None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:19.853259 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207d51d6-a5ac-4be8-a3ea-6b0e55b15b01 None admin] RBAC: Adding query filter params (name=service) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:19.853762 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207d51d6-a5ac-4be8-a3ea-6b0e55b15b01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:19.855436 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207d51d6-a5ac-4be8-a3ea-6b0e55b15b01 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:19.866441 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 325/650] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Sep 21 12:07:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:19.872496 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d51d6-a5ac-4be8-a3ea-6b0e55b15b01 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:19.915488 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b156c-69ac-4288-a748-89d3278cbd95 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:19.969757 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc568e36-4948-4b8a-a94b-b063cfca97b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:19.971588 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc568e36-4948-4b8a-a94b-b063cfca97b1 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:19.971588 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc568e36-4948-4b8a-a94b-b063cfca97b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:19.971813 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc568e36-4948-4b8a-a94b-b063cfca97b1 None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:19.972445 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc568e36-4948-4b8a-a94b-b063cfca97b1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:19.972753 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc568e36-4948-4b8a-a94b-b063cfca97b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:19.974303 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc568e36-4948-4b8a-a94b-b063cfca97b1 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:19.978912 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:20.001515 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 326/651] 10.222.0.60 () {56 vars in 1137 bytes} [Wed Sep 21 12:07:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:20.002758 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc568e36-4948-4b8a-a94b-b063cfca97b1 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:20.010759 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d51d6-a5ac-4be8-a3ea-6b0e55b15b01 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:20.052206 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a48511-662a-46bb-8b9f-9b0ee11125f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:20.053145 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a48511-662a-46bb-8b9f-9b0ee11125f7 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:20.053632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a48511-662a-46bb-8b9f-9b0ee11125f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:20.054712 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a48511-662a-46bb-8b9f-9b0ee11125f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:20.055561 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a48511-662a-46bb-8b9f-9b0ee11125f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:20.056517 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a48511-662a-46bb-8b9f-9b0ee11125f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:20.058629 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a48511-662a-46bb-8b9f-9b0ee11125f7 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:20.076525 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 326/652] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:20.077649 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a48511-662a-46bb-8b9f-9b0ee11125f7 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:20.092894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:20.125628 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc568e36-4948-4b8a-a94b-b063cfca97b1 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:20.164261 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7ec24-fcc6-47fc-bffc-0ab76bdb4644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:20.164877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7ec24-fcc6-47fc-bffc-0ab76bdb4644 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:20.165150 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7ec24-fcc6-47fc-bffc-0ab76bdb4644 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:20.165414 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7ec24-fcc6-47fc-bffc-0ab76bdb4644 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:20.180726 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa7ec24-fcc6-47fc-bffc-0ab76bdb4644 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:20.183071 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa7ec24-fcc6-47fc-bffc-0ab76bdb4644 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:20.205803 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-7fa7ec24-fcc6-47fc-bffc-0ab76bdb4644 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:20.205803 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:20.205803 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:20.205803 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:20.205803 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:20.205803 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:20.205803 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:20.205803 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:20.205803 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:20.205803 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:20.205803 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:20.205803 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:20.205803 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:20.205803 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:20.205803 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:20.205803 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:20.206853 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:20.206853 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:20.206853 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:20.206853 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:20.206853 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:20.206853 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:20.206853 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:20.206853 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:20.206853 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:20.206853 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:20.206853 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:20.206853 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:20.206853 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:20.206853 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:20.206853 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:20.206853 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:20.206853 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:20.207822 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:20.207822 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:20.207822 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:20.207995 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a48511-662a-46bb-8b9f-9b0ee11125f7 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:20.215828 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 327/653] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:20.215828 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7ec24-fcc6-47fc-bffc-0ab76bdb4644 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:20.257634 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388fe98-ae34-4e8f-b0d6-e3bf0e51d747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:20.259220 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388fe98-ae34-4e8f-b0d6-e3bf0e51d747 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:20.259732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388fe98-ae34-4e8f-b0d6-e3bf0e51d747 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:20.260273 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388fe98-ae34-4e8f-b0d6-e3bf0e51d747 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:20.266548 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:20.331919 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7ec24-fcc6-47fc-bffc-0ab76bdb4644 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:20.361303 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388fe98-ae34-4e8f-b0d6-e3bf0e51d747 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:20.362781 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388fe98-ae34-4e8f-b0d6-e3bf0e51d747 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:20.373468 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:20.374684 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb31db-7e1f-4087-82b5-ab7440826eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:20.376446 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb31db-7e1f-4087-82b5-ab7440826eee None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:20.377140 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb31db-7e1f-4087-82b5-ab7440826eee None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:20.377623 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb31db-7e1f-4087-82b5-ab7440826eee None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:20.390070 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb31db-7e1f-4087-82b5-ab7440826eee None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:20.392731 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb31db-7e1f-4087-82b5-ab7440826eee None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:20.414354 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-adbb31db-7e1f-4087-82b5-ab7440826eee None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 21 12:07:20.414354 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:20.414354 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:20.414354 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:20.414354 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:20.414354 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:20.414354 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:20.414354 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:20.414354 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:20.414354 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:20.414354 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:20.414354 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:20.414354 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 12:07:20.414354 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 12:07:20.414354 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 12:07:20.414354 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 12:07:20.415365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:20.415365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:20.415365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 12:07:20.415365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:20.415365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 12:07:20.415365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:20.415365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:20.415365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:20.415365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:20.415365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:20.415365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:20.415365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:20.415365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:20.415365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:20.415365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:20.415365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:20.415365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:20.415365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:20.416305 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:20.416305 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:20.416305 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 12:07:20.416305 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 12:07:20.416305 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 12:07:20.416305 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 12:07:20.416305 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 12:07:20.416305 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 12:07:20.416305 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 21 12:07:20.416305 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:20.418730 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 328/654] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:07:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:20.419760 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb31db-7e1f-4087-82b5-ab7440826eee None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:20.488144 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 327/655] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:07:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 12:07:20.489255 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388fe98-ae34-4e8f-b0d6-e3bf0e51d747 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:20.563999 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb31db-7e1f-4087-82b5-ab7440826eee None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:20.574867 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:20.600460 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388fe98-ae34-4e8f-b0d6-e3bf0e51d747 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:20.609881 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:20.610479 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703b166-a6cb-4e30-aaaf-74c47873e7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:20.611103 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703b166-a6cb-4e30-aaaf-74c47873e7e2 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:20.611417 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703b166-a6cb-4e30-aaaf-74c47873e7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:20.611723 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703b166-a6cb-4e30-aaaf-74c47873e7e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:20.612453 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703b166-a6cb-4e30-aaaf-74c47873e7e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:20.612757 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703b166-a6cb-4e30-aaaf-74c47873e7e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:20.614541 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703b166-a6cb-4e30-aaaf-74c47873e7e2 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:20.627099 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 329/656] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:20.627931 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703b166-a6cb-4e30-aaaf-74c47873e7e2 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:20.644767 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7baaa5-df97-4968-817b-c2da9e37ae52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:20.645413 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7baaa5-df97-4968-817b-c2da9e37ae52 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:20.645689 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7baaa5-df97-4968-817b-c2da9e37ae52 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:20.645967 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7baaa5-df97-4968-817b-c2da9e37ae52 None admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:20.646735 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7baaa5-df97-4968-817b-c2da9e37ae52 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:20.647044 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7baaa5-df97-4968-817b-c2da9e37ae52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:20.649104 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7baaa5-df97-4968-817b-c2da9e37ae52 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:20.668640 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 328/657] 10.222.0.60 () {56 vars in 1137 bytes} [Wed Sep 21 12:07:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:20.669963 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a1173-a6e7-4c99-95eb-b4e68410995c None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:20.670250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a1173-a6e7-4c99-95eb-b4e68410995c None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:20.670553 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a1173-a6e7-4c99-95eb-b4e68410995c None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:20.671939 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 329/658] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:07:20.675310 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a1173-a6e7-4c99-95eb-b4e68410995c None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:20.755382 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703b166-a6cb-4e30-aaaf-74c47873e7e2 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:20.803443 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abda50-fd8b-4d47-a49e-45d455b9a51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:20.805358 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abda50-fd8b-4d47-a49e-45d455b9a51c None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:20.805934 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abda50-fd8b-4d47-a49e-45d455b9a51c None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:20.806089 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a1173-a6e7-4c99-95eb-b4e68410995c None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:20.806621 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abda50-fd8b-4d47-a49e-45d455b9a51c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:20.820703 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11abda50-fd8b-4d47-a49e-45d455b9a51c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:20.822160 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11abda50-fd8b-4d47-a49e-45d455b9a51c None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:20.837394 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-11abda50-fd8b-4d47-a49e-45d455b9a51c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:20.837394 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:20.837394 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:20.837394 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:20.837394 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:20.837394 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:20.837394 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:20.837394 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:20.837394 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:20.837394 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:20.837394 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:20.837394 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:20.837394 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:20.837394 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:20.837394 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:20.837394 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:20.839053 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:20.839053 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:20.839053 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:20.839053 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:20.839053 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:20.839053 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:20.839053 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:20.839053 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:20.839053 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:20.839053 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:20.839053 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:20.839053 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:20.839053 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:20.839053 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:20.839053 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:20.839053 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:20.839053 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:20.840449 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:20.840449 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:20.840449 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:20.840449 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 330/659] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:20.840449 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abda50-fd8b-4d47-a49e-45d455b9a51c None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:20.855846 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672097f4-60a1-4c77-bcbb-d88852b32a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:20.856405 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672097f4-60a1-4c77-bcbb-d88852b32a18 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:20.856687 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672097f4-60a1-4c77-bcbb-d88852b32a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:20.856959 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672097f4-60a1-4c77-bcbb-d88852b32a18 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:20.861681 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:20.865114 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672097f4-60a1-4c77-bcbb-d88852b32a18 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:20.866162 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672097f4-60a1-4c77-bcbb-d88852b32a18 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:20.879556 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-672097f4-60a1-4c77-bcbb-d88852b32a18 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 21 12:07:20.879556 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:20.879556 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:20.879556 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:20.879556 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:20.879556 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:20.879556 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:20.879556 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:20.879556 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:20.879556 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:20.879556 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:20.879556 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:20.879556 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 12:07:20.879556 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 12:07:20.879556 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 12:07:20.879556 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 12:07:20.880611 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:20.880611 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:20.880611 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 12:07:20.880611 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:20.880611 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 12:07:20.880611 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:20.880611 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:20.880611 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:20.880611 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:20.880611 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:20.880611 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:20.880611 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:20.880611 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:20.880611 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:20.880611 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:20.880611 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:20.880611 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:20.880611 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:20.881540 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:20.881540 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:20.881540 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 12:07:20.881540 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 12:07:20.881540 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 12:07:20.881540 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 12:07:20.881540 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 12:07:20.881540 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 12:07:20.881540 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 21 12:07:20.881540 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:20.881540 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 330/660] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Sep 21 12:07:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:20.882145 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a2db3-f14e-4a16-ad21-a9308c50d5b2 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:20.882260 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a2db3-f14e-4a16-ad21-a9308c50d5b2 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:20.883403 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a2db3-f14e-4a16-ad21-a9308c50d5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:20.903208 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-6a5a2db3-f14e-4a16-ad21-a9308c50d5b2 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:20.904493 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-6a5a2db3-f14e-4a16-ad21-a9308c50d5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:20.932226 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:20.976171 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abda50-fd8b-4d47-a49e-45d455b9a51c None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:20.986059 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 331/661] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:07:20.986927 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a2db3-f14e-4a16-ad21-a9308c50d5b2 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:21.029260 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37a3fc-0c1a-4143-ab0a-0656a81290c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:21.030694 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37a3fc-0c1a-4143-ab0a-0656a81290c6 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:21.031200 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37a3fc-0c1a-4143-ab0a-0656a81290c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:21.032090 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37a3fc-0c1a-4143-ab0a-0656a81290c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:21.096707 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a2db3-f14e-4a16-ad21-a9308c50d5b2 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:21.115979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37a3fc-0c1a-4143-ab0a-0656a81290c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:21.117401 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37a3fc-0c1a-4143-ab0a-0656a81290c6 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:21.134718 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4bc32e-0244-47af-99eb-ebc3419d2b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:21.135610 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4bc32e-0244-47af-99eb-ebc3419d2b37 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:21.136083 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4bc32e-0244-47af-99eb-ebc3419d2b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:21.136538 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4bc32e-0244-47af-99eb-ebc3419d2b37 None admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:21.137341 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4bc32e-0244-47af-99eb-ebc3419d2b37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:21.138092 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4bc32e-0244-47af-99eb-ebc3419d2b37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:21.138475 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:21.140608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4bc32e-0244-47af-99eb-ebc3419d2b37 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:21.159979 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 332/662] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:21.161273 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4bc32e-0244-47af-99eb-ebc3419d2b37 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:21.184797 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:21.239675 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 331/663] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:07:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 12:07:21.239675 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37a3fc-0c1a-4143-ab0a-0656a81290c6 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:21.278864 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4bc32e-0244-47af-99eb-ebc3419d2b37 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:21.314183 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d6355-662b-42d9-9b85-3069137e50f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:21.314813 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d6355-662b-42d9-9b85-3069137e50f7 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:21.315091 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d6355-662b-42d9-9b85-3069137e50f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:21.315360 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d6355-662b-42d9-9b85-3069137e50f7 None admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:21.316481 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d6355-662b-42d9-9b85-3069137e50f7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:21.316786 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d6355-662b-42d9-9b85-3069137e50f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:21.318572 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d6355-662b-42d9-9b85-3069137e50f7 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:21.340187 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 333/664] 10.222.0.60 () {56 vars in 1139 bytes} [Wed Sep 21 12:07:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:21.341016 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d6355-662b-42d9-9b85-3069137e50f7 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:21.342101 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37a3fc-0c1a-4143-ab0a-0656a81290c6 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:21.361634 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:21.380504 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c7bef-0e44-4e5d-a9fe-717985088baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:21.381054 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c7bef-0e44-4e5d-a9fe-717985088baf None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:21.381329 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c7bef-0e44-4e5d-a9fe-717985088baf None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:21.381597 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c7bef-0e44-4e5d-a9fe-717985088baf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:21.389280 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c7bef-0e44-4e5d-a9fe-717985088baf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:21.390746 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7c7bef-0e44-4e5d-a9fe-717985088baf None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:21.403518 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-fd7c7bef-0e44-4e5d-a9fe-717985088baf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:21.403518 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:21.403518 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:21.403518 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:21.403518 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:21.403518 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:21.403518 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:21.403518 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:21.403518 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:21.403518 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:21.403518 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:21.403518 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:21.403518 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 12:07:21.403518 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 12:07:21.403518 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 12:07:21.404629 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 12:07:21.404629 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:21.404629 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:21.404629 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:21.404629 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:21.404629 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:21.404629 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:21.404629 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:21.404629 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:21.404629 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:21.404629 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:21.404629 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:21.404629 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:21.404629 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:21.404629 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:21.404629 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:21.404629 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:21.405535 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 12:07:21.405535 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 12:07:21.405535 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 12:07:21.405535 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 12:07:21.405535 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 12:07:21.405535 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 12:07:21.405535 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:21.405535 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:21.405535 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 332/665] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:07:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:21.405535 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c7bef-0e44-4e5d-a9fe-717985088baf None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:21.429686 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:21.457081 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d6355-662b-42d9-9b85-3069137e50f7 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:21.492889 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e16a1-ea9f-42f2-bc0d-45dfe11b97b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:21.493513 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e16a1-ea9f-42f2-bc0d-45dfe11b97b7 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:21.493786 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e16a1-ea9f-42f2-bc0d-45dfe11b97b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:21.494054 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e16a1-ea9f-42f2-bc0d-45dfe11b97b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:21.505465 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e16a1-ea9f-42f2-bc0d-45dfe11b97b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:21.507088 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e16a1-ea9f-42f2-bc0d-45dfe11b97b7 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:21.518252 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c7bef-0e44-4e5d-a9fe-717985088baf None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:21.522030 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-594e16a1-ea9f-42f2-bc0d-45dfe11b97b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:21.522030 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:21.522030 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:21.522030 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:21.522030 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:21.522030 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:21.522030 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:21.522030 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:21.522030 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:21.522030 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:21.522030 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:21.522030 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:21.522030 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:21.522030 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:21.522030 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:21.522030 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:21.523541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:21.523541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:21.523541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:21.523541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:21.523541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:21.523541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:21.523541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:21.523541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:21.523541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:21.523541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:21.523541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:21.523541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:21.523541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:21.523541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:21.523541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:21.523541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:21.523541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:21.525032 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:21.525032 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:21.525032 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:21.525032 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 334/666] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:21.525032 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e16a1-ea9f-42f2-bc0d-45dfe11b97b7 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:21.565933 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac5f74-ae29-40b6-bc24-43da0844eedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:21.566142 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac5f74-ae29-40b6-bc24-43da0844eedc None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:21.566315 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac5f74-ae29-40b6-bc24-43da0844eedc None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:21.566599 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac5f74-ae29-40b6-bc24-43da0844eedc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:21.579338 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbac5f74-ae29-40b6-bc24-43da0844eedc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:07:21.584811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-dbac5f74-ae29-40b6-bc24-43da0844eedc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 12:07:21.584811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:21.584811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:21.584811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:21.584811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:21.584811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:21.584811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:21.584811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:21.584811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:21.584811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:21.584811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:21.584811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:21.584811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:07:21.584811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:07:21.584811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:07:21.584811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:07:21.586308 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:07:21.586308 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:07:21.586308 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:07:21.586308 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:07:21.586308 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:21.586308 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:21.586308 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:21.586308 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:21.586308 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:21.586308 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:21.586308 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:21.586308 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:21.586308 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:21.586308 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:21.586308 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:21.586308 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:21.587198 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:21.587198 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:21.587198 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:21.587198 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:21.587198 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:07:21.587198 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:07:21.587198 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:07:21.587198 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:07:21.587198 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:07:21.587198 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:07:21.587198 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 12:07:21.587198 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:21.591330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 333/667] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Sep 21 12:07:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:21.592108 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac5f74-ae29-40b6-bc24-43da0844eedc None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:21.639746 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:21.643370 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e16a1-ea9f-42f2-bc0d-45dfe11b97b7 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:21.671821 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:21.683270 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1676478-2b27-490b-bd55-2fc6082a32f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:21.683903 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1676478-2b27-490b-bd55-2fc6082a32f1 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:21.684162 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1676478-2b27-490b-bd55-2fc6082a32f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:21.684436 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1676478-2b27-490b-bd55-2fc6082a32f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:21.705577 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac5f74-ae29-40b6-bc24-43da0844eedc None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:21.743736 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3550e8-4e1c-4b3d-a178-9de2c72aea40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:21.744502 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3550e8-4e1c-4b3d-a178-9de2c72aea40 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:21.744887 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3550e8-4e1c-4b3d-a178-9de2c72aea40 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:21.745170 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3550e8-4e1c-4b3d-a178-9de2c72aea40 None admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:21.745897 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3550e8-4e1c-4b3d-a178-9de2c72aea40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:21.746198 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3550e8-4e1c-4b3d-a178-9de2c72aea40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:21.747687 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3550e8-4e1c-4b3d-a178-9de2c72aea40 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:21.764658 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 334/668] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Sep 21 12:07:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:21.764658 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3550e8-4e1c-4b3d-a178-9de2c72aea40 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:21.767179 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1676478-2b27-490b-bd55-2fc6082a32f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:21.768005 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1676478-2b27-490b-bd55-2fc6082a32f1 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:21.872593 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:21.877801 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3550e8-4e1c-4b3d-a178-9de2c72aea40 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:21.889343 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 335/669] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:07:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 12:07:21.889343 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1676478-2b27-490b-bd55-2fc6082a32f1 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:21.919837 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8cfb24-106d-4dce-9c64-25be5ae22953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:21.920370 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cfb24-106d-4dce-9c64-25be5ae22953 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:21.920651 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cfb24-106d-4dce-9c64-25be5ae22953 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:21.920923 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cfb24-106d-4dce-9c64-25be5ae22953 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:21.921227 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:21.921595 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8cfb24-106d-4dce-9c64-25be5ae22953 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:21.921898 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8cfb24-106d-4dce-9c64-25be5ae22953 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:21.923795 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8cfb24-106d-4dce-9c64-25be5ae22953 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:21.941813 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 335/670] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:21.941813 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8cfb24-106d-4dce-9c64-25be5ae22953 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:22.004544 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1676478-2b27-490b-bd55-2fc6082a32f1 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:22.040401 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fef524-eeea-4633-aa15-0e77a68b0ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:22.041012 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fef524-eeea-4633-aa15-0e77a68b0ece None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:22.041293 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fef524-eeea-4633-aa15-0e77a68b0ece None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:22.041565 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fef524-eeea-4633-aa15-0e77a68b0ece None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:22.042223 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fef524-eeea-4633-aa15-0e77a68b0ece None admin] RBAC: Adding query filter params (name=service) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:22.042557 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fef524-eeea-4633-aa15-0e77a68b0ece None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:22.043917 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fef524-eeea-4633-aa15-0e77a68b0ece None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:22.048879 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8cfb24-106d-4dce-9c64-25be5ae22953 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:22.052320 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 336/671] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Sep 21 12:07:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:22.053114 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fef524-eeea-4633-aa15-0e77a68b0ece None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:22.083979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be1812-d432-40ce-9ad5-95c518ed04b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:22.084687 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be1812-d432-40ce-9ad5-95c518ed04b8 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:22.084965 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be1812-d432-40ce-9ad5-95c518ed04b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:22.085892 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be1812-d432-40ce-9ad5-95c518ed04b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:22.086645 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be1812-d432-40ce-9ad5-95c518ed04b8 None admin] RBAC: Adding query filter params (role.id=327398b6ec324647b6c4ea84a59a026b, scope.project.id=b0abcc6f2ce14825bfc26e6210889c21, user.id=c513a6c91a0240de87c7b51b07617827) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:22.086953 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be1812-d432-40ce-9ad5-95c518ed04b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:22.088384 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be1812-d432-40ce-9ad5-95c518ed04b8 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:22.094272 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 336/672] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:07:21 2022] GET /identity/v3/role_assignments?user.id=c513a6c91a0240de87c7b51b07617827&scope.project.id=b0abcc6f2ce14825bfc26e6210889c21&role.id=327398b6ec324647b6c4ea84a59a026b => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:22.095123 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be1812-d432-40ce-9ad5-95c518ed04b8 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:22.135200 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:22.150298 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:22.178696 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fef524-eeea-4633-aa15-0e77a68b0ece None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:22.220178 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef8d9b-a425-40fb-a77c-2daf29032428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:22.221357 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef8d9b-a425-40fb-a77c-2daf29032428 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:22.221640 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef8d9b-a425-40fb-a77c-2daf29032428 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:22.221912 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef8d9b-a425-40fb-a77c-2daf29032428 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:22.233723 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ef8d9b-a425-40fb-a77c-2daf29032428 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:22.235125 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be1812-d432-40ce-9ad5-95c518ed04b8 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:22.235338 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ef8d9b-a425-40fb-a77c-2daf29032428 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:22.250901 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-40ef8d9b-a425-40fb-a77c-2daf29032428 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:22.250901 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:22.250901 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:22.250901 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:22.250901 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:22.250901 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:22.250901 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:22.250901 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:22.250901 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:22.250901 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:22.250901 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:22.250901 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:22.250901 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:22.250901 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:22.250901 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:22.250901 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:22.252017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:22.252017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:22.252017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:22.252017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:22.252017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:22.252017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:22.252017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:22.252017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:22.252017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:22.252017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:22.252017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:22.252017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:22.252017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:22.252017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:22.252017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:22.252017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:22.252017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:22.252918 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:22.252918 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:22.252918 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:22.252918 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 337/673] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:22.253598 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04c252-375a-45b7-9dcb-3ce2e5362ee8 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:22.253710 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04c252-375a-45b7-9dcb-3ce2e5362ee8 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:22.254411 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04c252-375a-45b7-9dcb-3ce2e5362ee8 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:22.255388 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 338/674] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:07:22.255997 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04c252-375a-45b7-9dcb-3ce2e5362ee8 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:22.281651 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992fd2eb-6685-4734-86a7-9c4cfda00e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:22.283089 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fd2eb-6685-4734-86a7-9c4cfda00e4f None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:22.283089 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fd2eb-6685-4734-86a7-9c4cfda00e4f None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:22.283275 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fd2eb-6685-4734-86a7-9c4cfda00e4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:22.292970 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992fd2eb-6685-4734-86a7-9c4cfda00e4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:22.294473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992fd2eb-6685-4734-86a7-9c4cfda00e4f None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:22.307489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-992fd2eb-6685-4734-86a7-9c4cfda00e4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:22.307489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:22.307489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:22.307489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:22.307489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:22.307489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:22.307489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:22.307489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:22.307489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:22.307489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:22.307489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:22.307489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:22.307489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 12:07:22.307489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 12:07:22.307489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 12:07:22.308468 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 12:07:22.308468 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:22.308468 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:22.308468 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:22.308468 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:22.308468 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:22.308468 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:22.308468 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:22.308468 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:22.308468 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:22.308468 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:22.308468 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:22.308468 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:22.308468 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:22.308468 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:22.308468 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:22.308468 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:22.309391 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 12:07:22.309391 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 12:07:22.309391 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 12:07:22.309391 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 12:07:22.309391 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 12:07:22.309391 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 12:07:22.309391 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:22.309391 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:22.309391 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 337/675] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:07:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:22.309391 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992fd2eb-6685-4734-86a7-9c4cfda00e4f None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:22.378239 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04c252-375a-45b7-9dcb-3ce2e5362ee8 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:22.408522 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:22.415906 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ea951-fea1-4536-a5d8-6548ed861789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:22.416550 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ea951-fea1-4536-a5d8-6548ed861789 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:22.417056 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ea951-fea1-4536-a5d8-6548ed861789 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:22.417333 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ea951-fea1-4536-a5d8-6548ed861789 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:22.427127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:22.430256 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ea951-fea1-4536-a5d8-6548ed861789 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:22.430418 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992fd2eb-6685-4734-86a7-9c4cfda00e4f None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:22.433460 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ea951-fea1-4536-a5d8-6548ed861789 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:22.450156 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-3f4ea951-fea1-4536-a5d8-6548ed861789 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:22.450156 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:22.450156 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:22.450156 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:22.450156 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:22.450156 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:22.450156 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:22.450156 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:22.450156 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:22.450156 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:22.450156 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:22.450156 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:22.450156 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:22.450156 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:22.450156 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:22.450156 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:22.451201 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:22.451201 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:22.451201 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:22.451201 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:22.451201 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:22.451201 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:22.451201 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:22.451201 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:22.451201 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:22.451201 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:22.451201 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:22.451201 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:22.451201 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:22.451201 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:22.451201 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:22.451201 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:22.451201 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:22.452651 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:22.452651 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:22.452651 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:22.452651 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 339/676] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:22.453123 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7a0ff-73cc-4c83-bd9b-65aa07eeed93 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:22.453411 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7a0ff-73cc-4c83-bd9b-65aa07eeed93 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:22.453683 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7a0ff-73cc-4c83-bd9b-65aa07eeed93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:22.472334 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307eddb-2d3d-4091-ab20-d110f83b5905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:22.472881 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-4ec7a0ff-73cc-4c83-bd9b-65aa07eeed93 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:22.473012 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307eddb-2d3d-4091-ab20-d110f83b5905 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:22.473214 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307eddb-2d3d-4091-ab20-d110f83b5905 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:22.473486 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307eddb-2d3d-4091-ab20-d110f83b5905 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:22.474065 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-4ec7a0ff-73cc-4c83-bd9b-65aa07eeed93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:22.474170 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1307eddb-2d3d-4091-ab20-d110f83b5905 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:22.474479 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1307eddb-2d3d-4091-ab20-d110f83b5905 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:22.475930 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1307eddb-2d3d-4091-ab20-d110f83b5905 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:22.490046 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 338/677] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:22.491063 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307eddb-2d3d-4091-ab20-d110f83b5905 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:22.558558 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 340/678] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:07:22.558558 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7a0ff-73cc-4c83-bd9b-65aa07eeed93 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:22.626691 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307eddb-2d3d-4091-ab20-d110f83b5905 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:22.662474 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694c63d-51f1-40c2-a44c-bad1be0ea0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:22.663084 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694c63d-51f1-40c2-a44c-bad1be0ea0c4 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:22.663934 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694c63d-51f1-40c2-a44c-bad1be0ea0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:22.664213 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694c63d-51f1-40c2-a44c-bad1be0ea0c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:22.664957 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0694c63d-51f1-40c2-a44c-bad1be0ea0c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:22.665269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0694c63d-51f1-40c2-a44c-bad1be0ea0c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:22.666735 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0694c63d-51f1-40c2-a44c-bad1be0ea0c4 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:22.686460 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 339/679] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Sep 21 12:07:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:22.686460 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694c63d-51f1-40c2-a44c-bad1be0ea0c4 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:22.686725 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7a0ff-73cc-4c83-bd9b-65aa07eeed93 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:22.690603 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:22.720933 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:22.736717 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1de95-bfa0-44be-a701-0c4fd0fc7efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:22.738197 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1de95-bfa0-44be-a701-0c4fd0fc7efa None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:22.738718 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1de95-bfa0-44be-a701-0c4fd0fc7efa None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:22.739446 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1de95-bfa0-44be-a701-0c4fd0fc7efa None admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:22.740309 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1de95-bfa0-44be-a701-0c4fd0fc7efa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:22.740983 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1de95-bfa0-44be-a701-0c4fd0fc7efa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:22.743548 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1de95-bfa0-44be-a701-0c4fd0fc7efa None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:22.759596 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 341/680] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:22.761065 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1de95-bfa0-44be-a701-0c4fd0fc7efa None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:22.795881 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694c63d-51f1-40c2-a44c-bad1be0ea0c4 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:22.832534 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14216f-9beb-4681-b249-e11b1c71ef90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:22.833171 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14216f-9beb-4681-b249-e11b1c71ef90 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:22.833452 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14216f-9beb-4681-b249-e11b1c71ef90 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:22.833729 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14216f-9beb-4681-b249-e11b1c71ef90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:22.841331 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14216f-9beb-4681-b249-e11b1c71ef90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:22.842824 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14216f-9beb-4681-b249-e11b1c71ef90 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:22.855355 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-9f14216f-9beb-4681-b249-e11b1c71ef90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:22.855355 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:22.855355 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:22.855355 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:22.855355 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:22.855355 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:22.855355 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:22.855355 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:22.855355 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:22.855355 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:22.855355 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:22.855355 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:22.855355 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 12:07:22.855355 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 12:07:22.855355 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 12:07:22.856274 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 12:07:22.856274 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:22.856274 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:22.856274 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:22.856274 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:22.856274 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:22.856274 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:22.856274 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:22.856274 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:22.856274 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:22.856274 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:22.856274 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:22.856274 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:22.856274 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:22.856274 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:22.856274 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:22.856274 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:22.857182 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 12:07:22.857182 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 12:07:22.857182 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 12:07:22.857182 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 12:07:22.857182 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 12:07:22.857182 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 12:07:22.857182 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:22.857182 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:22.861239 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 340/681] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:07:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:22.862301 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14216f-9beb-4681-b249-e11b1c71ef90 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:22.884753 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1de95-bfa0-44be-a701-0c4fd0fc7efa None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:22.921002 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1bd3e-1abf-4c1b-a81e-c80f0b0ee496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:22.921763 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1bd3e-1abf-4c1b-a81e-c80f0b0ee496 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:22.922138 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1bd3e-1abf-4c1b-a81e-c80f0b0ee496 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:22.922554 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1bd3e-1abf-4c1b-a81e-c80f0b0ee496 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:22.923398 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1bd3e-1abf-4c1b-a81e-c80f0b0ee496 None admin] RBAC: Adding query filter params (role.id=327398b6ec324647b6c4ea84a59a026b, scope.project.id=b0abcc6f2ce14825bfc26e6210889c21, user.id=1b44dd2471684d358018f36ec0afc063) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:22.923710 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1bd3e-1abf-4c1b-a81e-c80f0b0ee496 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:22.925155 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1bd3e-1abf-4c1b-a81e-c80f0b0ee496 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:22.934015 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 342/682] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:07:22 2022] GET /identity/v3/role_assignments?user.id=1b44dd2471684d358018f36ec0afc063&scope.project.id=b0abcc6f2ce14825bfc26e6210889c21&role.id=327398b6ec324647b6c4ea84a59a026b => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:22.934015 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1bd3e-1abf-4c1b-a81e-c80f0b0ee496 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:22.948966 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:23.006721 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:23.015272 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14216f-9beb-4681-b249-e11b1c71ef90 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:23.060793 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d639d-e51b-460d-b2ef-3cdbfbde2df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:23.061462 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d639d-e51b-460d-b2ef-3cdbfbde2df5 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:23.061740 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d639d-e51b-460d-b2ef-3cdbfbde2df5 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:23.062013 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d639d-e51b-460d-b2ef-3cdbfbde2df5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:23.072759 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d639d-e51b-460d-b2ef-3cdbfbde2df5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:23.076434 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d639d-e51b-460d-b2ef-3cdbfbde2df5 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:23.078240 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1bd3e-1abf-4c1b-a81e-c80f0b0ee496 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:23.090801 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-1c2d639d-e51b-460d-b2ef-3cdbfbde2df5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 21 12:07:23.090801 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:23.090801 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:23.090801 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:23.090801 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:23.090801 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:23.090801 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:23.090801 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:23.090801 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:23.090801 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:23.090801 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:23.090801 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:23.090801 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 12:07:23.090801 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 12:07:23.090801 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 12:07:23.090801 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 12:07:23.091971 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:23.091971 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:23.091971 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 12:07:23.091971 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:23.091971 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 12:07:23.091971 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:23.091971 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:23.091971 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:23.091971 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:23.091971 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:23.091971 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:23.091971 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:23.091971 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:23.091971 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:23.091971 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:23.091971 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:23.091971 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:23.091971 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:23.093255 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:23.093255 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:23.093255 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 12:07:23.093255 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 12:07:23.093255 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 12:07:23.093255 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 12:07:23.093255 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 12:07:23.093255 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 12:07:23.093255 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 21 12:07:23.093255 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:23.093255 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 341/683] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Sep 21 12:07:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:23.093255 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d639d-e51b-460d-b2ef-3cdbfbde2df5 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:23.121807 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240f0a1-c59d-4e77-9df9-8f8a62abcf58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:23.122784 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240f0a1-c59d-4e77-9df9-8f8a62abcf58 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:23.123233 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240f0a1-c59d-4e77-9df9-8f8a62abcf58 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:23.123652 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240f0a1-c59d-4e77-9df9-8f8a62abcf58 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:23.135494 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6240f0a1-c59d-4e77-9df9-8f8a62abcf58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:07:23.142315 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-6240f0a1-c59d-4e77-9df9-8f8a62abcf58 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:07:23.142315 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:23.142315 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:23.142315 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:23.142315 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:23.142315 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:23.142315 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:23.142315 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:23.142315 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:23.142315 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:23.142315 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:23.142315 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:23.142315 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:07:23.142315 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:07:23.142315 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:07:23.142315 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:07:23.143498 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:07:23.143498 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:07:23.143498 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:07:23.143498 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:07:23.143498 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:23.143498 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:23.143498 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:23.143498 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:23.143498 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:23.143498 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:23.143498 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:23.143498 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:23.143498 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:23.143498 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:23.143498 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:23.143498 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:23.144525 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:23.144525 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:23.144525 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:23.144525 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:23.144525 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:07:23.144525 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:07:23.144525 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:07:23.144525 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:07:23.144525 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:07:23.144525 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:07:23.144525 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:07:23.144525 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:23.146821 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 343/684] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Sep 21 12:07:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:23.148458 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240f0a1-c59d-4e77-9df9-8f8a62abcf58 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:23.222130 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d639d-e51b-460d-b2ef-3cdbfbde2df5 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:23.248219 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:23.264046 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867c851-c97d-410e-95ac-338a15dfc573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:23.264991 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867c851-c97d-410e-95ac-338a15dfc573 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:23.265154 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867c851-c97d-410e-95ac-338a15dfc573 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:23.265458 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867c851-c97d-410e-95ac-338a15dfc573 None admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:23.266158 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867c851-c97d-410e-95ac-338a15dfc573 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:23.266870 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867c851-c97d-410e-95ac-338a15dfc573 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:23.268774 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867c851-c97d-410e-95ac-338a15dfc573 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:23.284133 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 342/685] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Sep 21 12:07:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:23.284499 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240f0a1-c59d-4e77-9df9-8f8a62abcf58 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:23.290535 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867c851-c97d-410e-95ac-338a15dfc573 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:23.293420 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:23.324250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccadba0-101b-41bf-bcd4-f776c7302497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:23.324867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccadba0-101b-41bf-bcd4-f776c7302497 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:23.325166 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccadba0-101b-41bf-bcd4-f776c7302497 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:23.325665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccadba0-101b-41bf-bcd4-f776c7302497 None admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:23.326256 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccadba0-101b-41bf-bcd4-f776c7302497 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:23.326591 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccadba0-101b-41bf-bcd4-f776c7302497 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:23.328038 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccadba0-101b-41bf-bcd4-f776c7302497 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:23.348206 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 344/686] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Sep 21 12:07:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:23.349062 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccadba0-101b-41bf-bcd4-f776c7302497 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:23.405956 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867c851-c97d-410e-95ac-338a15dfc573 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:23.445178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2ed37-4814-41ff-b3ff-bc2d2228d8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:23.446096 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2ed37-4814-41ff-b3ff-bc2d2228d8c5 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:23.446612 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2ed37-4814-41ff-b3ff-bc2d2228d8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:23.447069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2ed37-4814-41ff-b3ff-bc2d2228d8c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:23.447984 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2ed37-4814-41ff-b3ff-bc2d2228d8c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:23.448549 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2ed37-4814-41ff-b3ff-bc2d2228d8c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:23.450089 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2ed37-4814-41ff-b3ff-bc2d2228d8c5 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:23.457376 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccadba0-101b-41bf-bcd4-f776c7302497 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:23.464521 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 343/687] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:07:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:23.465700 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2ed37-4814-41ff-b3ff-bc2d2228d8c5 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:23.495255 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde43100-df72-4aff-91bc-b16b3a0871e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:23.496109 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde43100-df72-4aff-91bc-b16b3a0871e1 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:23.496225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde43100-df72-4aff-91bc-b16b3a0871e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:23.496423 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde43100-df72-4aff-91bc-b16b3a0871e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:23.497171 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde43100-df72-4aff-91bc-b16b3a0871e1 None admin] RBAC: Adding query filter params (role.id=327398b6ec324647b6c4ea84a59a026b, scope.project.id=b0abcc6f2ce14825bfc26e6210889c21, user.id=ab0521c25c2d4417944efa4745588f1e) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:23.497451 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde43100-df72-4aff-91bc-b16b3a0871e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:23.499128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde43100-df72-4aff-91bc-b16b3a0871e1 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:23.511146 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 345/688] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:07:23 2022] GET /identity/v3/role_assignments?user.id=ab0521c25c2d4417944efa4745588f1e&scope.project.id=b0abcc6f2ce14825bfc26e6210889c21&role.id=327398b6ec324647b6c4ea84a59a026b => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:23.511146 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde43100-df72-4aff-91bc-b16b3a0871e1 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:23.541597 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:23.583798 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:23.666287 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2ed37-4814-41ff-b3ff-bc2d2228d8c5 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:23.709480 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1076531-6865-4e58-ad8e-ea26c31bdf38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:23.709480 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1076531-6865-4e58-ad8e-ea26c31bdf38 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:23.709756 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1076531-6865-4e58-ad8e-ea26c31bdf38 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:23.709859 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1076531-6865-4e58-ad8e-ea26c31bdf38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:23.749102 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde43100-df72-4aff-91bc-b16b3a0871e1 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:23.799631 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d0821-5511-4601-85d5-df6552512514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:23.800922 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d0821-5511-4601-85d5-df6552512514 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:23.801479 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d0821-5511-4601-85d5-df6552512514 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:23.802129 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d0821-5511-4601-85d5-df6552512514 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:23.814074 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1076531-6865-4e58-ad8e-ea26c31bdf38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:23.815781 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1076531-6865-4e58-ad8e-ea26c31bdf38 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:23.818391 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249d0821-5511-4601-85d5-df6552512514 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:23.821241 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249d0821-5511-4601-85d5-df6552512514 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:23.841944 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-249d0821-5511-4601-85d5-df6552512514 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:23.841944 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:23.841944 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:23.841944 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:23.841944 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:23.841944 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:23.841944 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:23.841944 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:23.841944 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:23.841944 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:23.841944 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:23.841944 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:23.841944 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:23.841944 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:23.841944 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:23.841944 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:23.842966 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:23.842966 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:23.842966 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:23.842966 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:23.842966 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:23.842966 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:23.842966 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:23.842966 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:23.842966 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:23.842966 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:23.842966 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:23.842966 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:23.842966 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:23.842966 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:23.842966 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:23.842966 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:23.842966 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:23.843856 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:23.843856 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:23.843856 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:23.846754 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 346/689] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:23.854073 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d0821-5511-4601-85d5-df6552512514 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:23.878782 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:23.962010 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 344/690] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:07:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 12:07:23.966592 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:23.966894 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1076531-6865-4e58-ad8e-ea26c31bdf38 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:24.016791 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d0821-5511-4601-85d5-df6552512514 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:24.079021 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ed5d5-5f34-4ea0-a8ba-c9219acbf3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:24.079635 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ed5d5-5f34-4ea0-a8ba-c9219acbf3b2 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:24.079914 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ed5d5-5f34-4ea0-a8ba-c9219acbf3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:24.080221 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ed5d5-5f34-4ea0-a8ba-c9219acbf3b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:24.080939 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022ed5d5-5f34-4ea0-a8ba-c9219acbf3b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:24.081242 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022ed5d5-5f34-4ea0-a8ba-c9219acbf3b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:24.082659 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022ed5d5-5f34-4ea0-a8ba-c9219acbf3b2 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:24.104410 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 347/691] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:07:24.110375 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1076531-6865-4e58-ad8e-ea26c31bdf38 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:24.111572 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ed5d5-5f34-4ea0-a8ba-c9219acbf3b2 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:24.149278 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38145de-b628-4ced-bba1-d283a1d144ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:24.150380 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38145de-b628-4ced-bba1-d283a1d144ef None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:24.150869 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38145de-b628-4ced-bba1-d283a1d144ef None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:24.151360 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38145de-b628-4ced-bba1-d283a1d144ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:24.162161 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38145de-b628-4ced-bba1-d283a1d144ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:24.164256 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38145de-b628-4ced-bba1-d283a1d144ef None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:24.182136 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-f38145de-b628-4ced-bba1-d283a1d144ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:24.182136 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:24.182136 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:24.182136 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:24.182136 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:24.182136 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:24.182136 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:24.182136 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:24.182136 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:24.182136 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:24.182136 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:24.182136 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:24.182136 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:24.182136 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:24.182136 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:24.182136 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:24.183208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:24.183208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:24.183208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:24.183208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:24.183208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:24.183208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:24.183208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:24.183208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:24.183208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:24.183208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:24.183208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:24.183208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:24.183208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:24.183208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:24.183208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:24.183208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:24.183208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:24.184134 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:24.184134 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:24.184134 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:24.186266 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 345/692] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 12:07:24.186444 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:24.191717 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38145de-b628-4ced-bba1-d283a1d144ef None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:24.339788 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38145de-b628-4ced-bba1-d283a1d144ef None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:24.344275 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ed5d5-5f34-4ea0-a8ba-c9219acbf3b2 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:24.398918 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84193e4-a9c7-49d9-8fff-9fb5cad58e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:24.400848 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84193e4-a9c7-49d9-8fff-9fb5cad58e44 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:24.401303 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84193e4-a9c7-49d9-8fff-9fb5cad58e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:24.402462 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84193e4-a9c7-49d9-8fff-9fb5cad58e44 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:24.403265 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84193e4-a9c7-49d9-8fff-9fb5cad58e44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:24.404333 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84193e4-a9c7-49d9-8fff-9fb5cad58e44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:24.406047 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84193e4-a9c7-49d9-8fff-9fb5cad58e44 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:24.419103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2aae7a-6dd5-44eb-967e-371c8f9a487c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:24.419737 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2aae7a-6dd5-44eb-967e-371c8f9a487c None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:24.420018 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2aae7a-6dd5-44eb-967e-371c8f9a487c None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:24.420290 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2aae7a-6dd5-44eb-967e-371c8f9a487c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:24.423334 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 346/693] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:24.430779 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2aae7a-6dd5-44eb-967e-371c8f9a487c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:24.431046 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84193e4-a9c7-49d9-8fff-9fb5cad58e44 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:24.434384 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2aae7a-6dd5-44eb-967e-371c8f9a487c None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:24.439554 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:24.444989 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-af2aae7a-6dd5-44eb-967e-371c8f9a487c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 21 12:07:24.444989 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:24.444989 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:24.444989 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:24.444989 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:24.444989 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:24.444989 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:24.444989 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:24.444989 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:24.444989 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:24.444989 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:24.444989 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:24.444989 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 12:07:24.444989 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 12:07:24.444989 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 12:07:24.444989 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 12:07:24.446127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:24.446127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:24.446127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 12:07:24.446127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:24.446127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 12:07:24.446127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:24.446127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:24.446127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:24.446127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:24.446127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:24.446127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:24.446127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:24.446127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:24.446127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:24.446127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:24.446127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:24.446127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:24.446127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:24.447118 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:24.447118 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:24.447118 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 12:07:24.447118 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 12:07:24.447118 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 12:07:24.447118 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 12:07:24.447118 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 12:07:24.447118 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 12:07:24.447118 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 21 12:07:24.447118 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:24.447118 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 348/694] 10.222.0.60 () {56 vars in 1093 bytes} [Wed Sep 21 12:07:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:24.454400 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2aae7a-6dd5-44eb-967e-371c8f9a487c None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:24.504874 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:24.564639 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84193e4-a9c7-49d9-8fff-9fb5cad58e44 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:24.584152 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2aae7a-6dd5-44eb-967e-371c8f9a487c None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:24.613065 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193cccae-c633-49ab-afbe-45acccef1e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:24.613946 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cccae-c633-49ab-afbe-45acccef1e0a None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:24.614293 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cccae-c633-49ab-afbe-45acccef1e0a None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:24.615087 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cccae-c633-49ab-afbe-45acccef1e0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:24.622914 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921eb07-be97-4f64-a225-2f29b3fee450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:24.623765 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193cccae-c633-49ab-afbe-45acccef1e0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:24.623887 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921eb07-be97-4f64-a225-2f29b3fee450 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:24.624310 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921eb07-be97-4f64-a225-2f29b3fee450 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:24.624721 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921eb07-be97-4f64-a225-2f29b3fee450 None admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:24.625475 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193cccae-c633-49ab-afbe-45acccef1e0a None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:24.625761 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c921eb07-be97-4f64-a225-2f29b3fee450 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:24.626217 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c921eb07-be97-4f64-a225-2f29b3fee450 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:24.627920 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c921eb07-be97-4f64-a225-2f29b3fee450 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:24.640348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-193cccae-c633-49ab-afbe-45acccef1e0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:24.640348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:24.640348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:24.640348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:24.640348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:24.640348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:24.640348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:24.640348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:24.640348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:24.640348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:24.640348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:24.640348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:24.640348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 12:07:24.640348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 12:07:24.640348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 12:07:24.641457 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 12:07:24.641457 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:24.641457 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:24.641457 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:24.641457 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:24.641457 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:24.641457 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:24.641457 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:24.641457 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:24.641457 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:24.641457 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:24.641457 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:24.641457 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:24.641457 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:24.641457 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:24.641457 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:24.641457 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:24.642587 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 12:07:24.642587 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 12:07:24.642587 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 12:07:24.642587 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 12:07:24.642587 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 12:07:24.642587 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 12:07:24.642587 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:24.642587 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:24.648661 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 347/695] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:07:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:24.648661 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bfff3b-c9fd-4c3d-a94c-99944611ce08 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:24.648661 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bfff3b-c9fd-4c3d-a94c-99944611ce08 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:24.648661 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bfff3b-c9fd-4c3d-a94c-99944611ce08 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:24.651797 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 348/696] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:07:24.653468 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bfff3b-c9fd-4c3d-a94c-99944611ce08 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:24.657368 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 349/697] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Sep 21 12:07:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:24.658924 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ce5e0-5ddf-49c3-b737-d4e6f2f9c135 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:24.659356 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ce5e0-5ddf-49c3-b737-d4e6f2f9c135 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:24.659797 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ce5e0-5ddf-49c3-b737-d4e6f2f9c135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:24.680358 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-e93ce5e0-5ddf-49c3-b737-d4e6f2f9c135 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:24.681798 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-e93ce5e0-5ddf-49c3-b737-d4e6f2f9c135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:24.743635 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:24.759801 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 350/698] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:07:24.760932 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ce5e0-5ddf-49c3-b737-d4e6f2f9c135 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:24.810052 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bfff3b-c9fd-4c3d-a94c-99944611ce08 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:24.848609 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:24.885807 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be69db-8fec-4f35-bd33-024cd00a61fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:24.886687 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be69db-8fec-4f35-bd33-024cd00a61fb None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:24.887112 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be69db-8fec-4f35-bd33-024cd00a61fb None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:24.887530 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be69db-8fec-4f35-bd33-024cd00a61fb None admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:24.888640 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be69db-8fec-4f35-bd33-024cd00a61fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:24.889275 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be69db-8fec-4f35-bd33-024cd00a61fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:24.892117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be69db-8fec-4f35-bd33-024cd00a61fb None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:24.915314 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 349/699] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Sep 21 12:07:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:24.922315 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be69db-8fec-4f35-bd33-024cd00a61fb None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:24.950536 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ce5e0-5ddf-49c3-b737-d4e6f2f9c135 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:24.996310 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4fc0c-a5a6-4326-84c5-a3609d7bc201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:24.996923 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4fc0c-a5a6-4326-84c5-a3609d7bc201 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:24.997204 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4fc0c-a5a6-4326-84c5-a3609d7bc201 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:24.997478 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4fc0c-a5a6-4326-84c5-a3609d7bc201 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:25.092332 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:25.112102 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be69db-8fec-4f35-bd33-024cd00a61fb None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:25.116157 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a4fc0c-a5a6-4326-84c5-a3609d7bc201 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:25.117658 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a4fc0c-a5a6-4326-84c5-a3609d7bc201 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:25.159774 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc07e2f-cebd-4892-84e5-bfd0598fda79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:25.160570 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc07e2f-cebd-4892-84e5-bfd0598fda79 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:25.160851 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc07e2f-cebd-4892-84e5-bfd0598fda79 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:25.161120 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc07e2f-cebd-4892-84e5-bfd0598fda79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:25.161839 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc07e2f-cebd-4892-84e5-bfd0598fda79 None admin] RBAC: Adding query filter params (role.id=327398b6ec324647b6c4ea84a59a026b, scope.project.id=b0abcc6f2ce14825bfc26e6210889c21, user.id=cbc2bab11b264196859802907b93ac37) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:25.162139 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc07e2f-cebd-4892-84e5-bfd0598fda79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:25.163649 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc07e2f-cebd-4892-84e5-bfd0598fda79 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:25.178705 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 350/700] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:07:24 2022] GET /identity/v3/role_assignments?user.id=cbc2bab11b264196859802907b93ac37&scope.project.id=b0abcc6f2ce14825bfc26e6210889c21&role.id=327398b6ec324647b6c4ea84a59a026b => generated 608 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:07:25.179742 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc07e2f-cebd-4892-84e5-bfd0598fda79 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:25.265349 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:25.296492 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 351/701] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:07:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 12:07:25.302079 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4fc0c-a5a6-4326-84c5-a3609d7bc201 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:25.382379 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc07e2f-cebd-4892-84e5-bfd0598fda79 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:25.428509 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531bcda-c73d-4862-9564-1a0a2db42df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:25.429600 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531bcda-c73d-4862-9564-1a0a2db42df9 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:25.430131 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531bcda-c73d-4862-9564-1a0a2db42df9 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:25.430438 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531bcda-c73d-4862-9564-1a0a2db42df9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:25.446847 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531bcda-c73d-4862-9564-1a0a2db42df9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:25.448429 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531bcda-c73d-4862-9564-1a0a2db42df9 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:25.465203 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:25.469446 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-0531bcda-c73d-4862-9564-1a0a2db42df9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:25.469446 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:25.469446 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:25.469446 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:25.469446 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:25.469446 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:25.469446 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:25.469446 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:25.469446 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:25.469446 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:25.469446 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:25.469446 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:25.469446 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:25.469446 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:25.469446 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:25.469446 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:25.470491 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:25.470491 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:25.470491 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:25.470491 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:25.470491 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:25.470491 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:25.470491 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:25.470491 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:25.470491 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:25.470491 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:25.470491 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:25.470491 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:25.470491 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:25.470491 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:25.470491 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:25.470491 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:25.470491 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:25.472021 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:25.472021 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:25.472021 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:25.472021 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 351/702] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:25.477469 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531bcda-c73d-4862-9564-1a0a2db42df9 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:25.486527 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4fc0c-a5a6-4326-84c5-a3609d7bc201 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:25.543631 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8729c90e-324a-45f7-8bf7-cadce3c211f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:25.544088 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8729c90e-324a-45f7-8bf7-cadce3c211f5 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:25.544570 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8729c90e-324a-45f7-8bf7-cadce3c211f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:25.544844 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8729c90e-324a-45f7-8bf7-cadce3c211f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:25.561106 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8729c90e-324a-45f7-8bf7-cadce3c211f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:25.563383 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8729c90e-324a-45f7-8bf7-cadce3c211f5 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:25.585537 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-8729c90e-324a-45f7-8bf7-cadce3c211f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:25.585537 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:25.585537 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:25.585537 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:25.585537 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:25.585537 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:25.585537 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:25.585537 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:25.585537 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:25.585537 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:25.585537 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:25.585537 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:25.585537 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:25.585537 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:25.585537 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:25.585537 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:25.586585 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:25.586585 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:25.586585 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:25.586585 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:25.586585 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:25.586585 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:25.586585 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:25.586585 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:25.586585 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:25.586585 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:25.586585 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:25.586585 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:25.586585 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:25.586585 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:25.586585 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:25.586585 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:25.586585 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:25.587457 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:25.587457 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:25.587457 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:25.587457 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 352/703] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 12:07:25.588127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c38ec-2e76-4abe-96ec-4f2515d7808d None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:25.588408 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c38ec-2e76-4abe-96ec-4f2515d7808d None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:25.588678 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c38ec-2e76-4abe-96ec-4f2515d7808d None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:25.589925 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 353/704] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:07:25.595758 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443310cf-2319-46f7-9405-694ec27dfd88 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:25.596045 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443310cf-2319-46f7-9405-694ec27dfd88 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:25.596324 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443310cf-2319-46f7-9405-694ec27dfd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:25.615564 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-443310cf-2319-46f7-9405-694ec27dfd88 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:25.616883 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-443310cf-2319-46f7-9405-694ec27dfd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:25.618489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:25.629838 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531bcda-c73d-4862-9564-1a0a2db42df9 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:25.673849 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033ad6f-f32b-496b-b573-0836b92b16f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:25.675089 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033ad6f-f32b-496b-b573-0836b92b16f7 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:25.675538 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033ad6f-f32b-496b-b573-0836b92b16f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:25.675973 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033ad6f-f32b-496b-b573-0836b92b16f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:25.676831 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b033ad6f-f32b-496b-b573-0836b92b16f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:25.677295 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b033ad6f-f32b-496b-b573-0836b92b16f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:25.679531 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b033ad6f-f32b-496b-b573-0836b92b16f7 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:25.694758 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 352/705] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:25.695947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033ad6f-f32b-496b-b573-0836b92b16f7 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:25.703163 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 354/706] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:07:25.704161 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443310cf-2319-46f7-9405-694ec27dfd88 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:25.819097 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:25.858468 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033ad6f-f32b-496b-b573-0836b92b16f7 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:25.876963 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443310cf-2319-46f7-9405-694ec27dfd88 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:25.916852 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970e612-1147-4414-a84a-4ea6ad0c55fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:25.918687 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970e612-1147-4414-a84a-4ea6ad0c55fa None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:25.919589 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970e612-1147-4414-a84a-4ea6ad0c55fa None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:25.920884 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970e612-1147-4414-a84a-4ea6ad0c55fa None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:25.922005 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970e612-1147-4414-a84a-4ea6ad0c55fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:25.923945 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970e612-1147-4414-a84a-4ea6ad0c55fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:25.925644 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970e612-1147-4414-a84a-4ea6ad0c55fa None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:25.945308 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d204c-45aa-494e-8f67-d2d53bd2a6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:25.946249 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d204c-45aa-494e-8f67-d2d53bd2a6ee None admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:25.946750 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d204c-45aa-494e-8f67-d2d53bd2a6ee None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:25.947235 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d204c-45aa-494e-8f67-d2d53bd2a6ee None admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:25.948079 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d204c-45aa-494e-8f67-d2d53bd2a6ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:25.951396 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d204c-45aa-494e-8f67-d2d53bd2a6ee None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:25.953739 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 353/707] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:25.963318 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970e612-1147-4414-a84a-4ea6ad0c55fa None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:25.983046 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:25.993285 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 355/708] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Sep 21 12:07:25 2022] POST /identity/v3/users => generated 254 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:07:26.003772 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d204c-45aa-494e-8f67-d2d53bd2a6ee None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:26.135132 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970e612-1147-4414-a84a-4ea6ad0c55fa None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:26.140303 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d204c-45aa-494e-8f67-d2d53bd2a6ee None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:26.171301 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:26.190129 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae92cfb-c297-4e91-b777-d22cb4817ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:26.190808 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae92cfb-c297-4e91-b777-d22cb4817ef5 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:26.191090 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae92cfb-c297-4e91-b777-d22cb4817ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:26.191365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae92cfb-c297-4e91-b777-d22cb4817ef5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:26.193490 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee9270-af45-4aa9-901a-534f618a4407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:26.194146 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee9270-af45-4aa9-901a-534f618a4407 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:26.195084 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee9270-af45-4aa9-901a-534f618a4407 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:26.195416 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee9270-af45-4aa9-901a-534f618a4407 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:26.195964 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ee9270-af45-4aa9-901a-534f618a4407 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:26.204228 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ee9270-af45-4aa9-901a-534f618a4407 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:26.210299 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae92cfb-c297-4e91-b777-d22cb4817ef5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:26.211848 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae92cfb-c297-4e91-b777-d22cb4817ef5 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:26.221225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-c1ee9270-af45-4aa9-901a-534f618a4407 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 21 12:07:26.221225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:26.221225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 12:07:26.221225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 12:07:26.221225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 12:07:26.221225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 12:07:26.221225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 12:07:26.221225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:07:26.221225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 21 12:07:26.221225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:26.221225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 12:07:26.221225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:26.221225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:26.221225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:26.221225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:26.221225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:26.221225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:26.222413 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:26.222413 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:26.222413 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:26.222413 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:26.222413 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:26.222413 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:26.222413 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 12:07:26.222413 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 12:07:26.222413 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 12:07:26.222413 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 12:07:26.222413 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:26.222413 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:26.222413 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:26.222413 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:26.222413 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:26.222413 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:26.223266 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:26.223266 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:26.223266 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:26.223266 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:26.223266 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:26.223266 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:26.223266 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:26.223266 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:26.223266 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:26.223266 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:26.223266 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 12:07:26.223266 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:07:26.223266 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 21 12:07:26.223266 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:26.226239 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 356/709] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Sep 21 12:07:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:26.227110 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-fae92cfb-c297-4e91-b777-d22cb4817ef5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:26.227110 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:26.227110 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:26.227110 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:26.227110 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:26.227110 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:26.227110 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:26.227110 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:26.227110 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:26.227110 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:26.227110 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:26.227110 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:26.227110 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 12:07:26.227110 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 12:07:26.227110 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 12:07:26.227987 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 12:07:26.227987 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:26.227987 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:26.227987 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:26.227987 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:26.227987 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:26.227987 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:26.227987 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:26.227987 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:26.227987 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:26.227987 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:26.227987 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:26.227987 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:26.227987 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:26.227987 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:26.227987 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:26.227987 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:26.228918 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 12:07:26.228918 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 12:07:26.228918 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 12:07:26.228918 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 12:07:26.228918 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 12:07:26.228918 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 12:07:26.228918 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:26.228918 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:26.230835 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08206155-1e86-4968-95b1-957ccb17ebab None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:26.231414 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08206155-1e86-4968-95b1-957ccb17ebab None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:26.231930 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08206155-1e86-4968-95b1-957ccb17ebab None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:26.233897 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 357/710] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:07:26.238099 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 354/711] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:07:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:26.238099 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae92cfb-c297-4e91-b777-d22cb4817ef5 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:26.240556 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe11c0-950a-45dd-942b-e195860f6d53 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:26.240846 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe11c0-950a-45dd-942b-e195860f6d53 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:26.241123 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe11c0-950a-45dd-942b-e195860f6d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:26.266314 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-cebe11c0-950a-45dd-942b-e195860f6d53 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:26.267565 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-cebe11c0-950a-45dd-942b-e195860f6d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:26.343014 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:26.359399 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 358/712] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:07:26.360724 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe11c0-950a-45dd-942b-e195860f6d53 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:26.384419 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae92cfb-c297-4e91-b777-d22cb4817ef5 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:26.421611 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1312c-e8d5-4a14-8a7a-a5ddb8ba597c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:26.422225 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1312c-e8d5-4a14-8a7a-a5ddb8ba597c None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:26.422534 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1312c-e8d5-4a14-8a7a-a5ddb8ba597c None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:26.422807 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1312c-e8d5-4a14-8a7a-a5ddb8ba597c None admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:26.423593 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f1312c-e8d5-4a14-8a7a-a5ddb8ba597c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:26.424060 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f1312c-e8d5-4a14-8a7a-a5ddb8ba597c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:26.425394 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f1312c-e8d5-4a14-8a7a-a5ddb8ba597c None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:26.439100 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 355/713] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Sep 21 12:07:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:26.447493 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1312c-e8d5-4a14-8a7a-a5ddb8ba597c None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:26.556435 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe11c0-950a-45dd-942b-e195860f6d53 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:26.564579 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1312c-e8d5-4a14-8a7a-a5ddb8ba597c None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:26.600111 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:26.606661 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:26.609349 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f926b664-7c5f-461c-a18d-ba5b38e9bb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:26.610276 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926b664-7c5f-461c-a18d-ba5b38e9bb8c None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:26.610782 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926b664-7c5f-461c-a18d-ba5b38e9bb8c None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:26.611258 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926b664-7c5f-461c-a18d-ba5b38e9bb8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:26.612269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f926b664-7c5f-461c-a18d-ba5b38e9bb8c None admin] RBAC: Adding query filter params (role.id=72c80b472acb462ebadd86463efe91f7, scope.project.id=b0abcc6f2ce14825bfc26e6210889c21, user.id=6cb4001f94b8439180ca2a93d3b279b1) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:26.613694 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f926b664-7c5f-461c-a18d-ba5b38e9bb8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:26.615383 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f926b664-7c5f-461c-a18d-ba5b38e9bb8c None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:26.622430 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 356/714] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:07:26 2022] GET /identity/v3/role_assignments?user.id=6cb4001f94b8439180ca2a93d3b279b1&scope.project.id=b0abcc6f2ce14825bfc26e6210889c21&role.id=72c80b472acb462ebadd86463efe91f7 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:26.647873 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53be6dd-f3a6-420e-9750-b2d6a7fa5183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:26.648504 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53be6dd-f3a6-420e-9750-b2d6a7fa5183 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:26.648786 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53be6dd-f3a6-420e-9750-b2d6a7fa5183 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:26.649060 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53be6dd-f3a6-420e-9750-b2d6a7fa5183 None admin] PATH_INFO: `/v3/services` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:26.649707 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53be6dd-f3a6-420e-9750-b2d6a7fa5183 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:26.650010 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53be6dd-f3a6-420e-9750-b2d6a7fa5183 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:26.651454 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53be6dd-f3a6-420e-9750-b2d6a7fa5183 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:26.662927 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 359/715] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Sep 21 12:07:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:26.669025 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f926b664-7c5f-461c-a18d-ba5b38e9bb8c None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:26.756909 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53be6dd-f3a6-420e-9750-b2d6a7fa5183 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:26.832617 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f926b664-7c5f-461c-a18d-ba5b38e9bb8c None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:26.898084 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5349249-dc6f-45b7-90c4-171c0fbb5252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:26.900274 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5349249-dc6f-45b7-90c4-171c0fbb5252 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:26.901961 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5349249-dc6f-45b7-90c4-171c0fbb5252 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:26.902419 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5349249-dc6f-45b7-90c4-171c0fbb5252 None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:26.903308 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5349249-dc6f-45b7-90c4-171c0fbb5252 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:26.905077 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5349249-dc6f-45b7-90c4-171c0fbb5252 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:26.908353 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5349249-dc6f-45b7-90c4-171c0fbb5252 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:26.924272 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 357/716] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Sep 21 12:07:26 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:26.946187 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53be6dd-f3a6-420e-9750-b2d6a7fa5183 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:27.010888 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca75550-f4b2-481c-abf3-27c9c83c6c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:27.011908 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca75550-f4b2-481c-abf3-27c9c83c6c52 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:27.012407 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca75550-f4b2-481c-abf3-27c9c83c6c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:27.013133 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca75550-f4b2-481c-abf3-27c9c83c6c52 None admin] PATH_INFO: `/v3/services/network` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:27.013925 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca75550-f4b2-481c-abf3-27c9c83c6c52 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:27.015570 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca75550-f4b2-481c-abf3-27c9c83c6c52 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:27.034732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-0ca75550-f4b2-481c-abf3-27c9c83c6c52 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 21 12:07:27.034732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:27.034732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 12:07:27.034732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 12:07:27.034732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 12:07:27.034732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 12:07:27.034732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 12:07:27.034732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:07:27.034732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 21 12:07:27.034732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:27.034732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 12:07:27.034732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:27.034732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:27.034732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:27.034732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:27.034732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:27.034732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:27.035837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:27.035837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:27.035837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:27.035837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:27.035837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:27.035837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:27.035837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 12:07:27.035837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 12:07:27.035837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 12:07:27.035837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 12:07:27.035837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:27.035837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:27.035837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:27.035837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:27.035837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:27.035837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:27.036767 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:27.036767 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:27.036767 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:27.036767 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:27.036767 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:27.036767 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:27.036767 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:27.036767 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:27.036767 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:27.036767 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:27.036767 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 12:07:27.036767 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:07:27.036767 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 21 12:07:27.036767 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:27.040232 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 360/717] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:07:26 2022] GET /identity/v3/services/network => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:27.046315 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5349249-dc6f-45b7-90c4-171c0fbb5252 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:27.125818 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:27.184438 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5349249-dc6f-45b7-90c4-171c0fbb5252 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:27.242628 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f851f-5857-43d6-b796-1d22d724a0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:27.245569 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f851f-5857-43d6-b796-1d22d724a0ea None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:27.245860 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f851f-5857-43d6-b796-1d22d724a0ea None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:27.246143 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f851f-5857-43d6-b796-1d22d724a0ea None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:27.246825 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f851f-5857-43d6-b796-1d22d724a0ea None admin] RBAC: Adding query filter params (name=network) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:27.247132 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f851f-5857-43d6-b796-1d22d724a0ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:27.248559 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f851f-5857-43d6-b796-1d22d724a0ea None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:27.254266 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 358/718] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Sep 21 12:07:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:27.260723 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca75550-f4b2-481c-abf3-27c9c83c6c52 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:27.338164 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:27.402580 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca75550-f4b2-481c-abf3-27c9c83c6c52 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:27.443686 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df18718-6926-40ef-924b-53fb164a001c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:27.444963 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df18718-6926-40ef-924b-53fb164a001c None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:27.445250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df18718-6926-40ef-924b-53fb164a001c None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:27.445524 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df18718-6926-40ef-924b-53fb164a001c None admin] PATH_INFO: `/v3/services` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:27.446169 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df18718-6926-40ef-924b-53fb164a001c None admin] RBAC: Adding query filter params (type=network) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:27.446516 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df18718-6926-40ef-924b-53fb164a001c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:27.447900 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df18718-6926-40ef-924b-53fb164a001c None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:27.455964 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 361/719] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Sep 21 12:07:27 2022] GET /identity/v3/services?type=network => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:27.907078 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a02c8-d8ad-49ed-adae-c634ca7e2c01 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:27.907624 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a02c8-d8ad-49ed-adae-c634ca7e2c01 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:27.907624 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a02c8-d8ad-49ed-adae-c634ca7e2c01 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:27.909245 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 359/720] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:07:27.915063 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ad7aa-195e-4d36-bc76-c0a07cd9ef30 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:27.915529 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ad7aa-195e-4d36-bc76-c0a07cd9ef30 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:27.915605 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ad7aa-195e-4d36-bc76-c0a07cd9ef30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:27.942769 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-245ad7aa-195e-4d36-bc76-c0a07cd9ef30 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:27.943978 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-245ad7aa-195e-4d36-bc76-c0a07cd9ef30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:28.028048 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 362/721] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:07:28.432879 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a02c8-d8ad-49ed-adae-c634ca7e2c01 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:28.594488 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a02c8-d8ad-49ed-adae-c634ca7e2c01 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:28.622219 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:28.644369 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151891ee-ba7a-4f2b-b040-1f1577dedc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:28.645003 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151891ee-ba7a-4f2b-b040-1f1577dedc3b None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:28.645284 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151891ee-ba7a-4f2b-b040-1f1577dedc3b None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:28.645555 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151891ee-ba7a-4f2b-b040-1f1577dedc3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:28.665671 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151891ee-ba7a-4f2b-b040-1f1577dedc3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:07:28.670668 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-151891ee-ba7a-4f2b-b040-1f1577dedc3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:07:28.670668 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:28.670668 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:28.670668 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:28.670668 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:28.670668 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:28.670668 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:28.670668 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:28.670668 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:28.670668 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:28.670668 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:28.670668 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:28.670668 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:07:28.670668 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:07:28.670668 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:07:28.670668 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:07:28.671609 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:07:28.671609 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:07:28.671609 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:07:28.671609 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:07:28.671609 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:28.671609 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:28.671609 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:28.671609 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:28.671609 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:28.671609 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:28.671609 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:28.671609 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:28.671609 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:28.671609 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:28.671609 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:28.671609 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:28.672453 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:28.672453 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:28.672453 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:28.672453 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:28.672453 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:07:28.672453 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:07:28.672453 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:07:28.672453 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:07:28.672453 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:07:28.672453 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:07:28.672453 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:07:28.672453 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:28.672453 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 360/722] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Sep 21 12:07:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:28.678220 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ad7aa-195e-4d36-bc76-c0a07cd9ef30 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:28.739654 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:28.744822 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7232a-1dcf-41ee-8062-20251cfff4ca None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:28.745097 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7232a-1dcf-41ee-8062-20251cfff4ca None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:28.745365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7232a-1dcf-41ee-8062-20251cfff4ca None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:28.746757 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 361/723] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:07:28.756624 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26edc0-6814-41a9-9d16-a900776bd968 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:28.757460 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26edc0-6814-41a9-9d16-a900776bd968 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:28.757701 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26edc0-6814-41a9-9d16-a900776bd968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:28.789809 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-2d26edc0-6814-41a9-9d16-a900776bd968 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:28.791126 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2d26edc0-6814-41a9-9d16-a900776bd968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:28.834294 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ad7aa-195e-4d36-bc76-c0a07cd9ef30 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:28.902034 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080d72a-ed3c-4f71-a98c-3c4495e9407f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:28.902678 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080d72a-ed3c-4f71-a98c-3c4495e9407f None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:28.902955 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080d72a-ed3c-4f71-a98c-3c4495e9407f None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:28.903229 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7080d72a-ed3c-4f71-a98c-3c4495e9407f None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:28.903902 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7080d72a-ed3c-4f71-a98c-3c4495e9407f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:28.904206 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7080d72a-ed3c-4f71-a98c-3c4495e9407f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:28.905591 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7080d72a-ed3c-4f71-a98c-3c4495e9407f None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:28.908601 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 362/724] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:07:28.918004 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 363/725] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:07:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:28.925464 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26edc0-6814-41a9-9d16-a900776bd968 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:29.052072 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26edc0-6814-41a9-9d16-a900776bd968 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:29.077198 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:29.104229 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb4606-f67a-48f3-890e-df3b92c58d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:29.104858 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb4606-f67a-48f3-890e-df3b92c58d83 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:29.105137 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb4606-f67a-48f3-890e-df3b92c58d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:29.105407 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb4606-f67a-48f3-890e-df3b92c58d83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:29.123439 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb4606-f67a-48f3-890e-df3b92c58d83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:29.124887 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb4606-f67a-48f3-890e-df3b92c58d83 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:29.145795 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-adbb4606-f67a-48f3-890e-df3b92c58d83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:29.145795 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:29.145795 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:29.145795 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:29.145795 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:29.145795 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:29.145795 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:29.145795 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:29.145795 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:29.145795 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:29.145795 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:29.145795 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:29.145795 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:29.145795 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:29.145795 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:29.145795 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:29.146854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:29.146854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:29.146854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:29.146854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:29.146854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:29.146854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:29.146854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:29.146854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:29.146854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:29.146854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:29.146854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:29.146854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:29.146854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:29.146854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:29.146854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:29.146854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:29.146854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:29.148367 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:29.148367 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:29.148367 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:29.148367 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 363/726] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:29.153420 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080d72a-ed3c-4f71-a98c-3c4495e9407f None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:29.283761 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7080d72a-ed3c-4f71-a98c-3c4495e9407f None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:29.286239 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:29.329999 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821a884-cdf3-447d-949c-e0bc15fd96c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:29.331059 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821a884-cdf3-447d-949c-e0bc15fd96c1 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:29.331557 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821a884-cdf3-447d-949c-e0bc15fd96c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:29.332041 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821a884-cdf3-447d-949c-e0bc15fd96c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:29.332922 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821a884-cdf3-447d-949c-e0bc15fd96c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:29.333444 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821a884-cdf3-447d-949c-e0bc15fd96c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:29.335784 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821a884-cdf3-447d-949c-e0bc15fd96c1 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:29.355620 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 364/727] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:29.361337 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb4606-f67a-48f3-890e-df3b92c58d83 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:29.418747 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821a884-cdf3-447d-949c-e0bc15fd96c1 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:29.503573 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb4606-f67a-48f3-890e-df3b92c58d83 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:29.544717 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175cc45-4815-4761-8bbb-be62f6355abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:29.545566 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175cc45-4815-4761-8bbb-be62f6355abc None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:29.546081 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175cc45-4815-4761-8bbb-be62f6355abc None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:29.546452 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175cc45-4815-4761-8bbb-be62f6355abc None admin] PATH_INFO: `/v3/users/swift` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:29.562514 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175cc45-4815-4761-8bbb-be62f6355abc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:29.565084 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175cc45-4815-4761-8bbb-be62f6355abc None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:29.580516 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-9175cc45-4815-4761-8bbb-be62f6355abc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 21 12:07:29.580516 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:29.580516 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:29.580516 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:29.580516 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:29.580516 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:29.580516 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:29.580516 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:29.580516 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:29.580516 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:29.580516 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:29.580516 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:29.580516 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 12:07:29.580516 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 12:07:29.580516 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 12:07:29.580516 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 12:07:29.581662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:29.581662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:29.581662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 12:07:29.581662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:29.581662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 12:07:29.581662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:29.581662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:29.581662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:29.581662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:29.581662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:29.581662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:29.581662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:29.581662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:29.581662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:29.581662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:29.581662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:29.581662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:29.581662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:29.582864 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:29.582864 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:29.582864 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 12:07:29.582864 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 12:07:29.582864 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 12:07:29.582864 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 12:07:29.582864 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 12:07:29.582864 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 12:07:29.582864 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 21 12:07:29.582864 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:29.583689 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821a884-cdf3-447d-949c-e0bc15fd96c1 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:29.589070 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 364/728] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Sep 21 12:07:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:29.590547 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7020f6-d022-4c60-9f5c-2670f0af36bd None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:29.590931 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7020f6-d022-4c60-9f5c-2670f0af36bd None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:29.591305 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7020f6-d022-4c60-9f5c-2670f0af36bd None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:29.593190 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 365/729] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:07:29.594209 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7020f6-d022-4c60-9f5c-2670f0af36bd None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:29.627933 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:29.629747 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c58a55-b105-4e5b-ab20-228e447babc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:29.630658 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c58a55-b105-4e5b-ab20-228e447babc6 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:29.631059 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c58a55-b105-4e5b-ab20-228e447babc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:29.631421 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c58a55-b105-4e5b-ab20-228e447babc6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:29.644321 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c58a55-b105-4e5b-ab20-228e447babc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:07:29.649754 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-d1c58a55-b105-4e5b-ab20-228e447babc6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 12:07:29.649754 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:29.649754 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:29.649754 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:29.649754 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:29.649754 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:29.649754 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:29.649754 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:29.649754 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:29.649754 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:29.649754 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:29.649754 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:29.649754 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:07:29.649754 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:07:29.649754 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:07:29.649754 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:07:29.650718 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:07:29.650718 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:07:29.650718 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:07:29.650718 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:07:29.650718 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:29.650718 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:29.650718 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:29.650718 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:29.650718 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:29.650718 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:29.650718 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:29.650718 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:29.650718 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:29.650718 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:29.650718 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:29.650718 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:29.651559 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:29.651559 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:29.651559 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:29.651559 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:29.651559 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:07:29.651559 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:07:29.651559 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:07:29.651559 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:07:29.651559 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:07:29.651559 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:07:29.651559 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 12:07:29.651559 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:29.655948 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 365/730] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Sep 21 12:07:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 12:07:29.657400 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070a351-5a2d-4f06-a50d-2abb6de4c0ef None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:29.657758 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070a351-5a2d-4f06-a50d-2abb6de4c0ef None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:29.658105 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070a351-5a2d-4f06-a50d-2abb6de4c0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:29.679257 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-5070a351-5a2d-4f06-a50d-2abb6de4c0ef None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:29.680608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-5070a351-5a2d-4f06-a50d-2abb6de4c0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:29.703966 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:29.721009 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7020f6-d022-4c60-9f5c-2670f0af36bd None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:29.766539 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 366/731] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:07:29.768380 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070a351-5a2d-4f06-a50d-2abb6de4c0ef None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:29.773963 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9638692-266b-4d14-8ecb-19f36494f1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:29.774994 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9638692-266b-4d14-8ecb-19f36494f1c9 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:29.776214 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9638692-266b-4d14-8ecb-19f36494f1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:29.776946 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9638692-266b-4d14-8ecb-19f36494f1c9 None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:29.778853 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9638692-266b-4d14-8ecb-19f36494f1c9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:29.780446 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9638692-266b-4d14-8ecb-19f36494f1c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:29.782923 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9638692-266b-4d14-8ecb-19f36494f1c9 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:29.822008 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 366/732] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Sep 21 12:07:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:29.828584 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9638692-266b-4d14-8ecb-19f36494f1c9 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:29.988344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070a351-5a2d-4f06-a50d-2abb6de4c0ef None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:29.993223 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:30.013328 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9638692-266b-4d14-8ecb-19f36494f1c9 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:30.036252 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c135f-7717-4043-abef-c687e122209a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:30.036981 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c135f-7717-4043-abef-c687e122209a None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:30.037336 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c135f-7717-4043-abef-c687e122209a None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:30.037680 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c135f-7717-4043-abef-c687e122209a None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:30.039052 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c135f-7717-4043-abef-c687e122209a None admin] RBAC: Adding query filter params (name=service) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:30.039430 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c135f-7717-4043-abef-c687e122209a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:30.040882 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c135f-7717-4043-abef-c687e122209a None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:30.050427 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 367/733] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Sep 21 12:07:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:30.051777 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52e116-a102-45dd-9241-37016cf27b18 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:30.052134 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52e116-a102-45dd-9241-37016cf27b18 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:30.052479 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52e116-a102-45dd-9241-37016cf27b18 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:30.055382 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe91127-149b-4881-981e-ccdde3492206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:30.056244 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe91127-149b-4881-981e-ccdde3492206 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:30.056685 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe91127-149b-4881-981e-ccdde3492206 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:30.057116 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe91127-149b-4881-981e-ccdde3492206 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:30.058091 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 368/734] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:07:30.059195 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52e116-a102-45dd-9241-37016cf27b18 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:30.079038 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:30.151109 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe91127-149b-4881-981e-ccdde3492206 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:30.153288 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe91127-149b-4881-981e-ccdde3492206 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:30.181065 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52e116-a102-45dd-9241-37016cf27b18 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:30.230263 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3d2be-5c8e-4e92-829e-cb176287e8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:30.230945 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3d2be-5c8e-4e92-829e-cb176287e8bc None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:30.231217 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3d2be-5c8e-4e92-829e-cb176287e8bc None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:30.231491 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3d2be-5c8e-4e92-829e-cb176287e8bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:30.243426 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3d2be-5c8e-4e92-829e-cb176287e8bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:30.244810 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3d2be-5c8e-4e92-829e-cb176287e8bc None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:30.257884 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:30.261796 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-c0f3d2be-5c8e-4e92-829e-cb176287e8bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:30.261796 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:30.261796 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:30.261796 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:30.261796 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:30.261796 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:30.261796 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:30.261796 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:30.261796 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:30.261796 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:30.261796 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:30.261796 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:30.261796 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:30.261796 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:30.261796 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:30.261796 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:30.263103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:30.263103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:30.263103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:30.263103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:30.263103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:30.263103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:30.263103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:30.263103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:30.263103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:30.263103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:30.263103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:30.263103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:30.263103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:30.263103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:30.263103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:30.263103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:30.263103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:30.264058 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:30.264058 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:30.264058 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:30.264058 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 369/735] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:30.264690 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e800e-d8ac-4429-aeed-647cdfcd51ca None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:30.264944 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e800e-d8ac-4429-aeed-647cdfcd51ca None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:30.265213 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8e800e-d8ac-4429-aeed-647cdfcd51ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:30.280539 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 367/736] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:07:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 21 12:07:30.281689 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe91127-149b-4881-981e-ccdde3492206 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:30.291248 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-dd8e800e-d8ac-4429-aeed-647cdfcd51ca None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:30.292473 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-dd8e800e-d8ac-4429-aeed-647cdfcd51ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:30.357523 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:30.363370 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 370/737] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:07:30.364719 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0bca41-bca0-4749-8127-5e768e493f0a None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:30.365002 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0bca41-bca0-4749-8127-5e768e493f0a None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:30.365587 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0bca41-bca0-4749-8127-5e768e493f0a None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:30.367558 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 371/738] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:07:30.368282 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0bca41-bca0-4749-8127-5e768e493f0a None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:30.405853 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe91127-149b-4881-981e-ccdde3492206 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:30.464137 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71bf2ac-76fe-420c-9fb9-bf1286552d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:30.465151 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bf2ac-76fe-420c-9fb9-bf1286552d43 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:30.465650 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bf2ac-76fe-420c-9fb9-bf1286552d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:30.466203 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bf2ac-76fe-420c-9fb9-bf1286552d43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:30.482278 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71bf2ac-76fe-420c-9fb9-bf1286552d43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:07:30.487929 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-e71bf2ac-76fe-420c-9fb9-bf1286552d43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:07:30.487929 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:30.487929 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:30.487929 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:30.487929 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:30.487929 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:30.487929 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:30.487929 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:30.487929 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:30.487929 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:30.487929 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:30.487929 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:30.487929 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:07:30.487929 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:07:30.487929 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:07:30.487929 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:07:30.488936 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:07:30.488936 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:07:30.488936 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:07:30.488936 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:07:30.488936 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:30.488936 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:30.488936 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:30.488936 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:30.488936 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:30.488936 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:30.488936 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:30.488936 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:30.488936 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:30.488936 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:30.488936 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:30.488936 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:30.496049 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:30.496049 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:30.496049 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:30.496049 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:30.496049 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:07:30.496049 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:07:30.496049 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:07:30.496049 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:07:30.496049 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:07:30.496049 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:07:30.496049 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:07:30.496049 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:30.496049 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 368/739] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Sep 21 12:07:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:30.496049 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71bf2ac-76fe-420c-9fb9-bf1286552d43 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:30.537604 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0bca41-bca0-4749-8127-5e768e493f0a None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:30.555353 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:30.589765 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b2f11-3bb6-4472-879e-4b5be860505b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:30.590498 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b2f11-3bb6-4472-879e-4b5be860505b None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:30.590877 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b2f11-3bb6-4472-879e-4b5be860505b None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:30.591050 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b2f11-3bb6-4472-879e-4b5be860505b None admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:30.591702 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3b2f11-3bb6-4472-879e-4b5be860505b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:30.592005 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3b2f11-3bb6-4472-879e-4b5be860505b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:30.594060 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3b2f11-3bb6-4472-879e-4b5be860505b None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:30.610911 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 372/740] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:30.610911 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f8d5d-ba6f-43dc-a6ca-58b6ec33222f None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:30.610911 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f8d5d-ba6f-43dc-a6ca-58b6ec33222f None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:30.610911 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f8d5d-ba6f-43dc-a6ca-58b6ec33222f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:30.626666 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-a97f8d5d-ba6f-43dc-a6ca-58b6ec33222f None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:30.627870 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-a97f8d5d-ba6f-43dc-a6ca-58b6ec33222f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:30.640326 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71bf2ac-76fe-420c-9fb9-bf1286552d43 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:30.677616 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2e3b8-f0a0-4576-9632-bf1dfed351dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:30.678241 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2e3b8-f0a0-4576-9632-bf1dfed351dc None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:30.678625 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2e3b8-f0a0-4576-9632-bf1dfed351dc None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:30.678897 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2e3b8-f0a0-4576-9632-bf1dfed351dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:30.683257 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:30.689469 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2e3b8-f0a0-4576-9632-bf1dfed351dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:30.690962 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2e3b8-f0a0-4576-9632-bf1dfed351dc None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:30.697744 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 373/741] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 21 12:07:30.698933 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f8d5d-ba6f-43dc-a6ca-58b6ec33222f None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:30.708922 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-31a2e3b8-f0a0-4576-9632-bf1dfed351dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:30.708922 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:30.708922 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:30.708922 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:30.708922 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:30.708922 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:30.708922 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:30.708922 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:30.708922 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:30.708922 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:30.708922 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:30.708922 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:30.708922 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:30.708922 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:30.708922 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:30.708922 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:30.710520 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:30.710520 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:30.710520 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:30.710520 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:30.710520 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:30.710520 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:30.710520 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:30.710520 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:30.710520 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:30.710520 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:30.710520 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:30.710520 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:30.710520 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:30.710520 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:30.710520 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:30.710520 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:30.710520 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:30.711434 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:30.711434 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:30.711434 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:30.711434 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 369/742] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:30.711666 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2e3b8-f0a0-4576-9632-bf1dfed351dc None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:30.818897 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f8d5d-ba6f-43dc-a6ca-58b6ec33222f None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:30.825377 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:30.837102 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2e3b8-f0a0-4576-9632-bf1dfed351dc None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:30.857718 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6482816-7158-40a0-abda-e035905816f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:30.858336 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6482816-7158-40a0-abda-e035905816f4 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:30.858651 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6482816-7158-40a0-abda-e035905816f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:30.860589 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6482816-7158-40a0-abda-e035905816f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:30.860589 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6482816-7158-40a0-abda-e035905816f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:30.860589 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6482816-7158-40a0-abda-e035905816f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:30.861336 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6482816-7158-40a0-abda-e035905816f4 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:30.871363 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 374/743] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:07:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:30.872142 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6482816-7158-40a0-abda-e035905816f4 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:30.884314 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06bd744-3d12-41f5-819b-b2bbdfdd6592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:30.885416 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bd744-3d12-41f5-819b-b2bbdfdd6592 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:30.885416 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bd744-3d12-41f5-819b-b2bbdfdd6592 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:30.885617 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bd744-3d12-41f5-819b-b2bbdfdd6592 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:30.894607 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06bd744-3d12-41f5-819b-b2bbdfdd6592 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:30.896348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06bd744-3d12-41f5-819b-b2bbdfdd6592 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:30.909682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-a06bd744-3d12-41f5-819b-b2bbdfdd6592 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 12:07:30.909682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:30.909682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:30.909682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:30.909682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:30.909682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:30.909682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:30.909682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:30.909682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:30.909682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:30.909682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:30.909682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:30.909682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 12:07:30.909682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 12:07:30.909682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 12:07:30.909682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 12:07:30.912418 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:30.912418 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:30.912418 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 12:07:30.912418 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:30.912418 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 12:07:30.912418 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:30.912418 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:30.912418 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:30.912418 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:30.912418 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:30.912418 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:30.912418 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:30.912418 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:30.912418 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:30.912418 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:30.912418 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:30.912418 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:30.912418 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:30.914700 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:30.914700 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:30.914700 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 12:07:30.914700 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 12:07:30.914700 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 12:07:30.914700 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 12:07:30.914700 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 12:07:30.914700 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 12:07:30.914700 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 12:07:30.914700 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:30.914700 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 370/744] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Sep 21 12:07:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:30.917052 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06bd744-3d12-41f5-819b-b2bbdfdd6592 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:30.941738 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:31.001886 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6482816-7158-40a0-abda-e035905816f4 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:31.036291 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06bd744-3d12-41f5-819b-b2bbdfdd6592 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:31.038950 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e014f32-4c5e-4d43-8927-165b2f4137e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:31.039731 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e014f32-4c5e-4d43-8927-165b2f4137e5 None admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:31.041178 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e014f32-4c5e-4d43-8927-165b2f4137e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:31.042994 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e014f32-4c5e-4d43-8927-165b2f4137e5 None admin] PATH_INFO: `/v3/services` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:31.043696 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e014f32-4c5e-4d43-8927-165b2f4137e5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:31.045132 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e014f32-4c5e-4d43-8927-165b2f4137e5 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:31.063382 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 375/745] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Sep 21 12:07:30 2022] POST /identity/v3/services => generated 251 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:07:31.064090 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e014f32-4c5e-4d43-8927-165b2f4137e5 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:31.091274 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03398f97-d053-436a-b74c-1e0a256f6156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:31.092016 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03398f97-d053-436a-b74c-1e0a256f6156 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:31.092297 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03398f97-d053-436a-b74c-1e0a256f6156 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:31.092571 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03398f97-d053-436a-b74c-1e0a256f6156 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:31.093259 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03398f97-d053-436a-b74c-1e0a256f6156 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:31.093562 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03398f97-d053-436a-b74c-1e0a256f6156 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:31.095031 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03398f97-d053-436a-b74c-1e0a256f6156 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:31.114401 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 371/746] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:31.114401 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03398f97-d053-436a-b74c-1e0a256f6156 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:31.133622 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:31.197587 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e014f32-4c5e-4d43-8927-165b2f4137e5 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:31.209231 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:31.232717 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03398f97-d053-436a-b74c-1e0a256f6156 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:31.236874 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d254f-2ecc-4b3e-bd3d-aea4acf35a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:31.237587 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d254f-2ecc-4b3e-bd3d-aea4acf35a1d None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:31.237949 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d254f-2ecc-4b3e-bd3d-aea4acf35a1d None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:31.238285 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d254f-2ecc-4b3e-bd3d-aea4acf35a1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:31.252503 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d254f-2ecc-4b3e-bd3d-aea4acf35a1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:31.254063 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d254f-2ecc-4b3e-bd3d-aea4acf35a1d None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:31.270296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-516d254f-2ecc-4b3e-bd3d-aea4acf35a1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:31.270296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:31.270296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:31.270296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:31.270296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:31.270296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:31.270296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:31.270296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:31.270296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:31.270296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:31.270296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:31.270296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:31.270296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:31.270296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:31.270296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:31.270296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:31.271511 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:31.271511 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:31.271511 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:31.271511 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:31.271511 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:31.271511 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:31.271511 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:31.271511 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:31.271511 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:31.271511 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:31.271511 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:31.271511 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:31.271511 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:31.271511 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:31.271511 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:31.271511 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:31.271511 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:31.273037 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:31.273037 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:31.273037 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:31.274724 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 376/747] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:31.274965 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e7ba1-2225-459b-ab36-91cab51d0fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:31.275581 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e7ba1-2225-459b-ab36-91cab51d0fc7 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:31.275868 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e7ba1-2225-459b-ab36-91cab51d0fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:31.276120 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e7ba1-2225-459b-ab36-91cab51d0fc7 None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:31.276310 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d254f-2ecc-4b3e-bd3d-aea4acf35a1d None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:31.276836 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e7ba1-2225-459b-ab36-91cab51d0fc7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:31.277140 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e7ba1-2225-459b-ab36-91cab51d0fc7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:31.278606 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e7ba1-2225-459b-ab36-91cab51d0fc7 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:31.297665 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 372/748] 10.222.0.60 () {56 vars in 1149 bytes} [Wed Sep 21 12:07:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:31.298328 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e7ba1-2225-459b-ab36-91cab51d0fc7 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:31.378217 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:31.384017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d254f-2ecc-4b3e-bd3d-aea4acf35a1d None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:31.414887 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e7ba1-2225-459b-ab36-91cab51d0fc7 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:31.420275 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c70fa2-e223-4bc1-a2a7-bef0e6747779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:31.420968 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c70fa2-e223-4bc1-a2a7-bef0e6747779 None admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:31.421318 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c70fa2-e223-4bc1-a2a7-bef0e6747779 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:31.421657 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c70fa2-e223-4bc1-a2a7-bef0e6747779 None admin] PATH_INFO: `/v3/services` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:31.422441 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c70fa2-e223-4bc1-a2a7-bef0e6747779 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:31.423873 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c70fa2-e223-4bc1-a2a7-bef0e6747779 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:31.443214 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 377/749] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Sep 21 12:07:31 2022] POST /identity/v3/services => generated 240 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:07:31.443214 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c70fa2-e223-4bc1-a2a7-bef0e6747779 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:31.464341 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11c6d4-690d-4e18-ba45-b35a42248670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:31.465149 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11c6d4-690d-4e18-ba45-b35a42248670 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:31.465528 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11c6d4-690d-4e18-ba45-b35a42248670 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:31.465903 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11c6d4-690d-4e18-ba45-b35a42248670 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:31.474518 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11c6d4-690d-4e18-ba45-b35a42248670 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:31.476535 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11c6d4-690d-4e18-ba45-b35a42248670 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:31.484236 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:31.492140 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-0e11c6d4-690d-4e18-ba45-b35a42248670 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:31.492140 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:31.492140 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:31.492140 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:31.492140 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:31.492140 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:31.492140 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:31.492140 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:31.492140 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:31.492140 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:31.492140 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:31.492140 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:31.492140 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 12:07:31.492140 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 12:07:31.492140 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 12:07:31.493337 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 12:07:31.493337 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:31.493337 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:31.493337 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:31.493337 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:31.493337 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:31.493337 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:31.493337 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:31.493337 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:31.493337 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:31.493337 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:31.493337 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:31.493337 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:31.493337 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:31.493337 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:31.493337 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:31.493337 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:31.494490 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 12:07:31.494490 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 12:07:31.494490 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 12:07:31.494490 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 12:07:31.494490 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 12:07:31.494490 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 12:07:31.494490 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:31.494490 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:31.501263 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 373/750] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:07:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:31.503660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11c6d4-690d-4e18-ba45-b35a42248670 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:31.602471 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c70fa2-e223-4bc1-a2a7-bef0e6747779 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:31.645915 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cadb74-34a2-4242-a613-a5560e88bab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:31.646507 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cadb74-34a2-4242-a613-a5560e88bab8 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:31.646791 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cadb74-34a2-4242-a613-a5560e88bab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:31.647263 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cadb74-34a2-4242-a613-a5560e88bab8 None admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:31.648491 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cadb74-34a2-4242-a613-a5560e88bab8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:31.648798 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cadb74-34a2-4242-a613-a5560e88bab8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:31.650185 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cadb74-34a2-4242-a613-a5560e88bab8 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:31.666019 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 378/751] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:31.667329 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cadb74-34a2-4242-a613-a5560e88bab8 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:31.766476 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11c6d4-690d-4e18-ba45-b35a42248670 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:31.774416 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:31.797715 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:31.803236 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cadb74-34a2-4242-a613-a5560e88bab8 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:31.808495 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34122e-6299-425b-b46b-74a3bbcc7eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:31.809193 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34122e-6299-425b-b46b-74a3bbcc7eb5 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:31.809560 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34122e-6299-425b-b46b-74a3bbcc7eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:31.809903 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34122e-6299-425b-b46b-74a3bbcc7eb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:31.853326 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3d876-9979-4b82-9399-23dc303cf43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:31.854942 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3d876-9979-4b82-9399-23dc303cf43b None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:31.855428 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3d876-9979-4b82-9399-23dc303cf43b None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:31.855891 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3d876-9979-4b82-9399-23dc303cf43b None admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:31.857240 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c3d876-9979-4b82-9399-23dc303cf43b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:31.857747 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c3d876-9979-4b82-9399-23dc303cf43b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:31.860131 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c3d876-9979-4b82-9399-23dc303cf43b None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:31.877197 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 379/752] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Sep 21 12:07:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:31.878575 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3d876-9979-4b82-9399-23dc303cf43b None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:31.897845 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34122e-6299-425b-b46b-74a3bbcc7eb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:31.899960 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34122e-6299-425b-b46b-74a3bbcc7eb5 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:32.020232 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3d876-9979-4b82-9399-23dc303cf43b None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:32.024996 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 374/753] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:07:31 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 12:07:32.025993 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34122e-6299-425b-b46b-74a3bbcc7eb5 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:32.055466 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:32.067061 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e30ea-1eef-403a-9a18-d11495efeb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:32.068008 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e30ea-1eef-403a-9a18-d11495efeb20 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:32.068471 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e30ea-1eef-403a-9a18-d11495efeb20 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:32.068923 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e30ea-1eef-403a-9a18-d11495efeb20 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:32.079673 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e30ea-1eef-403a-9a18-d11495efeb20 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:32.081861 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e30ea-1eef-403a-9a18-d11495efeb20 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:32.097687 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-938e30ea-1eef-403a-9a18-d11495efeb20 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 21 12:07:32.097687 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:32.097687 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:32.097687 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:32.097687 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:32.097687 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:32.097687 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:32.097687 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:32.097687 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:32.097687 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:32.097687 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:32.097687 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:32.097687 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 12:07:32.097687 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 12:07:32.097687 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 12:07:32.097687 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 12:07:32.098733 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:32.098733 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:32.098733 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 12:07:32.098733 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:32.098733 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 12:07:32.098733 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:32.098733 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:32.098733 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:32.098733 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:32.098733 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:32.098733 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:32.098733 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:32.098733 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:32.098733 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:32.098733 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:32.098733 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:32.098733 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:32.098733 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:32.099664 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:32.099664 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:32.099664 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 12:07:32.099664 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 12:07:32.099664 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 12:07:32.099664 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 12:07:32.099664 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 12:07:32.099664 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 12:07:32.099664 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 21 12:07:32.099664 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:32.102528 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 380/754] 10.222.0.60 () {56 vars in 1093 bytes} [Wed Sep 21 12:07:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:32.103704 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e30ea-1eef-403a-9a18-d11495efeb20 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:32.108057 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:32.146801 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34122e-6299-425b-b46b-74a3bbcc7eb5 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:32.189551 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230ac71-2bdf-4935-b34f-dd0d110703d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:32.190254 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230ac71-2bdf-4935-b34f-dd0d110703d7 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:32.190628 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230ac71-2bdf-4935-b34f-dd0d110703d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:32.190972 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230ac71-2bdf-4935-b34f-dd0d110703d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:32.191769 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230ac71-2bdf-4935-b34f-dd0d110703d7 None admin] RBAC: Adding query filter params (role.id=72c80b472acb462ebadd86463efe91f7, scope.project.id=b0abcc6f2ce14825bfc26e6210889c21, user.id=cbc2bab11b264196859802907b93ac37) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:32.192168 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230ac71-2bdf-4935-b34f-dd0d110703d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:32.193669 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230ac71-2bdf-4935-b34f-dd0d110703d7 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:32.206852 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 375/755] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:07:32 2022] GET /identity/v3/role_assignments?user.id=cbc2bab11b264196859802907b93ac37&scope.project.id=b0abcc6f2ce14825bfc26e6210889c21&role.id=72c80b472acb462ebadd86463efe91f7 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:32.207925 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230ac71-2bdf-4935-b34f-dd0d110703d7 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:32.225734 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e30ea-1eef-403a-9a18-d11495efeb20 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:32.312402 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9237cf-348f-4127-9be3-3d6ffa332417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:32.313060 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9237cf-348f-4127-9be3-3d6ffa332417 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:32.313340 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9237cf-348f-4127-9be3-3d6ffa332417 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:32.313613 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9237cf-348f-4127-9be3-3d6ffa332417 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:32.342682 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9237cf-348f-4127-9be3-3d6ffa332417 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:32.344294 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9237cf-348f-4127-9be3-3d6ffa332417 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:32.375103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-bf9237cf-348f-4127-9be3-3d6ffa332417 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:32.375103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:32.375103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:32.375103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:32.375103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:32.375103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:32.375103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:32.375103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:32.375103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:32.375103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:32.375103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:32.375103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:32.375103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:32.375103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:32.375103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:32.375103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:32.376191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:32.376191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:32.376191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:32.376191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:32.376191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:32.376191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:32.376191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:32.376191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:32.376191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:32.376191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:32.376191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:32.376191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:32.376191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:32.376191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:32.376191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:32.376191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:32.376191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:32.377058 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:32.377058 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:32.377058 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:32.379318 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 381/756] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:32.386695 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:32.387361 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9237cf-348f-4127-9be3-3d6ffa332417 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:32.400903 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230ac71-2bdf-4935-b34f-dd0d110703d7 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:32.443251 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61d1cd-9ed4-4e57-9555-bdc7fc8cb124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:32.444209 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61d1cd-9ed4-4e57-9555-bdc7fc8cb124 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:32.444662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61d1cd-9ed4-4e57-9555-bdc7fc8cb124 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:32.445090 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61d1cd-9ed4-4e57-9555-bdc7fc8cb124 None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:32.446012 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61d1cd-9ed4-4e57-9555-bdc7fc8cb124 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:32.446517 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61d1cd-9ed4-4e57-9555-bdc7fc8cb124 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:32.448242 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61d1cd-9ed4-4e57-9555-bdc7fc8cb124 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:32.474896 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 376/757] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Sep 21 12:07:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:32.482766 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61d1cd-9ed4-4e57-9555-bdc7fc8cb124 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:32.505179 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:32.576962 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9237cf-348f-4127-9be3-3d6ffa332417 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:32.617414 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac55496-c540-47d5-befc-3c63c2686d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:32.618350 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac55496-c540-47d5-befc-3c63c2686d69 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:32.618798 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac55496-c540-47d5-befc-3c63c2686d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:32.619212 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac55496-c540-47d5-befc-3c63c2686d69 None admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:32.620270 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac55496-c540-47d5-befc-3c63c2686d69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:32.620744 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac55496-c540-47d5-befc-3c63c2686d69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:32.622515 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac55496-c540-47d5-befc-3c63c2686d69 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:32.636797 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 382/758] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:07:32.643058 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac55496-c540-47d5-befc-3c63c2686d69 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:32.713233 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61d1cd-9ed4-4e57-9555-bdc7fc8cb124 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:32.796834 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c913ff-6d0e-4312-9ab7-0ad3b5659123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:32.797781 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c913ff-6d0e-4312-9ab7-0ad3b5659123 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:32.798382 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c913ff-6d0e-4312-9ab7-0ad3b5659123 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:32.798806 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c913ff-6d0e-4312-9ab7-0ad3b5659123 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:32.823488 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c913ff-6d0e-4312-9ab7-0ad3b5659123 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:32.825244 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c913ff-6d0e-4312-9ab7-0ad3b5659123 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:32.826099 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac55496-c540-47d5-befc-3c63c2686d69 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:32.844158 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:32.855407 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-37c913ff-6d0e-4312-9ab7-0ad3b5659123 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:32.855407 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:32.855407 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:32.855407 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:32.855407 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:32.855407 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:32.855407 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:32.855407 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:32.855407 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:32.855407 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:32.855407 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:32.855407 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:32.855407 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:32.855407 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:32.855407 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:32.855407 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:32.856620 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:32.856620 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:32.856620 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:32.856620 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:32.856620 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:32.856620 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:32.856620 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:32.856620 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:32.856620 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:32.856620 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:32.856620 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:32.856620 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:32.856620 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:32.856620 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:32.856620 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:32.856620 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:32.856620 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:32.857706 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:32.857706 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:32.857706 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:32.859762 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 377/759] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:32.865986 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:32.867790 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c913ff-6d0e-4312-9ab7-0ad3b5659123 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:32.919137 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8dd9a-e90e-4142-b8c2-ec6c7cae315f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:32.919788 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8dd9a-e90e-4142-b8c2-ec6c7cae315f None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:32.920066 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8dd9a-e90e-4142-b8c2-ec6c7cae315f None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:32.920335 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8dd9a-e90e-4142-b8c2-ec6c7cae315f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:32.935551 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8dd9a-e90e-4142-b8c2-ec6c7cae315f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:32.937016 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8dd9a-e90e-4142-b8c2-ec6c7cae315f None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:32.964616 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-03c8dd9a-e90e-4142-b8c2-ec6c7cae315f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:32.964616 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:32.964616 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:32.964616 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:32.964616 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:32.964616 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:32.964616 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:32.964616 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:32.964616 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:32.964616 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:32.964616 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:32.964616 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:32.964616 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 12:07:32.964616 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 12:07:32.964616 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 12:07:32.965568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 12:07:32.965568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:32.965568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:32.965568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:32.965568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:32.965568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:32.965568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:32.965568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:32.965568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:32.965568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:32.965568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:32.965568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:32.965568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:32.965568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:32.965568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:32.965568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:32.965568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:32.966679 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 12:07:32.966679 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 12:07:32.966679 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 12:07:32.966679 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 12:07:32.966679 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 12:07:32.966679 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 12:07:32.966679 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:32.966679 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:32.966679 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 383/760] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:07:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:32.972828 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8dd9a-e90e-4142-b8c2-ec6c7cae315f None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:32.995918 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c913ff-6d0e-4312-9ab7-0ad3b5659123 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:33.036114 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221ce5a-ecf9-496a-be00-9f93cc58adc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:33.037268 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221ce5a-ecf9-496a-be00-9f93cc58adc4 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:33.037699 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221ce5a-ecf9-496a-be00-9f93cc58adc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:33.038719 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221ce5a-ecf9-496a-be00-9f93cc58adc4 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:33.039941 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5221ce5a-ecf9-496a-be00-9f93cc58adc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:33.040402 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5221ce5a-ecf9-496a-be00-9f93cc58adc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:33.041920 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5221ce5a-ecf9-496a-be00-9f93cc58adc4 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:33.056548 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 378/761] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:33.065390 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221ce5a-ecf9-496a-be00-9f93cc58adc4 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:33.151799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:33.169108 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8dd9a-e90e-4142-b8c2-ec6c7cae315f None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:33.207097 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa725ed-e798-4d4a-a49a-fd231249709c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:33.207832 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221ce5a-ecf9-496a-be00-9f93cc58adc4 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:33.207987 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa725ed-e798-4d4a-a49a-fd231249709c None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:33.208328 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa725ed-e798-4d4a-a49a-fd231249709c None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:33.208696 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa725ed-e798-4d4a-a49a-fd231249709c None admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:33.209490 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa725ed-e798-4d4a-a49a-fd231249709c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:33.210489 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa725ed-e798-4d4a-a49a-fd231249709c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:33.212535 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa725ed-e798-4d4a-a49a-fd231249709c None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:33.226152 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 384/762] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Sep 21 12:07:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:07:33.232219 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa725ed-e798-4d4a-a49a-fd231249709c None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:33.251948 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fa559-5ebd-470e-a960-dbc3d895b551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:33.252892 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fa559-5ebd-470e-a960-dbc3d895b551 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:33.253336 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fa559-5ebd-470e-a960-dbc3d895b551 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:33.253741 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fa559-5ebd-470e-a960-dbc3d895b551 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:33.263374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098fa559-5ebd-470e-a960-dbc3d895b551 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:33.265193 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098fa559-5ebd-470e-a960-dbc3d895b551 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:33.279473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-098fa559-5ebd-470e-a960-dbc3d895b551 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:33.279473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:33.279473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:33.279473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:33.279473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:33.279473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:33.279473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:33.279473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:33.279473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:33.279473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:33.279473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:33.279473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:33.279473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 12:07:33.279473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 12:07:33.279473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 12:07:33.280451 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 12:07:33.280451 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:33.280451 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:33.280451 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:33.280451 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:33.280451 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:33.280451 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:33.280451 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:33.280451 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:33.280451 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:33.280451 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:33.280451 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:33.280451 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:33.280451 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:33.280451 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:33.280451 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:33.280451 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:33.281359 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 12:07:33.281359 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 12:07:33.281359 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 12:07:33.281359 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 12:07:33.281359 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 12:07:33.281359 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 12:07:33.281359 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:33.281359 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:33.283999 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 379/763] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:07:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:33.290824 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fa559-5ebd-470e-a960-dbc3d895b551 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:33.307773 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:33.413040 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fa559-5ebd-470e-a960-dbc3d895b551 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:33.437757 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:33.457336 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b7d85-7d1f-4e9b-bdcb-8591365c0da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:33.458403 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b7d85-7d1f-4e9b-bdcb-8591365c0da0 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:33.458941 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b7d85-7d1f-4e9b-bdcb-8591365c0da0 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:33.459422 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b7d85-7d1f-4e9b-bdcb-8591365c0da0 None admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:33.460918 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b7d85-7d1f-4e9b-bdcb-8591365c0da0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:33.461702 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b7d85-7d1f-4e9b-bdcb-8591365c0da0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:33.463460 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b7d85-7d1f-4e9b-bdcb-8591365c0da0 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:33.477878 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 380/764] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Sep 21 12:07:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:33.483934 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b7d85-7d1f-4e9b-bdcb-8591365c0da0 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:33.484365 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa725ed-e798-4d4a-a49a-fd231249709c None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:33.558916 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3265c8e-cb26-4f34-8b03-a2871c2bf476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:33.559543 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3265c8e-cb26-4f34-8b03-a2871c2bf476 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:33.559823 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3265c8e-cb26-4f34-8b03-a2871c2bf476 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:33.560091 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3265c8e-cb26-4f34-8b03-a2871c2bf476 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:33.560827 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3265c8e-cb26-4f34-8b03-a2871c2bf476 None admin] RBAC: Adding query filter params (role.id=327398b6ec324647b6c4ea84a59a026b, scope.project.id=b0abcc6f2ce14825bfc26e6210889c21, user.id=bbd7a1d5a8d04e3798ffcab27bad936b) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:33.561136 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3265c8e-cb26-4f34-8b03-a2871c2bf476 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:33.562947 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3265c8e-cb26-4f34-8b03-a2871c2bf476 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:33.572904 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 385/765] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:07:33 2022] GET /identity/v3/role_assignments?user.id=bbd7a1d5a8d04e3798ffcab27bad936b&scope.project.id=b0abcc6f2ce14825bfc26e6210889c21&role.id=327398b6ec324647b6c4ea84a59a026b => generated 259 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:33.572904 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc87397-fef5-4666-8097-4945243397df None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:33.572904 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc87397-fef5-4666-8097-4945243397df None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:33.573231 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc87397-fef5-4666-8097-4945243397df None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:33.574634 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 386/766] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:07:33.579839 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f1feb-6366-45f0-96e6-7fd41ba85491 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:33.580137 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f1feb-6366-45f0-96e6-7fd41ba85491 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:33.580391 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f1feb-6366-45f0-96e6-7fd41ba85491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:33.605653 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-7f1f1feb-6366-45f0-96e6-7fd41ba85491 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:33.607244 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-7f1f1feb-6366-45f0-96e6-7fd41ba85491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:33.615577 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b7d85-7d1f-4e9b-bdcb-8591365c0da0 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:33.681760 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aaf6ac-8103-4fd4-80ec-a69caa35a378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:33.682481 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aaf6ac-8103-4fd4-80ec-a69caa35a378 None admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:33.682765 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aaf6ac-8103-4fd4-80ec-a69caa35a378 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:33.683046 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aaf6ac-8103-4fd4-80ec-a69caa35a378 None admin] PATH_INFO: `/v3/projects/b0abcc6f2ce14825bfc26e6210889c21/users/6cb4001f94b8439180ca2a93d3b279b1/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:33.685045 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aaf6ac-8103-4fd4-80ec-a69caa35a378 None admin] RBAC: Authorizing `identity:create_grant(project_id=b0abcc6f2ce14825bfc26e6210889c21, user_id=6cb4001f94b8439180ca2a93d3b279b1, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:33.686551 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aaf6ac-8103-4fd4-80ec-a69caa35a378 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:33.710778 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 381/767] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Sep 21 12:07:33 2022] PUT /identity/v3/projects/b0abcc6f2ce14825bfc26e6210889c21/users/6cb4001f94b8439180ca2a93d3b279b1/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:07:33.724293 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 387/768] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:07:33.868176 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff48e6-0d10-41e8-93aa-25ab4095c0aa None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:33.868526 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff48e6-0d10-41e8-93aa-25ab4095c0aa None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:33.868737 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff48e6-0d10-41e8-93aa-25ab4095c0aa None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:33.870273 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 382/769] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:07:33.876194 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138d419-c459-4524-9a4f-59db5da0f12a None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:33.876526 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138d419-c459-4524-9a4f-59db5da0f12a None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:33.876758 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138d419-c459-4524-9a4f-59db5da0f12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:33.902990 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-0138d419-c459-4524-9a4f-59db5da0f12a None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:33.904235 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-0138d419-c459-4524-9a4f-59db5da0f12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:33.938328 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:33.998498 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 388/770] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:07:34.045420 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff48e6-0d10-41e8-93aa-25ab4095c0aa None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:34.106876 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:34.176703 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff48e6-0d10-41e8-93aa-25ab4095c0aa None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:34.214409 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffc693-4d9b-4074-8899-c93550fdeadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:34.215106 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffc693-4d9b-4074-8899-c93550fdeadd None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:34.215388 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffc693-4d9b-4074-8899-c93550fdeadd None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:34.215661 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffc693-4d9b-4074-8899-c93550fdeadd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:34.216301 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ffc693-4d9b-4074-8899-c93550fdeadd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:34.217675 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ffc693-4d9b-4074-8899-c93550fdeadd None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:34.228877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-f1ffc693-4d9b-4074-8899-c93550fdeadd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 21 12:07:34.228877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:34.228877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 12:07:34.228877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 12:07:34.228877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 12:07:34.228877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 12:07:34.228877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 12:07:34.228877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:07:34.228877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 21 12:07:34.228877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:34.228877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 12:07:34.228877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:34.228877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:34.228877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:34.228877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:34.228877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:34.228877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:34.230096 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:34.230096 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:34.230096 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:34.230096 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:34.230096 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:34.230096 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:34.230096 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 12:07:34.230096 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 12:07:34.230096 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 12:07:34.230096 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 12:07:34.230096 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:34.230096 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:34.230096 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:34.230096 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:34.230096 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:34.230096 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:34.230979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:34.230979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:34.230979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:34.230979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:34.230979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:34.230979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:34.230979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:34.230979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:34.230979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:34.230979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:34.230979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 12:07:34.230979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:07:34.230979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 21 12:07:34.230979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:34.230979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 383/771] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Sep 21 12:07:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:34.237944 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138d419-c459-4524-9a4f-59db5da0f12a None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:34.401541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138d419-c459-4524-9a4f-59db5da0f12a None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:34.424169 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffc693-4d9b-4074-8899-c93550fdeadd None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:34.447107 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c32947-ba17-4163-aa19-ae49c8c46385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:34.447649 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c32947-ba17-4163-aa19-ae49c8c46385 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:34.449930 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c32947-ba17-4163-aa19-ae49c8c46385 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:34.450216 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c32947-ba17-4163-aa19-ae49c8c46385 None admin] PATH_INFO: `/v3/services` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:34.450894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c32947-ba17-4163-aa19-ae49c8c46385 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:34.451203 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c32947-ba17-4163-aa19-ae49c8c46385 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:34.452592 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c32947-ba17-4163-aa19-ae49c8c46385 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:34.466723 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 389/772] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Sep 21 12:07:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:34.471367 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c32947-ba17-4163-aa19-ae49c8c46385 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:34.518608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:34.624183 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffc693-4d9b-4074-8899-c93550fdeadd None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:34.641595 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:34.687220 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c32947-ba17-4163-aa19-ae49c8c46385 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:34.699067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d195b-e64b-4e2e-9321-d0ee911d2f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:34.699700 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d195b-e64b-4e2e-9321-d0ee911d2f76 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:34.700039 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d195b-e64b-4e2e-9321-d0ee911d2f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:34.700322 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d195b-e64b-4e2e-9321-d0ee911d2f76 None admin] PATH_INFO: `/v3/services/network` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:34.700920 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d195b-e64b-4e2e-9321-d0ee911d2f76 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:34.702304 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d195b-e64b-4e2e-9321-d0ee911d2f76 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:34.720017 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-e57d195b-e64b-4e2e-9321-d0ee911d2f76 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 21 12:07:34.720017 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:34.720017 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 12:07:34.720017 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 12:07:34.720017 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 12:07:34.720017 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 12:07:34.720017 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 12:07:34.720017 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:07:34.720017 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 21 12:07:34.720017 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:34.720017 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 12:07:34.720017 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:34.720017 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:34.720017 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:34.720017 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:34.720017 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:34.720017 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:34.721049 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:34.721049 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:34.721049 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:34.721049 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:34.721049 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:34.721049 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:34.721049 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 12:07:34.721049 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 12:07:34.721049 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 12:07:34.721049 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 12:07:34.721049 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:34.721049 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:34.721049 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:34.721049 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:34.721049 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:34.721049 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:34.721885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:34.721885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:34.721885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:34.721885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:34.721885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:34.721885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:34.721885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:34.721885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:34.721885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:34.721885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:34.721885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 12:07:34.721885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:07:34.721885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 21 12:07:34.721885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:34.721885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 384/773] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:07:34 2022] GET /identity/v3/services/network => generated 88 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 12:07:34.735060 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d195b-e64b-4e2e-9321-d0ee911d2f76 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:34.779126 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f8134-9f96-420e-b3a4-64e519767b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:34.780109 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f8134-9f96-420e-b3a4-64e519767b76 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:34.780612 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f8134-9f96-420e-b3a4-64e519767b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:34.781082 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f8134-9f96-420e-b3a4-64e519767b76 None admin] PATH_INFO: `/v3/services` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:34.781945 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f8134-9f96-420e-b3a4-64e519767b76 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:34.782489 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f8134-9f96-420e-b3a4-64e519767b76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:34.784066 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f8134-9f96-420e-b3a4-64e519767b76 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:34.796924 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 390/774] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Sep 21 12:07:34 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:34.803049 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f8134-9f96-420e-b3a4-64e519767b76 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:34.853042 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d195b-e64b-4e2e-9321-d0ee911d2f76 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:34.894846 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa864768-0aea-492b-9098-e09f825ce5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:34.895351 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa864768-0aea-492b-9098-e09f825ce5a1 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:34.895630 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa864768-0aea-492b-9098-e09f825ce5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:34.895900 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa864768-0aea-492b-9098-e09f825ce5a1 None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:34.896528 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa864768-0aea-492b-9098-e09f825ce5a1 None admin] RBAC: Adding query filter params (name=network) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:34.896829 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa864768-0aea-492b-9098-e09f825ce5a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:34.898235 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa864768-0aea-492b-9098-e09f825ce5a1 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:34.903680 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 385/775] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Sep 21 12:07:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:07:34.916394 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa864768-0aea-492b-9098-e09f825ce5a1 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:34.982836 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:34.993316 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:35.015090 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f8134-9f96-420e-b3a4-64e519767b76 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:35.062664 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32cbc41-6387-4e58-8454-239e330e241e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:35.063734 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cbc41-6387-4e58-8454-239e330e241e None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:35.064288 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cbc41-6387-4e58-8454-239e330e241e None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:35.064566 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cbc41-6387-4e58-8454-239e330e241e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:35.065293 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32cbc41-6387-4e58-8454-239e330e241e None admin] RBAC: Adding query filter params (interface=public, service_id=9c63a19a7d1f40eeb20f11111d17afba, region_id=RegionOne) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:35.065601 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32cbc41-6387-4e58-8454-239e330e241e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:35.066284 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa864768-0aea-492b-9098-e09f825ce5a1 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:35.067060 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32cbc41-6387-4e58-8454-239e330e241e None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:35.077631 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 391/776] 10.222.0.60 () {56 vars in 1251 bytes} [Wed Sep 21 12:07:34 2022] GET /identity/v3/endpoints?service_id=9c63a19a7d1f40eeb20f11111d17afba&interface=public®ion_id=RegionOne => generated 194 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:07:35.083130 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915aa460-1d8f-4431-828e-4fd98188193a None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:35.083910 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915aa460-1d8f-4431-828e-4fd98188193a None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:35.084193 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915aa460-1d8f-4431-828e-4fd98188193a None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:35.086225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 392/777] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:07:35.094045 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915aa460-1d8f-4431-828e-4fd98188193a None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:35.126031 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d982384e-5c42-4ae0-baa7-a0fd2ad1fb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:35.127426 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982384e-5c42-4ae0-baa7-a0fd2ad1fb74 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:35.127946 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982384e-5c42-4ae0-baa7-a0fd2ad1fb74 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:35.128451 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d982384e-5c42-4ae0-baa7-a0fd2ad1fb74 None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:35.130341 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d982384e-5c42-4ae0-baa7-a0fd2ad1fb74 None admin] RBAC: Adding query filter params (type=network) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:35.130956 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d982384e-5c42-4ae0-baa7-a0fd2ad1fb74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:35.132933 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d982384e-5c42-4ae0-baa7-a0fd2ad1fb74 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:35.143767 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 386/778] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Sep 21 12:07:34 2022] GET /identity/v3/services?type=network => generated 350 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:35.143933 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c630a0-441c-4355-ad2f-74439d0b5f55 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:35.144109 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c630a0-441c-4355-ad2f-74439d0b5f55 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:35.144480 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c630a0-441c-4355-ad2f-74439d0b5f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:35.165009 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-e5c630a0-441c-4355-ad2f-74439d0b5f55 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:35.166136 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-e5c630a0-441c-4355-ad2f-74439d0b5f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:35.222539 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915aa460-1d8f-4431-828e-4fd98188193a None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:35.254831 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 387/779] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:07:35.254831 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c630a0-441c-4355-ad2f-74439d0b5f55 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:35.282434 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:35.284037 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa2e03-78aa-41bb-bc65-01a64a99acfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:35.285219 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa2e03-78aa-41bb-bc65-01a64a99acfa None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:35.285831 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa2e03-78aa-41bb-bc65-01a64a99acfa None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:35.287169 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa2e03-78aa-41bb-bc65-01a64a99acfa None admin] PATH_INFO: `/v3/services` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:35.288615 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa2e03-78aa-41bb-bc65-01a64a99acfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:35.298384 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa2e03-78aa-41bb-bc65-01a64a99acfa None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:35.305178 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 393/780] 10.222.0.60 () {56 vars in 1087 bytes} [Wed Sep 21 12:07:35 2022] GET /identity/v3/services => generated 772 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:35.366122 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c630a0-441c-4355-ad2f-74439d0b5f55 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:35.403477 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d61af6-4aea-41e3-a625-94c2de94c6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:35.404225 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d61af6-4aea-41e3-a625-94c2de94c6ce None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:35.404506 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d61af6-4aea-41e3-a625-94c2de94c6ce None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:35.404780 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d61af6-4aea-41e3-a625-94c2de94c6ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:35.405502 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d61af6-4aea-41e3-a625-94c2de94c6ce None admin] RBAC: Adding query filter params (interface=public, service_id=d2811365956a4d5892a12855ee9291d4, region_id=RegionOne) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:35.405809 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d61af6-4aea-41e3-a625-94c2de94c6ce None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:35.407295 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d61af6-4aea-41e3-a625-94c2de94c6ce None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:35.416817 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 388/781] 10.222.0.60 () {56 vars in 1251 bytes} [Wed Sep 21 12:07:35 2022] GET /identity/v3/endpoints?service_id=d2811365956a4d5892a12855ee9291d4&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:35.423513 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa2e03-78aa-41bb-bc65-01a64a99acfa None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:35.458807 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:35.582544 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa2e03-78aa-41bb-bc65-01a64a99acfa None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:35.619104 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a96fb3-e10f-4188-84dc-2376fcca3f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:35.619770 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a96fb3-e10f-4188-84dc-2376fcca3f32 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:35.620054 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a96fb3-e10f-4188-84dc-2376fcca3f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:35.620326 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a96fb3-e10f-4188-84dc-2376fcca3f32 None admin] PATH_INFO: `/v3/services` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:35.620927 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a96fb3-e10f-4188-84dc-2376fcca3f32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:35.622287 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a96fb3-e10f-4188-84dc-2376fcca3f32 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:35.628550 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 394/782] 10.222.0.60 () {56 vars in 1087 bytes} [Wed Sep 21 12:07:35 2022] GET /identity/v3/services => generated 772 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:35.705231 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d61af6-4aea-41e3-a625-94c2de94c6ce None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:35.830861 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:35.841282 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d61af6-4aea-41e3-a625-94c2de94c6ce None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:35.877836 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20953c1-97bb-4a0d-b910-ca89a7b1a33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:35.878568 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20953c1-97bb-4a0d-b910-ca89a7b1a33a None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:35.878849 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20953c1-97bb-4a0d-b910-ca89a7b1a33a None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:35.879119 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20953c1-97bb-4a0d-b910-ca89a7b1a33a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:35.890444 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20953c1-97bb-4a0d-b910-ca89a7b1a33a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:07:35.895269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-f20953c1-97bb-4a0d-b910-ca89a7b1a33a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:07:35.895269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:35.895269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:35.895269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:35.895269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:35.895269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:35.895269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:35.895269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:35.895269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:35.895269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:35.895269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:35.895269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:35.895269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:07:35.895269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:07:35.895269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:07:35.895269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:07:35.896205 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:07:35.896205 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:07:35.896205 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:07:35.896205 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:07:35.896205 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:35.896205 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:35.896205 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:35.896205 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:35.896205 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:35.896205 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:35.896205 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:35.896205 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:35.896205 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:35.896205 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:35.896205 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:35.896205 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:35.897583 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:35.897583 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:35.897583 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:35.897583 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:35.897583 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:07:35.897583 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:07:35.897583 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:07:35.897583 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:07:35.897583 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:07:35.897583 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:07:35.897583 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:07:35.897583 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:35.897583 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 389/783] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Sep 21 12:07:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:35.902958 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a96fb3-e10f-4188-84dc-2376fcca3f32 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:35.993532 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:36.019524 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a96fb3-e10f-4188-84dc-2376fcca3f32 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:36.070835 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6dc83-0bdd-4dde-b070-709236580bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:36.071750 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6dc83-0bdd-4dde-b070-709236580bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:36.072039 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6dc83-0bdd-4dde-b070-709236580bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:36.072332 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6dc83-0bdd-4dde-b070-709236580bc8 None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:36.073009 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6dc83-0bdd-4dde-b070-709236580bc8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:36.073380 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6dc83-0bdd-4dde-b070-709236580bc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:36.074882 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6dc83-0bdd-4dde-b070-709236580bc8 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:36.088502 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 395/784] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:07:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:36.094350 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20953c1-97bb-4a0d-b910-ca89a7b1a33a None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:36.205221 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20953c1-97bb-4a0d-b910-ca89a7b1a33a None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:36.242899 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc975837-1976-4384-89ef-bd7c51de657c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:36.243541 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc975837-1976-4384-89ef-bd7c51de657c None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:36.243820 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc975837-1976-4384-89ef-bd7c51de657c None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:36.244151 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc975837-1976-4384-89ef-bd7c51de657c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:36.254995 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc975837-1976-4384-89ef-bd7c51de657c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:36.256553 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc975837-1976-4384-89ef-bd7c51de657c None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:36.260293 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a49eb-9a90-43b0-b65f-0724a2ca8a78 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:36.260582 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a49eb-9a90-43b0-b65f-0724a2ca8a78 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:36.260860 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a49eb-9a90-43b0-b65f-0724a2ca8a78 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:36.262751 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 396/785] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:07:36.267594 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ecdb3f-6cc8-4988-99b1-23b95ce62bc4 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:36.267875 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ecdb3f-6cc8-4988-99b1-23b95ce62bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:36.268150 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ecdb3f-6cc8-4988-99b1-23b95ce62bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:36.297300 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-bc975837-1976-4384-89ef-bd7c51de657c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:36.297300 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:36.297300 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:36.297300 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:36.297300 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:36.297300 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:36.297300 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:36.297300 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:36.297300 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:36.297300 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:36.297300 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:36.297300 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:36.297300 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:36.297300 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:36.297300 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:36.297300 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:36.298292 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:36.298292 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:36.298292 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:36.298292 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:36.298292 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:36.298292 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:36.298292 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:36.298292 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:36.298292 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:36.298292 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:36.298292 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:36.298292 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:36.298292 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:36.298292 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:36.298292 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:36.298292 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:36.298292 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:36.299220 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:36.299220 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:36.299220 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:36.299811 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-a3ecdb3f-6cc8-4988-99b1-23b95ce62bc4 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:36.303902 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-a3ecdb3f-6cc8-4988-99b1-23b95ce62bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:36.304048 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 390/786] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:36.304670 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc975837-1976-4384-89ef-bd7c51de657c None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:36.318700 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:36.437524 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 397/787] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:07:36.470749 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc975837-1976-4384-89ef-bd7c51de657c None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:36.514153 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7253bddf-c971-45d9-87d5-ebf098b585b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:36.515172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253bddf-c971-45d9-87d5-ebf098b585b0 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:36.515678 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253bddf-c971-45d9-87d5-ebf098b585b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:36.516155 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253bddf-c971-45d9-87d5-ebf098b585b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:36.517015 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7253bddf-c971-45d9-87d5-ebf098b585b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:36.517531 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7253bddf-c971-45d9-87d5-ebf098b585b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:36.519145 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7253bddf-c971-45d9-87d5-ebf098b585b0 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:36.521734 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345c0a4-a807-41a2-a40c-178f00314ff9 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:36.522567 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345c0a4-a807-41a2-a40c-178f00314ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:36.523355 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345c0a4-a807-41a2-a40c-178f00314ff9 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:36.524486 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 398/788] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:07:36.529647 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88460c6-7a01-452f-a9e0-19292e4b3457 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:36.529929 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88460c6-7a01-452f-a9e0-19292e4b3457 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:36.530209 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88460c6-7a01-452f-a9e0-19292e4b3457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:36.542784 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 391/789] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:36.551086 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7253bddf-c971-45d9-87d5-ebf098b585b0 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:36.560820 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-c88460c6-7a01-452f-a9e0-19292e4b3457 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:36.562034 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-c88460c6-7a01-452f-a9e0-19292e4b3457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:36.680603 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:36.682002 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:36.689522 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 399/790] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 12:07:36.761862 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7253bddf-c971-45d9-87d5-ebf098b585b0 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:36.812255 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdde224-1f5d-44e0-b039-2d601f7c7368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:36.812907 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdde224-1f5d-44e0-b039-2d601f7c7368 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:36.813191 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdde224-1f5d-44e0-b039-2d601f7c7368 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:36.813469 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdde224-1f5d-44e0-b039-2d601f7c7368 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:36.829363 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdde224-1f5d-44e0-b039-2d601f7c7368 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:36.830878 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdde224-1f5d-44e0-b039-2d601f7c7368 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:36.847487 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-3bdde224-1f5d-44e0-b039-2d601f7c7368 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 21 12:07:36.847487 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:36.847487 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:36.847487 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:36.847487 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:36.847487 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:36.847487 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:36.847487 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:36.847487 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:36.847487 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:36.847487 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:36.847487 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:36.847487 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 12:07:36.847487 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 12:07:36.847487 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 12:07:36.847487 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 12:07:36.848465 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:36.848465 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:36.848465 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 12:07:36.848465 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:36.848465 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 12:07:36.848465 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:36.848465 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:36.848465 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:36.848465 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:36.848465 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:36.848465 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:36.848465 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:36.848465 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:36.848465 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:36.848465 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:36.848465 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:36.848465 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:36.848465 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:36.849480 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:36.849480 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:36.849480 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 12:07:36.849480 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 12:07:36.849480 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 12:07:36.849480 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 12:07:36.849480 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 12:07:36.849480 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 12:07:36.849480 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 21 12:07:36.849480 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:36.849480 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 392/791] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Sep 21 12:07:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:36.854768 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88460c6-7a01-452f-a9e0-19292e4b3457 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:36.888154 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdde224-1f5d-44e0-b039-2d601f7c7368 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:37.016762 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdde224-1f5d-44e0-b039-2d601f7c7368 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:37.031355 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88460c6-7a01-452f-a9e0-19292e4b3457 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:37.042395 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:37.057251 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ebd9bf-7bc9-4a1a-9910-bddc0c9acc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:37.057885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ebd9bf-7bc9-4a1a-9910-bddc0c9acc3c None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:37.058167 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ebd9bf-7bc9-4a1a-9910-bddc0c9acc3c None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:37.058469 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ebd9bf-7bc9-4a1a-9910-bddc0c9acc3c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:37.069871 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ebd9bf-7bc9-4a1a-9910-bddc0c9acc3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:07:37.076334 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-b3ebd9bf-7bc9-4a1a-9910-bddc0c9acc3c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:07:37.076334 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:37.076334 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:37.076334 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:37.076334 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:37.076334 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:37.076334 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:37.076334 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:37.076334 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:37.076334 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:37.076334 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:37.076334 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:37.076334 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:07:37.076334 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:07:37.076334 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:07:37.076334 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:07:37.077304 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:07:37.077304 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:07:37.077304 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:07:37.077304 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:07:37.077304 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:37.077304 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:37.077304 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:37.077304 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:37.077304 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:37.077304 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:37.077304 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:37.077304 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:37.077304 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:37.077304 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:37.077304 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:37.077304 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:37.078179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:37.078179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:37.078179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:37.078179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:37.078179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:07:37.078179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:07:37.078179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:07:37.078179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:07:37.078179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:07:37.078179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:07:37.078179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:07:37.078179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:37.078179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 393/792] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Sep 21 12:07:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 12:07:37.078936 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ebd9bf-7bc9-4a1a-9910-bddc0c9acc3c None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:37.079503 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de4835-9bc2-44eb-afca-599fb1012cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:37.080360 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de4835-9bc2-44eb-afca-599fb1012cc9 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:37.080838 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de4835-9bc2-44eb-afca-599fb1012cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:37.081683 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de4835-9bc2-44eb-afca-599fb1012cc9 None admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:37.083709 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de4835-9bc2-44eb-afca-599fb1012cc9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:37.084229 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de4835-9bc2-44eb-afca-599fb1012cc9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:37.085939 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de4835-9bc2-44eb-afca-599fb1012cc9 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:37.111110 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 400/793] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Sep 21 12:07:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:37.112873 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de4835-9bc2-44eb-afca-599fb1012cc9 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:37.194767 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ebd9bf-7bc9-4a1a-9910-bddc0c9acc3c None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:37.199929 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:37.238745 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb405923-a5c6-45d3-abdb-2a651a0753aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:37.239495 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb405923-a5c6-45d3-abdb-2a651a0753aa None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:37.239860 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb405923-a5c6-45d3-abdb-2a651a0753aa None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:37.240207 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb405923-a5c6-45d3-abdb-2a651a0753aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:37.252391 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb405923-a5c6-45d3-abdb-2a651a0753aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:07:37.257926 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de4835-9bc2-44eb-afca-599fb1012cc9 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:37.258076 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-bb405923-a5c6-45d3-abdb-2a651a0753aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 12:07:37.258076 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:37.258076 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:37.258076 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:37.258076 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:37.258076 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:37.258076 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:37.258076 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:37.258076 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:37.258076 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:37.258076 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:37.258076 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:37.258076 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:07:37.258076 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:07:37.258076 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:07:37.258076 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:07:37.259240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:07:37.259240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:07:37.259240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:07:37.259240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:07:37.259240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:37.259240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:37.259240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:37.259240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:37.259240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:37.259240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:37.259240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:37.259240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:37.259240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:37.259240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:37.259240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:37.259240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:37.260107 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:37.260107 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:37.260107 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:37.260107 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:37.260107 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:07:37.260107 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:07:37.260107 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:07:37.260107 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:07:37.260107 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:07:37.260107 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:07:37.260107 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 12:07:37.260107 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:37.264739 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 394/794] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Sep 21 12:07:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:37.265692 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb405923-a5c6-45d3-abdb-2a651a0753aa None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:37.308201 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5fb8a-c8f5-4f7d-bad4-a8e835450ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:37.309896 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5fb8a-c8f5-4f7d-bad4-a8e835450ceb None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:37.310380 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5fb8a-c8f5-4f7d-bad4-a8e835450ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:37.310830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5fb8a-c8f5-4f7d-bad4-a8e835450ceb None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:37.312137 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f5fb8a-c8f5-4f7d-bad4-a8e835450ceb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:37.313113 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:37.314109 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f5fb8a-c8f5-4f7d-bad4-a8e835450ceb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:37.316011 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f5fb8a-c8f5-4f7d-bad4-a8e835450ceb None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:37.329763 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 401/795] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:07:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:37.331209 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5fb8a-c8f5-4f7d-bad4-a8e835450ceb None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:37.379911 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb405923-a5c6-45d3-abdb-2a651a0753aa None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:37.418576 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c22e2-3854-4769-8069-6469749ab1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:37.419459 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c22e2-3854-4769-8069-6469749ab1f3 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:37.419886 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c22e2-3854-4769-8069-6469749ab1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:37.420303 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c22e2-3854-4769-8069-6469749ab1f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:37.435018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c22e2-3854-4769-8069-6469749ab1f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:37.436894 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c22e2-3854-4769-8069-6469749ab1f3 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:37.455284 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-519c22e2-3854-4769-8069-6469749ab1f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:37.455284 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:37.455284 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:37.455284 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:37.455284 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:37.455284 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:37.455284 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:37.455284 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:37.455284 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:37.455284 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:37.455284 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:37.455284 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:37.455284 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:37.455284 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:37.455284 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:37.455284 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:37.456272 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:37.456272 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:37.456272 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:37.456272 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:37.456272 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:37.456272 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:37.456272 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:37.456272 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:37.456272 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:37.456272 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:37.456272 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:37.456272 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:37.456272 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:37.456272 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:37.456272 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:37.456272 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:37.456272 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:37.457154 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:37.457154 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:37.457154 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:37.457154 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 395/796] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:37.457960 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c22e2-3854-4769-8069-6469749ab1f3 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:37.458825 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5fb8a-c8f5-4f7d-bad4-a8e835450ceb None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:37.481948 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:37.504151 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f313624-e17a-4141-82f7-1e894c51fb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:37.505021 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f313624-e17a-4141-82f7-1e894c51fb50 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:37.505298 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f313624-e17a-4141-82f7-1e894c51fb50 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:37.505622 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f313624-e17a-4141-82f7-1e894c51fb50 None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:37.507292 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f313624-e17a-4141-82f7-1e894c51fb50 None admin] RBAC: Adding query filter params (name=service) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:37.507537 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f313624-e17a-4141-82f7-1e894c51fb50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:37.512008 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f313624-e17a-4141-82f7-1e894c51fb50 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:37.530395 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 402/797] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Sep 21 12:07:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:37.530395 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f313624-e17a-4141-82f7-1e894c51fb50 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:37.608453 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:37.617744 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c22e2-3854-4769-8069-6469749ab1f3 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:37.662088 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6bdf9-834b-4fd3-9e23-cb52992fffea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:37.662823 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6bdf9-834b-4fd3-9e23-cb52992fffea None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:37.663143 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6bdf9-834b-4fd3-9e23-cb52992fffea None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:37.663630 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6bdf9-834b-4fd3-9e23-cb52992fffea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:37.675588 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f313624-e17a-4141-82f7-1e894c51fb50 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:37.680916 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd6bdf9-834b-4fd3-9e23-cb52992fffea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:37.682434 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd6bdf9-834b-4fd3-9e23-cb52992fffea None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:37.699780 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-8fd6bdf9-834b-4fd3-9e23-cb52992fffea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:37.699780 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:37.699780 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:37.699780 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:37.699780 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:37.699780 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:37.699780 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:37.699780 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:37.699780 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:37.699780 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:37.699780 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:37.699780 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:37.699780 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:37.699780 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:37.699780 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:37.699780 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:37.700813 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:37.700813 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:37.700813 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:37.700813 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:37.700813 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:37.700813 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:37.700813 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:37.700813 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:37.700813 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:37.700813 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:37.700813 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:37.700813 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:37.700813 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:37.700813 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:37.700813 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:37.700813 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:37.700813 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:37.701694 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:37.701694 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:37.701694 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:37.701694 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 396/798] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:37.702390 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6bdf9-834b-4fd3-9e23-cb52992fffea None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:37.725781 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e3a72-3f9d-414c-acfc-cfd5f518e11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:37.726841 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e3a72-3f9d-414c-acfc-cfd5f518e11a None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:37.727368 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e3a72-3f9d-414c-acfc-cfd5f518e11a None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:37.728494 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e3a72-3f9d-414c-acfc-cfd5f518e11a None admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:37.729391 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e3a72-3f9d-414c-acfc-cfd5f518e11a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:37.730155 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e3a72-3f9d-414c-acfc-cfd5f518e11a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:37.732564 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e3a72-3f9d-414c-acfc-cfd5f518e11a None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:37.749190 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 403/799] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:37.750394 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e3a72-3f9d-414c-acfc-cfd5f518e11a None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:37.828300 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:37.878989 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6bdf9-834b-4fd3-9e23-cb52992fffea None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:37.922862 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e3a72-3f9d-414c-acfc-cfd5f518e11a None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:37.932361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25465b94-f85f-4c04-a80a-037976a0623a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:37.933333 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25465b94-f85f-4c04-a80a-037976a0623a None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:37.933474 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25465b94-f85f-4c04-a80a-037976a0623a None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:37.933708 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25465b94-f85f-4c04-a80a-037976a0623a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:37.948172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25465b94-f85f-4c04-a80a-037976a0623a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:37.949632 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25465b94-f85f-4c04-a80a-037976a0623a None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:37.957235 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:37.968064 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-25465b94-f85f-4c04-a80a-037976a0623a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:37.968064 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:37.968064 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:37.968064 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:37.968064 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:37.968064 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:37.968064 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:37.968064 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:37.968064 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:37.968064 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:37.968064 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:37.968064 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:37.968064 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:37.968064 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:37.968064 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:37.968064 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:37.969094 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:37.969094 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:37.969094 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:37.969094 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:37.969094 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:37.969094 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:37.969094 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:37.969094 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:37.969094 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:37.969094 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:37.969094 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:37.969094 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:37.969094 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:37.969094 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:37.969094 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:37.969094 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:37.969094 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:37.969986 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:37.969986 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:37.969986 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:37.973756 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec296095-a862-4bec-841b-61a93071576c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:37.974305 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 397/800] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:37.974975 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec296095-a862-4bec-841b-61a93071576c None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:37.975358 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25465b94-f85f-4c04-a80a-037976a0623a None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:37.975712 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec296095-a862-4bec-841b-61a93071576c None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:37.976184 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec296095-a862-4bec-841b-61a93071576c None admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:37.977046 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec296095-a862-4bec-841b-61a93071576c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:37.977575 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec296095-a862-4bec-841b-61a93071576c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:37.980422 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec296095-a862-4bec-841b-61a93071576c None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:37.996061 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 404/801] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:37.997540 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec296095-a862-4bec-841b-61a93071576c None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:38.091472 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25465b94-f85f-4c04-a80a-037976a0623a None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:38.121273 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec296095-a862-4bec-841b-61a93071576c None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:38.122875 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:38.133120 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb041e4c-0893-4eee-8da5-57d20f8e275c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:38.133755 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb041e4c-0893-4eee-8da5-57d20f8e275c None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:38.134041 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb041e4c-0893-4eee-8da5-57d20f8e275c None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:38.134310 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb041e4c-0893-4eee-8da5-57d20f8e275c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:38.143235 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb041e4c-0893-4eee-8da5-57d20f8e275c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:38.144757 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb041e4c-0893-4eee-8da5-57d20f8e275c None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:38.157489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-eb041e4c-0893-4eee-8da5-57d20f8e275c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:38.157489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:38.157489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:38.157489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:38.157489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:38.157489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:38.157489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:38.157489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:38.157489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:38.157489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:38.157489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:38.157489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:38.157489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 12:07:38.157489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 12:07:38.157489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 12:07:38.158521 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 12:07:38.158521 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:38.158521 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:38.158521 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:38.158521 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:38.158521 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:38.158521 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:38.158521 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:38.158521 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:38.158521 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:38.158521 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:38.158521 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:38.158521 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:38.158521 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:38.158521 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:38.158521 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:38.158521 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:38.159559 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 12:07:38.159559 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 12:07:38.159559 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 12:07:38.159559 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 12:07:38.159559 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 12:07:38.159559 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 12:07:38.159559 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:38.159559 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:38.163614 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 398/802] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:07:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:38.165074 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d5abe-4220-40e3-bddd-f662348bf518 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:38.165354 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d5abe-4220-40e3-bddd-f662348bf518 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:38.165629 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d5abe-4220-40e3-bddd-f662348bf518 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:38.166809 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61bd4ff-fdba-4ecc-8076-14d2cc7a98f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:38.171147 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 399/803] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:07:38.171147 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d5abe-4220-40e3-bddd-f662348bf518 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:38.172310 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61bd4ff-fdba-4ecc-8076-14d2cc7a98f3 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:38.172600 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61bd4ff-fdba-4ecc-8076-14d2cc7a98f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:38.172876 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61bd4ff-fdba-4ecc-8076-14d2cc7a98f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:38.173536 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61bd4ff-fdba-4ecc-8076-14d2cc7a98f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:38.173838 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61bd4ff-fdba-4ecc-8076-14d2cc7a98f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:38.175285 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61bd4ff-fdba-4ecc-8076-14d2cc7a98f3 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:38.192998 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 405/804] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:38.194719 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61bd4ff-fdba-4ecc-8076-14d2cc7a98f3 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:38.233881 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:38.282597 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d5abe-4220-40e3-bddd-f662348bf518 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:38.299630 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61bd4ff-fdba-4ecc-8076-14d2cc7a98f3 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:38.320314 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680752e4-f0a6-4e3b-94ed-92d0d1fc610a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:38.320942 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680752e4-f0a6-4e3b-94ed-92d0d1fc610a None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:38.321221 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680752e4-f0a6-4e3b-94ed-92d0d1fc610a None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:38.321489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680752e4-f0a6-4e3b-94ed-92d0d1fc610a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:38.328563 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680752e4-f0a6-4e3b-94ed-92d0d1fc610a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:38.329972 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680752e4-f0a6-4e3b-94ed-92d0d1fc610a None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:38.333457 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e6a93-0dc8-43af-8e8b-40eeb25e60fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:38.334058 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e6a93-0dc8-43af-8e8b-40eeb25e60fc None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:38.334337 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e6a93-0dc8-43af-8e8b-40eeb25e60fc None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:38.335160 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e6a93-0dc8-43af-8e8b-40eeb25e60fc None admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:38.335839 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e6a93-0dc8-43af-8e8b-40eeb25e60fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:38.336142 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e6a93-0dc8-43af-8e8b-40eeb25e60fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:38.337536 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e6a93-0dc8-43af-8e8b-40eeb25e60fc None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:38.341997 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-680752e4-f0a6-4e3b-94ed-92d0d1fc610a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 21 12:07:38.341997 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:38.341997 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:38.341997 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:38.341997 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:38.341997 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:38.341997 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:38.341997 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:38.341997 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:38.341997 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:38.341997 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:38.341997 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:38.341997 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 12:07:38.341997 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 12:07:38.341997 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 12:07:38.341997 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 12:07:38.343123 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:38.343123 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:38.343123 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 12:07:38.343123 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:38.343123 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 12:07:38.343123 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:38.343123 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:38.343123 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:38.343123 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:38.343123 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:38.343123 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:38.343123 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:38.343123 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:38.343123 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:38.343123 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:38.343123 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:38.343123 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:38.343123 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:38.344956 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:38.344956 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:38.344956 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 12:07:38.344956 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 12:07:38.344956 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 12:07:38.344956 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 12:07:38.344956 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 12:07:38.344956 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 12:07:38.344956 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 21 12:07:38.344956 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:38.344956 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 400/805] 10.222.0.60 () {56 vars in 1093 bytes} [Wed Sep 21 12:07:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:38.344956 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd039a0-d477-4da0-a51b-c7f744ba60c6 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:38.344956 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd039a0-d477-4da0-a51b-c7f744ba60c6 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:38.347153 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd039a0-d477-4da0-a51b-c7f744ba60c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:38.355434 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 406/806] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Sep 21 12:07:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:38.355434 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e6a93-0dc8-43af-8e8b-40eeb25e60fc None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:38.362984 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-4dd039a0-d477-4da0-a51b-c7f744ba60c6 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:38.364192 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-4dd039a0-d477-4da0-a51b-c7f744ba60c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:38.376586 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:38.431913 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 401/807] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:07:38.433198 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d9453-7e90-449d-abd3-5cb7c7d20e1c None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:38.433477 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d9453-7e90-449d-abd3-5cb7c7d20e1c None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:38.433751 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d9453-7e90-449d-abd3-5cb7c7d20e1c None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:38.435002 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 402/808] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:07:38.435689 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d9453-7e90-449d-abd3-5cb7c7d20e1c None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:38.464875 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e6a93-0dc8-43af-8e8b-40eeb25e60fc None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:38.493073 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:38.502994 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbbf9b-a76c-4221-89b9-bcae2d0df4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:38.503978 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbbf9b-a76c-4221-89b9-bcae2d0df4b1 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:38.504441 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbbf9b-a76c-4221-89b9-bcae2d0df4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:38.504863 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbbf9b-a76c-4221-89b9-bcae2d0df4b1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:38.514188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bbbf9b-a76c-4221-89b9-bcae2d0df4b1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:38.516056 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bbbf9b-a76c-4221-89b9-bcae2d0df4b1 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:38.529198 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-72bbbf9b-a76c-4221-89b9-bcae2d0df4b1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 12:07:38.529198 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:38.529198 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:38.529198 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:38.529198 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:38.529198 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:38.529198 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:38.529198 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:38.529198 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:38.529198 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:38.529198 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:38.529198 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:38.529198 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 12:07:38.529198 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 12:07:38.529198 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 12:07:38.529198 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 12:07:38.530347 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:38.530347 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:38.530347 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 12:07:38.530347 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:38.530347 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 12:07:38.530347 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:38.530347 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:38.530347 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:38.530347 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:38.530347 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:38.530347 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:38.530347 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:38.530347 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:38.530347 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:38.530347 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:38.530347 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:38.530347 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:38.530347 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:38.531465 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:38.531465 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:38.531465 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 12:07:38.531465 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 12:07:38.531465 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 12:07:38.531465 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 12:07:38.531465 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 12:07:38.531465 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 12:07:38.531465 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 12:07:38.531465 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:38.531997 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 407/809] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Sep 21 12:07:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:38.532688 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbbf9b-a76c-4221-89b9-bcae2d0df4b1 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:38.553267 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d9453-7e90-449d-abd3-5cb7c7d20e1c None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:38.596769 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa83f9-7af1-429d-be38-f0f7cf7bdfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:38.597308 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa83f9-7af1-429d-be38-f0f7cf7bdfd7 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:38.597591 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa83f9-7af1-429d-be38-f0f7cf7bdfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:38.597866 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa83f9-7af1-429d-be38-f0f7cf7bdfd7 None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:38.598617 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa83f9-7af1-429d-be38-f0f7cf7bdfd7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:38.598920 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa83f9-7af1-429d-be38-f0f7cf7bdfd7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:38.600385 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aa83f9-7af1-429d-be38-f0f7cf7bdfd7 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:38.623624 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 403/810] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Sep 21 12:07:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:38.623624 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec1095-b2ef-4ca8-8ce4-6af8f52e5d09 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:38.623624 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec1095-b2ef-4ca8-8ce4-6af8f52e5d09 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:38.623624 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec1095-b2ef-4ca8-8ce4-6af8f52e5d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:38.628012 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:38.643276 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-edec1095-b2ef-4ca8-8ce4-6af8f52e5d09 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:38.644567 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-edec1095-b2ef-4ca8-8ce4-6af8f52e5d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:38.650775 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbbf9b-a76c-4221-89b9-bcae2d0df4b1 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:38.687610 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78b040-925a-4998-81f0-b98e4953633a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:38.688273 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78b040-925a-4998-81f0-b98e4953633a None admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:38.688569 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78b040-925a-4998-81f0-b98e4953633a None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:38.688827 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78b040-925a-4998-81f0-b98e4953633a None admin] PATH_INFO: `/v3/projects/b0abcc6f2ce14825bfc26e6210889c21/users/cbc2bab11b264196859802907b93ac37/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:38.691195 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78b040-925a-4998-81f0-b98e4953633a None admin] RBAC: Authorizing `identity:create_grant(project_id=b0abcc6f2ce14825bfc26e6210889c21, user_id=cbc2bab11b264196859802907b93ac37, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:38.692342 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78b040-925a-4998-81f0-b98e4953633a None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:38.706814 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 408/811] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Sep 21 12:07:38 2022] PUT /identity/v3/projects/b0abcc6f2ce14825bfc26e6210889c21/users/cbc2bab11b264196859802907b93ac37/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:07:38.707640 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78b040-925a-4998-81f0-b98e4953633a None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:38.717607 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 404/812] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:07:38.718856 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec1095-b2ef-4ca8-8ce4-6af8f52e5d09 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:38.763116 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:38.847900 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78b040-925a-4998-81f0-b98e4953633a None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:38.860916 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec1095-b2ef-4ca8-8ce4-6af8f52e5d09 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:38.888264 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12edf23f-c783-453b-9ae8-f599cff0e2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:38.888875 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12edf23f-c783-453b-9ae8-f599cff0e2c7 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:38.889152 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12edf23f-c783-453b-9ae8-f599cff0e2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:38.889423 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12edf23f-c783-453b-9ae8-f599cff0e2c7 None admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:38.890150 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12edf23f-c783-453b-9ae8-f599cff0e2c7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:38.890472 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12edf23f-c783-453b-9ae8-f599cff0e2c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:38.891909 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12edf23f-c783-453b-9ae8-f599cff0e2c7 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:38.906287 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e276754-32a3-4b06-a4c4-109545b2d63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:38.906708 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:38.907416 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e276754-32a3-4b06-a4c4-109545b2d63b None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:38.907706 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e276754-32a3-4b06-a4c4-109545b2d63b None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:38.907983 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e276754-32a3-4b06-a4c4-109545b2d63b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:38.910982 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 409/813] 10.222.0.60 () {56 vars in 1149 bytes} [Wed Sep 21 12:07:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:38.911834 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12edf23f-c783-453b-9ae8-f599cff0e2c7 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:38.993360 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e276754-32a3-4b06-a4c4-109545b2d63b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:38.994837 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e276754-32a3-4b06-a4c4-109545b2d63b None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:39.035866 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:39.039548 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12edf23f-c783-453b-9ae8-f599cff0e2c7 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:39.076865 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cce8bd-a6e9-4ad5-8c70-196b3f09c95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:39.077548 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cce8bd-a6e9-4ad5-8c70-196b3f09c95b None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:39.077829 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cce8bd-a6e9-4ad5-8c70-196b3f09c95b None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:39.078096 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cce8bd-a6e9-4ad5-8c70-196b3f09c95b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:39.078705 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cce8bd-a6e9-4ad5-8c70-196b3f09c95b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:39.080088 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cce8bd-a6e9-4ad5-8c70-196b3f09c95b None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:39.090254 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-39cce8bd-a6e9-4ad5-8c70-196b3f09c95b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 21 12:07:39.090254 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:39.090254 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 12:07:39.090254 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 12:07:39.090254 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 12:07:39.090254 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 12:07:39.090254 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 12:07:39.090254 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:07:39.090254 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 21 12:07:39.090254 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:39.090254 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 12:07:39.090254 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:39.090254 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:39.090254 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:39.090254 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:39.090254 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:39.090254 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:39.091412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:39.091412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:39.091412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:39.091412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:39.091412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:39.091412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:39.091412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 12:07:39.091412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 12:07:39.091412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 12:07:39.091412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 12:07:39.091412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:39.091412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:39.091412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:39.091412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:39.091412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:39.091412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:39.092800 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:39.092800 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:39.092800 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:39.092800 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:39.092800 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:39.092800 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:39.092800 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:39.092800 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:39.092800 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:39.092800 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:39.092800 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 12:07:39.092800 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:07:39.092800 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 21 12:07:39.092800 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:39.092800 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 410/814] 10.222.0.60 () {56 vars in 1129 bytes} [Wed Sep 21 12:07:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:39.093598 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cce8bd-a6e9-4ad5-8c70-196b3f09c95b None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:39.112803 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 405/815] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:07:38 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 12:07:39.114247 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e276754-32a3-4b06-a4c4-109545b2d63b None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:39.171262 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:39.212840 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cce8bd-a6e9-4ad5-8c70-196b3f09c95b None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:39.244611 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e276754-32a3-4b06-a4c4-109545b2d63b None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:39.249287 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b5f52-75df-49d8-9792-529b4ba862db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:39.249984 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b5f52-75df-49d8-9792-529b4ba862db None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:39.250309 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b5f52-75df-49d8-9792-529b4ba862db None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:39.250613 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b5f52-75df-49d8-9792-529b4ba862db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:39.262797 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323b5f52-75df-49d8-9792-529b4ba862db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:39.264246 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323b5f52-75df-49d8-9792-529b4ba862db None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:39.279489 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-323b5f52-75df-49d8-9792-529b4ba862db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:39.279489 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:39.279489 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:39.279489 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:39.279489 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:39.279489 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:39.279489 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:39.279489 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:39.279489 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:39.279489 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:39.279489 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:39.279489 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:39.279489 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:39.279489 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:39.279489 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:39.279489 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:39.280495 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:39.280495 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:39.280495 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:39.280495 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:39.280495 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:39.280495 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:39.280495 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:39.280495 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:39.280495 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:39.280495 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:39.280495 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:39.280495 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:39.280495 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:39.280495 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:39.280495 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:39.280495 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:39.280495 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:39.281384 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:39.281384 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:39.281384 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:39.281384 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 411/816] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:39.281614 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b5f52-75df-49d8-9792-529b4ba862db None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:39.285946 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b84950-1f70-458b-bc69-e27e4b2c8028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:39.286613 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b84950-1f70-458b-bc69-e27e4b2c8028 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:39.286894 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b84950-1f70-458b-bc69-e27e4b2c8028 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:39.287165 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b84950-1f70-458b-bc69-e27e4b2c8028 None admin] PATH_INFO: `/v3/services/network` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:39.288260 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b84950-1f70-458b-bc69-e27e4b2c8028 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:39.289633 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b84950-1f70-458b-bc69-e27e4b2c8028 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:39.293266 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:39.301165 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-03b84950-1f70-458b-bc69-e27e4b2c8028 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 21 12:07:39.301165 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:39.301165 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 12:07:39.301165 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 12:07:39.301165 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 12:07:39.301165 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 12:07:39.301165 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 12:07:39.301165 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:07:39.301165 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 21 12:07:39.301165 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:39.301165 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 12:07:39.301165 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:39.301165 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:39.301165 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:39.301165 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:39.301165 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:39.301165 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:39.303178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:39.303178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:39.303178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:39.303178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:39.303178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:39.303178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:39.303178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 12:07:39.303178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 12:07:39.303178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 12:07:39.303178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 12:07:39.303178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:39.303178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:39.303178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:39.303178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:39.303178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:39.303178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:39.304530 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:39.304530 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:39.304530 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:39.304530 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:39.304530 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:39.304530 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:39.304530 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:39.304530 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:39.304530 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:39.304530 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:39.304530 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 12:07:39.304530 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:07:39.304530 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 21 12:07:39.304530 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:39.304530 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 406/817] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:07:39 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:39.305733 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b84950-1f70-458b-bc69-e27e4b2c8028 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:39.402823 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b5f52-75df-49d8-9792-529b4ba862db None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:39.420590 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:39.422938 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b84950-1f70-458b-bc69-e27e4b2c8028 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:39.439476 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d82cbe-2d9b-46e1-825b-fe8d43717110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:39.440097 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d82cbe-2d9b-46e1-825b-fe8d43717110 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:39.440376 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d82cbe-2d9b-46e1-825b-fe8d43717110 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:39.440643 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d82cbe-2d9b-46e1-825b-fe8d43717110 None admin] PATH_INFO: `/v3/services` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:39.441274 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d82cbe-2d9b-46e1-825b-fe8d43717110 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:39.441577 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d82cbe-2d9b-46e1-825b-fe8d43717110 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:39.442992 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d82cbe-2d9b-46e1-825b-fe8d43717110 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:39.452639 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 412/818] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Sep 21 12:07:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:39.452639 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d82cbe-2d9b-46e1-825b-fe8d43717110 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:39.470418 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34ce37-d4cf-4f9a-b7dc-aab2f90d6ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:39.471582 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34ce37-d4cf-4f9a-b7dc-aab2f90d6ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:39.471878 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34ce37-d4cf-4f9a-b7dc-aab2f90d6ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:39.472152 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34ce37-d4cf-4f9a-b7dc-aab2f90d6ac5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:39.483563 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f34ce37-d4cf-4f9a-b7dc-aab2f90d6ac5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:39.485015 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f34ce37-d4cf-4f9a-b7dc-aab2f90d6ac5 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:39.500016 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-5f34ce37-d4cf-4f9a-b7dc-aab2f90d6ac5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:39.500016 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:39.500016 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:39.500016 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:39.500016 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:39.500016 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:39.500016 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:39.500016 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:39.500016 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:39.500016 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:39.500016 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:39.500016 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:39.500016 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:39.500016 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:39.500016 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:39.500016 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:39.501013 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:39.501013 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:39.501013 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:39.501013 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:39.501013 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:39.501013 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:39.501013 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:39.501013 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:39.501013 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:39.501013 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:39.501013 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:39.501013 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:39.501013 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:39.501013 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:39.501013 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:39.501013 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:39.501013 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:39.501901 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:39.501901 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:39.501901 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:39.501901 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 407/819] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:39.501901 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34ce37-d4cf-4f9a-b7dc-aab2f90d6ac5 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:39.566300 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:39.577052 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d82cbe-2d9b-46e1-825b-fe8d43717110 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:39.616660 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05da20-8732-4cc4-bf2b-728daa0c78c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:39.617276 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05da20-8732-4cc4-bf2b-728daa0c78c2 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:39.617551 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05da20-8732-4cc4-bf2b-728daa0c78c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:39.617823 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05da20-8732-4cc4-bf2b-728daa0c78c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:39.618596 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee05da20-8732-4cc4-bf2b-728daa0c78c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:39.618809 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee05da20-8732-4cc4-bf2b-728daa0c78c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:39.620192 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee05da20-8732-4cc4-bf2b-728daa0c78c2 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:39.625407 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34ce37-d4cf-4f9a-b7dc-aab2f90d6ac5 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:39.641674 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 413/820] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:39.642911 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05da20-8732-4cc4-bf2b-728daa0c78c2 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:39.676946 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dca546-7c25-4e34-9fa9-1f62b810f27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:39.677741 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dca546-7c25-4e34-9fa9-1f62b810f27f None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:39.678022 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dca546-7c25-4e34-9fa9-1f62b810f27f None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:39.678391 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dca546-7c25-4e34-9fa9-1f62b810f27f None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:39.679125 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dca546-7c25-4e34-9fa9-1f62b810f27f None admin] RBAC: Adding query filter params (name=network) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:39.679472 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dca546-7c25-4e34-9fa9-1f62b810f27f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:39.680933 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dca546-7c25-4e34-9fa9-1f62b810f27f None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:39.688232 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 408/821] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Sep 21 12:07:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:39.688232 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dca546-7c25-4e34-9fa9-1f62b810f27f None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:39.706883 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:39.778390 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05da20-8732-4cc4-bf2b-728daa0c78c2 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:39.815924 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dca546-7c25-4e34-9fa9-1f62b810f27f None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:39.816915 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13329db6-2406-4574-889f-49085d1aefdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:39.817535 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13329db6-2406-4574-889f-49085d1aefdd None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:39.817811 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13329db6-2406-4574-889f-49085d1aefdd None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:39.818079 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13329db6-2406-4574-889f-49085d1aefdd None admin] PATH_INFO: `/v3/services` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:39.818789 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13329db6-2406-4574-889f-49085d1aefdd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:39.819079 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13329db6-2406-4574-889f-49085d1aefdd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:39.820467 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13329db6-2406-4574-889f-49085d1aefdd None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:39.825478 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 414/822] 10.222.0.60 () {56 vars in 1124 bytes} [Wed Sep 21 12:07:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:39.826295 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13329db6-2406-4574-889f-49085d1aefdd None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:39.840062 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:39.877793 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5bb9e-c4a2-4ede-acf3-f4487fd12f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:39.878778 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5bb9e-c4a2-4ede-acf3-f4487fd12f9d None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:39.879230 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5bb9e-c4a2-4ede-acf3-f4487fd12f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:39.879674 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5bb9e-c4a2-4ede-acf3-f4487fd12f9d None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:39.880746 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5bb9e-c4a2-4ede-acf3-f4487fd12f9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:39.881776 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5bb9e-c4a2-4ede-acf3-f4487fd12f9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:39.884825 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5bb9e-c4a2-4ede-acf3-f4487fd12f9d None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:39.914016 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 409/823] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:39.914016 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5bb9e-c4a2-4ede-acf3-f4487fd12f9d None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:39.990554 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13329db6-2406-4574-889f-49085d1aefdd None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:39.992389 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:40.057647 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031decc-62bf-4e67-a644-9e24ab5817b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:40.059196 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031decc-62bf-4e67-a644-9e24ab5817b8 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:40.059934 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031decc-62bf-4e67-a644-9e24ab5817b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:40.060608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031decc-62bf-4e67-a644-9e24ab5817b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:40.073366 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1031decc-62bf-4e67-a644-9e24ab5817b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:40.075428 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5bb9e-c4a2-4ede-acf3-f4487fd12f9d None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:40.076720 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1031decc-62bf-4e67-a644-9e24ab5817b8 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:40.130257 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326c18f-af7b-47aa-af17-62c7f2970326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:40.131763 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326c18f-af7b-47aa-af17-62c7f2970326 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:40.132229 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326c18f-af7b-47aa-af17-62c7f2970326 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:40.132686 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326c18f-af7b-47aa-af17-62c7f2970326 None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:40.133690 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326c18f-af7b-47aa-af17-62c7f2970326 None admin] RBAC: Adding query filter params (type=network) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:40.134196 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326c18f-af7b-47aa-af17-62c7f2970326 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:40.136466 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326c18f-af7b-47aa-af17-62c7f2970326 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:40.144993 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 410/824] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Sep 21 12:07:39 2022] GET /identity/v3/services?type=network => generated 350 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:40.146393 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326c18f-af7b-47aa-af17-62c7f2970326 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:40.198407 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:40.227942 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-1031decc-62bf-4e67-a644-9e24ab5817b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:40.227942 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:40.227942 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:40.227942 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:40.227942 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:40.227942 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:40.227942 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:40.227942 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:40.227942 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:40.227942 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:40.227942 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:40.227942 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:40.227942 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 12:07:40.227942 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 12:07:40.227942 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 12:07:40.229077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 12:07:40.229077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:40.229077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:40.229077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:40.229077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:40.229077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:40.229077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:40.229077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:40.229077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:40.229077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:40.229077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:40.229077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:40.229077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:40.229077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:40.229077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:40.229077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:40.229077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:40.230184 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 12:07:40.230184 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 12:07:40.230184 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 12:07:40.230184 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 12:07:40.230184 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 12:07:40.230184 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 12:07:40.230184 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:40.230184 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:40.232236 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 415/825] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:07:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:40.233207 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031decc-62bf-4e67-a644-9e24ab5817b8 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:40.274324 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326c18f-af7b-47aa-af17-62c7f2970326 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:40.308541 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ef62c-6958-48f8-8216-25d1136cb104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:40.309210 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ef62c-6958-48f8-8216-25d1136cb104 None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:40.309419 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ef62c-6958-48f8-8216-25d1136cb104 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:40.309693 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ef62c-6958-48f8-8216-25d1136cb104 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:40.310380 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ef62c-6958-48f8-8216-25d1136cb104 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:40.311753 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ef62c-6958-48f8-8216-25d1136cb104 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:40.333966 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 411/826] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:07:40 2022] POST /identity/v3/endpoints => generated 346 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:07:40.334792 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ef62c-6958-48f8-8216-25d1136cb104 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:40.371871 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031decc-62bf-4e67-a644-9e24ab5817b8 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:40.440630 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d99a78-b2f0-48d3-bd2f-b0335fe2a82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:40.442441 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d99a78-b2f0-48d3-bd2f-b0335fe2a82c None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:40.443554 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d99a78-b2f0-48d3-bd2f-b0335fe2a82c None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:40.444606 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d99a78-b2f0-48d3-bd2f-b0335fe2a82c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:40.455433 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d99a78-b2f0-48d3-bd2f-b0335fe2a82c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:40.457735 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d99a78-b2f0-48d3-bd2f-b0335fe2a82c None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:40.458610 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:40.469262 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ef62c-6958-48f8-8216-25d1136cb104 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:40.476894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-28d99a78-b2f0-48d3-bd2f-b0335fe2a82c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:40.476894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:40.476894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:40.476894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:40.476894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:40.476894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:40.476894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:40.476894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:40.476894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:40.476894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:40.476894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:40.476894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:40.476894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 12:07:40.476894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 12:07:40.476894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 12:07:40.477861 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 12:07:40.477861 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:40.477861 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:40.477861 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:40.477861 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:40.477861 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:40.477861 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:40.477861 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:40.477861 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:40.477861 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:40.477861 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:40.477861 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:40.477861 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:40.477861 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:40.477861 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:40.477861 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:40.477861 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:40.478823 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 12:07:40.478823 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 12:07:40.478823 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 12:07:40.478823 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 12:07:40.478823 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 12:07:40.478823 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 12:07:40.478823 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:40.478823 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:40.480411 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 416/827] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:07:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:40.480867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d99a78-b2f0-48d3-bd2f-b0335fe2a82c None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:40.515023 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5775c8-d2e4-4fe2-992d-87369de4d25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:40.515704 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5775c8-d2e4-4fe2-992d-87369de4d25a None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:40.515990 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5775c8-d2e4-4fe2-992d-87369de4d25a None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:40.516266 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5775c8-d2e4-4fe2-992d-87369de4d25a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:40.516956 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5775c8-d2e4-4fe2-992d-87369de4d25a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:40.517698 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:40.518844 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5775c8-d2e4-4fe2-992d-87369de4d25a None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:40.550493 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 412/828] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:07:40 2022] POST /identity/v3/endpoints => generated 337 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:07:40.551506 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5775c8-d2e4-4fe2-992d-87369de4d25a None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:40.640713 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d99a78-b2f0-48d3-bd2f-b0335fe2a82c None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:40.692861 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48eb5e-ab86-4939-b85e-74d6c3e52875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:40.694534 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48eb5e-ab86-4939-b85e-74d6c3e52875 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:40.695066 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48eb5e-ab86-4939-b85e-74d6c3e52875 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:40.695539 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48eb5e-ab86-4939-b85e-74d6c3e52875 None admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:40.696535 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b48eb5e-ab86-4939-b85e-74d6c3e52875 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:40.696650 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5775c8-d2e4-4fe2-992d-87369de4d25a None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:40.697153 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b48eb5e-ab86-4939-b85e-74d6c3e52875 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:40.699075 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b48eb5e-ab86-4939-b85e-74d6c3e52875 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:40.713901 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 417/829] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Sep 21 12:07:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:40.719349 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48eb5e-ab86-4939-b85e-74d6c3e52875 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:40.739985 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86374058-ac85-4ecc-9c90-5e734662b752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:40.740676 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86374058-ac85-4ecc-9c90-5e734662b752 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:40.740956 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86374058-ac85-4ecc-9c90-5e734662b752 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:40.741227 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86374058-ac85-4ecc-9c90-5e734662b752 None admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:40.742033 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86374058-ac85-4ecc-9c90-5e734662b752 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:40.742345 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86374058-ac85-4ecc-9c90-5e734662b752 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:40.743988 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86374058-ac85-4ecc-9c90-5e734662b752 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:40.760661 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 413/830] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Sep 21 12:07:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:40.766138 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86374058-ac85-4ecc-9c90-5e734662b752 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:40.791607 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:40.827009 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:40.847820 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48eb5e-ab86-4939-b85e-74d6c3e52875 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:40.888680 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c75b02-da5a-4fbf-a4ee-474a048fcda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:40.889342 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c75b02-da5a-4fbf-a4ee-474a048fcda1 None admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:40.889616 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c75b02-da5a-4fbf-a4ee-474a048fcda1 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:40.889885 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c75b02-da5a-4fbf-a4ee-474a048fcda1 None admin] PATH_INFO: `/v3/projects/b0abcc6f2ce14825bfc26e6210889c21/users/bbd7a1d5a8d04e3798ffcab27bad936b/roles/327398b6ec324647b6c4ea84a59a026b` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:40.892498 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86374058-ac85-4ecc-9c90-5e734662b752 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:40.909061 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c75b02-da5a-4fbf-a4ee-474a048fcda1 None admin] RBAC: Authorizing `identity:create_grant(project_id=b0abcc6f2ce14825bfc26e6210889c21, user_id=bbd7a1d5a8d04e3798ffcab27bad936b, role_id=327398b6ec324647b6c4ea84a59a026b)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:40.910718 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c75b02-da5a-4fbf-a4ee-474a048fcda1 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:40.936546 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 418/831] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Sep 21 12:07:40 2022] PUT /identity/v3/projects/b0abcc6f2ce14825bfc26e6210889c21/users/bbd7a1d5a8d04e3798ffcab27bad936b/roles/327398b6ec324647b6c4ea84a59a026b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:07:40.947231 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d265d4a-54f1-4278-a3dc-db44084a701d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:40.947875 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d265d4a-54f1-4278-a3dc-db44084a701d None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:40.948157 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d265d4a-54f1-4278-a3dc-db44084a701d None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:40.948429 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d265d4a-54f1-4278-a3dc-db44084a701d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:40.949191 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d265d4a-54f1-4278-a3dc-db44084a701d None admin] RBAC: Adding query filter params (role.id=72c80b472acb462ebadd86463efe91f7, scope.project.id=b0abcc6f2ce14825bfc26e6210889c21, user.id=6cb4001f94b8439180ca2a93d3b279b1) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:40.949503 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d265d4a-54f1-4278-a3dc-db44084a701d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:40.951459 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d265d4a-54f1-4278-a3dc-db44084a701d None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:40.959744 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 414/832] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:07:40 2022] GET /identity/v3/role_assignments?user.id=6cb4001f94b8439180ca2a93d3b279b1&scope.project.id=b0abcc6f2ce14825bfc26e6210889c21&role.id=72c80b472acb462ebadd86463efe91f7 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:07:41.065655 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378afdd-4548-42a5-a1d2-63e556930c43 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:41.065997 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378afdd-4548-42a5-a1d2-63e556930c43 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:41.066202 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378afdd-4548-42a5-a1d2-63e556930c43 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:41.068035 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 419/833] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:07:41.074826 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4704b3e-4534-4643-a0fd-255d909cb6c2 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:41.075165 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4704b3e-4534-4643-a0fd-255d909cb6c2 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:41.075452 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4704b3e-4534-4643-a0fd-255d909cb6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:41.095859 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-e4704b3e-4534-4643-a0fd-255d909cb6c2 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:41.097038 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-e4704b3e-4534-4643-a0fd-255d909cb6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:41.179636 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 415/834] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:41 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:07:41.451938 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378afdd-4548-42a5-a1d2-63e556930c43 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:41.567222 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378afdd-4548-42a5-a1d2-63e556930c43 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:41.600624 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:41.605061 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b620590-db84-4820-93c0-34db011da70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:41.605692 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b620590-db84-4820-93c0-34db011da70e None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:41.605966 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b620590-db84-4820-93c0-34db011da70e None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:41.606310 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b620590-db84-4820-93c0-34db011da70e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:41.617858 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b620590-db84-4820-93c0-34db011da70e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:07:41.622682 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-0b620590-db84-4820-93c0-34db011da70e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:07:41.622682 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:41.622682 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:41.622682 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:41.622682 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:41.622682 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:41.622682 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:41.622682 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:41.622682 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:41.622682 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:41.622682 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:41.622682 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:41.622682 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:07:41.622682 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:07:41.622682 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:07:41.622682 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:07:41.623598 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:07:41.623598 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:07:41.623598 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:07:41.623598 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:07:41.623598 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:41.623598 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:41.623598 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:41.623598 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:41.623598 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:41.623598 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:41.623598 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:41.623598 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:41.623598 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:41.623598 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:41.623598 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:41.623598 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:41.624457 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:41.624457 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:41.624457 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:41.624457 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:41.624457 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:07:41.624457 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:07:41.624457 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:07:41.624457 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:07:41.624457 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:07:41.624457 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:07:41.624457 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:07:41.624457 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:41.624457 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 420/835] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Sep 21 12:07:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:41.630086 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4704b3e-4534-4643-a0fd-255d909cb6c2 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:41.632611 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:41.735856 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4704b3e-4534-4643-a0fd-255d909cb6c2 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:41.771543 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eaea16-d9a1-444c-95a3-470e9200891f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:41.772247 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eaea16-d9a1-444c-95a3-470e9200891f None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:41.772522 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eaea16-d9a1-444c-95a3-470e9200891f None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:41.772791 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eaea16-d9a1-444c-95a3-470e9200891f None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:41.773454 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eaea16-d9a1-444c-95a3-470e9200891f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:41.773754 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eaea16-d9a1-444c-95a3-470e9200891f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:41.775214 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eaea16-d9a1-444c-95a3-470e9200891f None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:41.784446 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 416/836] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:07:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:41.790180 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b620590-db84-4820-93c0-34db011da70e None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:41.897642 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b620590-db84-4820-93c0-34db011da70e None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:41.939250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e19cd-e0a6-49bd-aa1a-8ba617e5c5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:41.939881 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e19cd-e0a6-49bd-aa1a-8ba617e5c5aa None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:41.940153 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e19cd-e0a6-49bd-aa1a-8ba617e5c5aa None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:41.940414 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e19cd-e0a6-49bd-aa1a-8ba617e5c5aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:41.951679 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e19cd-e0a6-49bd-aa1a-8ba617e5c5aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:41.953114 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e19cd-e0a6-49bd-aa1a-8ba617e5c5aa None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:41.968184 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-bb2e19cd-e0a6-49bd-aa1a-8ba617e5c5aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:41.968184 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:41.968184 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:41.968184 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:41.968184 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:41.968184 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:41.968184 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:41.968184 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:41.968184 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:41.968184 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:41.968184 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:41.968184 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:41.968184 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:41.968184 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:41.968184 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:41.968184 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:41.969208 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:41.969208 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:41.969208 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:41.969208 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:41.969208 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:41.969208 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:41.969208 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:41.969208 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:41.969208 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:41.969208 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:41.969208 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:41.969208 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:41.969208 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:41.969208 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:41.969208 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:41.969208 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:41.969208 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:41.970130 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:41.970130 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:41.970130 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:41.970130 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 421/837] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:41.976716 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eaea16-d9a1-444c-95a3-470e9200891f None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:42.044970 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:42.086735 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eaea16-d9a1-444c-95a3-470e9200891f None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:42.121584 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507ec5d-9a45-4dfb-bad6-5191cc3c70c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:42.122185 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507ec5d-9a45-4dfb-bad6-5191cc3c70c0 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:42.122488 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507ec5d-9a45-4dfb-bad6-5191cc3c70c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:42.122756 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507ec5d-9a45-4dfb-bad6-5191cc3c70c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:42.123387 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3507ec5d-9a45-4dfb-bad6-5191cc3c70c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:42.123682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3507ec5d-9a45-4dfb-bad6-5191cc3c70c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:42.125030 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3507ec5d-9a45-4dfb-bad6-5191cc3c70c0 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:42.137218 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 417/838] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:42.143499 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e19cd-e0a6-49bd-aa1a-8ba617e5c5aa None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:42.188958 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:42.257620 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e19cd-e0a6-49bd-aa1a-8ba617e5c5aa None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:42.293548 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca74b2-6cf9-4545-b3fa-dbc5dd422e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:42.294181 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca74b2-6cf9-4545-b3fa-dbc5dd422e8e None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:42.294487 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca74b2-6cf9-4545-b3fa-dbc5dd422e8e None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:42.294759 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca74b2-6cf9-4545-b3fa-dbc5dd422e8e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:42.302785 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca74b2-6cf9-4545-b3fa-dbc5dd422e8e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:42.304199 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca74b2-6cf9-4545-b3fa-dbc5dd422e8e None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:42.315623 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-4fca74b2-6cf9-4545-b3fa-dbc5dd422e8e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 21 12:07:42.315623 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:42.315623 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:42.315623 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:42.315623 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:42.315623 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:42.315623 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:42.315623 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:42.315623 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:42.315623 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:42.315623 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:42.315623 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:42.315623 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 12:07:42.315623 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 12:07:42.315623 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 12:07:42.315623 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 12:07:42.316617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:42.316617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:42.316617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 12:07:42.316617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:42.316617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 12:07:42.316617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:42.316617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:42.316617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:42.316617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:42.316617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:42.316617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:42.316617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:42.316617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:42.316617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:42.316617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:42.316617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:42.316617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:42.316617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:42.317566 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:42.317566 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:42.317566 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 12:07:42.317566 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 12:07:42.317566 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 12:07:42.317566 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 12:07:42.317566 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 12:07:42.317566 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 12:07:42.317566 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 21 12:07:42.317566 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:42.317566 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 422/839] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Sep 21 12:07:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:42.325098 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507ec5d-9a45-4dfb-bad6-5191cc3c70c0 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:42.436373 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507ec5d-9a45-4dfb-bad6-5191cc3c70c0 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:42.467057 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:42.476908 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9097d80-bd13-4dc9-bdfd-57beac3c5207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:42.477510 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9097d80-bd13-4dc9-bdfd-57beac3c5207 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:42.477787 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9097d80-bd13-4dc9-bdfd-57beac3c5207 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:42.478103 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9097d80-bd13-4dc9-bdfd-57beac3c5207 None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:42.478865 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9097d80-bd13-4dc9-bdfd-57beac3c5207 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:42.479163 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9097d80-bd13-4dc9-bdfd-57beac3c5207 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:42.480638 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9097d80-bd13-4dc9-bdfd-57beac3c5207 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:42.499711 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 418/840] 10.222.0.60 () {56 vars in 1135 bytes} [Wed Sep 21 12:07:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:42.505402 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca74b2-6cf9-4545-b3fa-dbc5dd422e8e None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:42.613823 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:42.618974 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca74b2-6cf9-4545-b3fa-dbc5dd422e8e None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:42.656216 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25eab45-42b0-4ff5-b21c-25c1735e4587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:42.656833 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25eab45-42b0-4ff5-b21c-25c1735e4587 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:42.657114 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25eab45-42b0-4ff5-b21c-25c1735e4587 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:42.657387 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25eab45-42b0-4ff5-b21c-25c1735e4587 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:42.734878 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25eab45-42b0-4ff5-b21c-25c1735e4587 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:42.736354 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25eab45-42b0-4ff5-b21c-25c1735e4587 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:42.845172 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:42.850735 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 423/841] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:07:42 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 12:07:42.855816 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9097d80-bd13-4dc9-bdfd-57beac3c5207 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:42.951765 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f09df4-8394-4f50-b4b2-6f0856625dfb None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:42.952091 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f09df4-8394-4f50-b4b2-6f0856625dfb None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:42.952316 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f09df4-8394-4f50-b4b2-6f0856625dfb None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:42.953783 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 424/842] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:07:42.960813 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154cc142-2d19-48c9-bf9e-f8b76f27435b None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:42.961136 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154cc142-2d19-48c9-bf9e-f8b76f27435b None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:42.961418 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154cc142-2d19-48c9-bf9e-f8b76f27435b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:42.979606 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9097d80-bd13-4dc9-bdfd-57beac3c5207 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:42.990953 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-154cc142-2d19-48c9-bf9e-f8b76f27435b None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:42.992174 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-154cc142-2d19-48c9-bf9e-f8b76f27435b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:43.032698 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7488f29-e98d-485d-92e3-a26d5efa4553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:43.033694 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7488f29-e98d-485d-92e3-a26d5efa4553 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:43.034168 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7488f29-e98d-485d-92e3-a26d5efa4553 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:43.034672 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7488f29-e98d-485d-92e3-a26d5efa4553 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:43.047989 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7488f29-e98d-485d-92e3-a26d5efa4553 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:43.050966 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7488f29-e98d-485d-92e3-a26d5efa4553 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:43.070897 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-b7488f29-e98d-485d-92e3-a26d5efa4553 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:43.070897 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:43.070897 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:43.070897 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:43.070897 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:43.070897 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:43.070897 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:43.070897 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:43.070897 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:43.070897 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:43.070897 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:43.070897 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:43.070897 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:43.070897 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:43.070897 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:43.070897 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:43.072197 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:43.072197 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:43.072197 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:43.072197 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:43.072197 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:43.072197 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:43.072197 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:43.072197 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:43.072197 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:43.072197 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:43.072197 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:43.072197 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:43.072197 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:43.072197 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:43.072197 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:43.072197 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:43.072197 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:43.073395 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:43.073395 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:43.073395 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:43.074972 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 419/843] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:43.082088 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7488f29-e98d-485d-92e3-a26d5efa4553 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:43.106629 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 425/844] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 12:07:43.123644 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:43.207982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7488f29-e98d-485d-92e3-a26d5efa4553 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:43.245494 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212a102-5995-4720-aefb-9cc5b3681533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:43.246564 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212a102-5995-4720-aefb-9cc5b3681533 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:43.247073 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212a102-5995-4720-aefb-9cc5b3681533 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:43.247556 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212a102-5995-4720-aefb-9cc5b3681533 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:43.248448 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e212a102-5995-4720-aefb-9cc5b3681533 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:43.248971 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e212a102-5995-4720-aefb-9cc5b3681533 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:43.250644 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e212a102-5995-4720-aefb-9cc5b3681533 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:43.265756 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 420/845] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:07:43.271956 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154cc142-2d19-48c9-bf9e-f8b76f27435b None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:43.283710 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a4a55-6924-43a8-87ef-c91a1c3b6fa4 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:43.284060 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a4a55-6924-43a8-87ef-c91a1c3b6fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:43.284256 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a4a55-6924-43a8-87ef-c91a1c3b6fa4 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:43.285886 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 421/846] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:07:43.291188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d5507-8cfb-4c57-8629-8313555b6737 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:43.291475 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d5507-8cfb-4c57-8629-8313555b6737 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:43.291753 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d5507-8cfb-4c57-8629-8313555b6737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:43.312072 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-918d5507-8cfb-4c57-8629-8313555b6737 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:43.313303 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-918d5507-8cfb-4c57-8629-8313555b6737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:43.393498 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 422/847] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:43 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 12:07:43.395044 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc117a-0124-45b4-a1a9-28ba03b72e4e None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:43.395044 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc117a-0124-45b4-a1a9-28ba03b72e4e None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:43.395361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc117a-0124-45b4-a1a9-28ba03b72e4e None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:43.397099 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 423/848] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:07:43.397902 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc117a-0124-45b4-a1a9-28ba03b72e4e None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:43.412024 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154cc142-2d19-48c9-bf9e-f8b76f27435b None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:43.431435 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:43.442136 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:43.452309 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca2190-a134-47dc-a214-7738a7e49419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:43.452944 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca2190-a134-47dc-a214-7738a7e49419 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:43.453222 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca2190-a134-47dc-a214-7738a7e49419 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:43.453491 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca2190-a134-47dc-a214-7738a7e49419 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:43.460415 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca2190-a134-47dc-a214-7738a7e49419 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:43.461859 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca2190-a134-47dc-a214-7738a7e49419 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:43.473940 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-01ca2190-a134-47dc-a214-7738a7e49419 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:43.473940 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:43.473940 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:43.473940 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:43.473940 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:43.473940 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:43.473940 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:43.473940 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:43.473940 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:43.473940 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:43.473940 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:43.473940 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:43.473940 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 12:07:43.473940 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 12:07:43.473940 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 12:07:43.475100 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 12:07:43.475100 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:43.475100 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:43.475100 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:43.475100 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:43.475100 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:43.475100 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:43.475100 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:43.475100 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:43.475100 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:43.475100 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:43.475100 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:43.475100 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:43.475100 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:43.475100 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:43.475100 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:43.475100 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:43.476053 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 12:07:43.476053 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 12:07:43.476053 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 12:07:43.476053 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 12:07:43.476053 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 12:07:43.476053 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 12:07:43.476053 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:43.476053 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:43.476053 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 426/849] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:07:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:43.476558 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e71177-8e41-4042-8ad9-92c2a4394306 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:43.476558 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e71177-8e41-4042-8ad9-92c2a4394306 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:43.477107 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e71177-8e41-4042-8ad9-92c2a4394306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:43.495669 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-f5e71177-8e41-4042-8ad9-92c2a4394306 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:43.496874 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-f5e71177-8e41-4042-8ad9-92c2a4394306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:43.526278 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc117a-0124-45b4-a1a9-28ba03b72e4e None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:43.575130 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa0f5b-52c8-4c92-b8cc-e12b6a67a21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:43.576241 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa0f5b-52c8-4c92-b8cc-e12b6a67a21b None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:43.576738 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa0f5b-52c8-4c92-b8cc-e12b6a67a21b None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:43.577111 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa0f5b-52c8-4c92-b8cc-e12b6a67a21b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:43.578166 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa0f5b-52c8-4c92-b8cc-e12b6a67a21b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:43.579882 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa0f5b-52c8-4c92-b8cc-e12b6a67a21b None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:43.590313 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-a8fa0f5b-52c8-4c92-b8cc-e12b6a67a21b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 21 12:07:43.590313 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:43.590313 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 12:07:43.590313 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 12:07:43.590313 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 12:07:43.590313 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 12:07:43.590313 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 12:07:43.590313 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:07:43.590313 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 21 12:07:43.590313 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:43.590313 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 12:07:43.590313 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:43.590313 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:43.590313 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:43.590313 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:43.590313 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:43.590313 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:43.591473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:43.591473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:43.591473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:43.591473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:43.591473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:43.591473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:43.591473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 12:07:43.591473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 12:07:43.591473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 12:07:43.591473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 12:07:43.591473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:43.591473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:43.591473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:43.591473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:43.591473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:43.591473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:43.592362 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:43.592362 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:43.592362 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:43.592362 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:43.592362 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:43.592362 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:43.592362 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:43.592362 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:43.592362 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:43.592362 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:43.592362 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 12:07:43.592362 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:07:43.592362 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 21 12:07:43.592362 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:43.593134 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 427/850] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:43 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:07:43.593134 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e71177-8e41-4042-8ad9-92c2a4394306 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:43.596997 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 424/851] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Sep 21 12:07:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:43.603208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa0f5b-52c8-4c92-b8cc-e12b6a67a21b None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:43.721572 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e71177-8e41-4042-8ad9-92c2a4394306 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:43.722344 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:43.740684 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa0f5b-52c8-4c92-b8cc-e12b6a67a21b None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:43.743561 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:43.777264 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8cc458-81fe-46ab-bd8c-802e3bf88b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:43.778162 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8cc458-81fe-46ab-bd8c-802e3bf88b68 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:43.778692 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8cc458-81fe-46ab-bd8c-802e3bf88b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:43.779150 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8cc458-81fe-46ab-bd8c-802e3bf88b68 None admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:43.780200 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8cc458-81fe-46ab-bd8c-802e3bf88b68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:43.780708 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8cc458-81fe-46ab-bd8c-802e3bf88b68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:43.783174 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8cc458-81fe-46ab-bd8c-802e3bf88b68 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:43.788547 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559e841-9635-4c27-b83f-b3ce1c855f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:43.789473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559e841-9635-4c27-b83f-b3ce1c855f69 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:43.789933 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559e841-9635-4c27-b83f-b3ce1c855f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:43.790409 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559e841-9635-4c27-b83f-b3ce1c855f69 None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:43.791473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d559e841-9635-4c27-b83f-b3ce1c855f69 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:43.792004 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d559e841-9635-4c27-b83f-b3ce1c855f69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:43.794379 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d559e841-9635-4c27-b83f-b3ce1c855f69 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:43.805972 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 425/852] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Sep 21 12:07:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:43.806157 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 428/853] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Sep 21 12:07:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:43.807504 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8cc458-81fe-46ab-bd8c-802e3bf88b68 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:43.807706 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559e841-9635-4c27-b83f-b3ce1c855f69 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:43.921431 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8cc458-81fe-46ab-bd8c-802e3bf88b68 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:43.923099 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559e841-9635-4c27-b83f-b3ce1c855f69 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:43.956937 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ccc79b-01a9-47f1-957e-92979ae7303b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:43.957539 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccc79b-01a9-47f1-957e-92979ae7303b None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:43.957814 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccc79b-01a9-47f1-957e-92979ae7303b None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:43.958083 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ccc79b-01a9-47f1-957e-92979ae7303b None admin] PATH_INFO: `/v3/services` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:43.958455 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99af45-9708-4e67-972c-d9969dd11ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:43.958736 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ccc79b-01a9-47f1-957e-92979ae7303b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:43.959035 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ccc79b-01a9-47f1-957e-92979ae7303b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:43.959136 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99af45-9708-4e67-972c-d9969dd11ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:43.959956 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99af45-9708-4e67-972c-d9969dd11ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:43.960230 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99af45-9708-4e67-972c-d9969dd11ed7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:43.961010 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ccc79b-01a9-47f1-957e-92979ae7303b None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:43.965365 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 429/854] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Sep 21 12:07:43 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:43.966133 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ccc79b-01a9-47f1-957e-92979ae7303b None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:43.973239 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa99af45-9708-4e67-972c-d9969dd11ed7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:07:43.979020 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-fa99af45-9708-4e67-972c-d9969dd11ed7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 12:07:43.979020 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:43.979020 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:43.979020 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:43.979020 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:43.979020 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:43.979020 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:43.979020 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:43.979020 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:43.979020 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:43.979020 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:43.979020 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:43.979020 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:07:43.979020 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:07:43.979020 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:07:43.979020 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:07:43.980038 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:07:43.980038 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:07:43.980038 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:07:43.980038 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:07:43.980038 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:43.980038 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:43.980038 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:43.980038 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:43.980038 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:43.980038 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:43.980038 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:43.980038 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:43.980038 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:43.980038 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:43.980038 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:43.980038 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:43.980866 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:43.980866 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:43.980866 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:43.980866 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:43.980866 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:07:43.980866 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:07:43.980866 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:07:43.980866 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:07:43.980866 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:07:43.980866 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:07:43.980866 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 12:07:43.980866 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:43.980866 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 426/855] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Sep 21 12:07:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:43.981583 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99af45-9708-4e67-972c-d9969dd11ed7 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:44.000156 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:44.026765 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:44.123916 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ccc79b-01a9-47f1-957e-92979ae7303b None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:44.124200 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99af45-9708-4e67-972c-d9969dd11ed7 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:44.179731 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e135dcda-51d2-4433-aa7b-9a05318929c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:44.180755 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135dcda-51d2-4433-aa7b-9a05318929c3 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:44.181345 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135dcda-51d2-4433-aa7b-9a05318929c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:44.181533 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004593c-ba69-4a69-b90f-938835768423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:44.181694 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135dcda-51d2-4433-aa7b-9a05318929c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:44.182305 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004593c-ba69-4a69-b90f-938835768423 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:44.182561 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004593c-ba69-4a69-b90f-938835768423 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:44.182870 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004593c-ba69-4a69-b90f-938835768423 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:44.182976 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e135dcda-51d2-4433-aa7b-9a05318929c3 None admin] RBAC: Adding query filter params (role.id=72c80b472acb462ebadd86463efe91f7, scope.project.id=b0abcc6f2ce14825bfc26e6210889c21, user.id=cbc2bab11b264196859802907b93ac37) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:44.183526 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d004593c-ba69-4a69-b90f-938835768423 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:44.183635 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e135dcda-51d2-4433-aa7b-9a05318929c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:44.185894 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d004593c-ba69-4a69-b90f-938835768423 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:44.186017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e135dcda-51d2-4433-aa7b-9a05318929c3 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:44.192043 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 430/856] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:07:43 2022] GET /identity/v3/role_assignments?user.id=cbc2bab11b264196859802907b93ac37&scope.project.id=b0abcc6f2ce14825bfc26e6210889c21&role.id=72c80b472acb462ebadd86463efe91f7 => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:44.192855 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e135dcda-51d2-4433-aa7b-9a05318929c3 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:44.200871 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-d004593c-ba69-4a69-b90f-938835768423 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 21 12:07:44.200871 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:44.200871 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 12:07:44.200871 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 12:07:44.200871 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 12:07:44.200871 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 12:07:44.200871 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 12:07:44.200871 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:07:44.200871 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 21 12:07:44.200871 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:44.200871 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 12:07:44.200871 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:44.200871 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:44.200871 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:44.200871 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:44.200871 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:44.202069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:44.202069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:44.202069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:44.202069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:44.202069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:44.202069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:44.202069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:44.202069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 12:07:44.202069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 12:07:44.202069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 12:07:44.202069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 12:07:44.202069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:44.202069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:44.202069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:44.202069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:44.202069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:44.202069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:44.203058 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:44.203058 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:44.203058 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:44.203058 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:44.203058 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:44.203058 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:44.203058 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:44.203058 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:44.203058 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:44.203058 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:44.203058 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 12:07:44.203058 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:07:44.203058 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 21 12:07:44.203058 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:44.203058 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 427/857] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Sep 21 12:07:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:44.213358 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004593c-ba69-4a69-b90f-938835768423 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:44.318678 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:44.356193 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004593c-ba69-4a69-b90f-938835768423 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:44.378325 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e135dcda-51d2-4433-aa7b-9a05318929c3 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:44.391377 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:44.410466 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3d9d3-43ce-47a7-b598-e7588c02bfcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:44.411096 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3d9d3-43ce-47a7-b598-e7588c02bfcb None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:44.411774 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3d9d3-43ce-47a7-b598-e7588c02bfcb None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:44.411774 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3d9d3-43ce-47a7-b598-e7588c02bfcb None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:44.412498 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f3d9d3-43ce-47a7-b598-e7588c02bfcb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:44.412725 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f3d9d3-43ce-47a7-b598-e7588c02bfcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:44.414179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f3d9d3-43ce-47a7-b598-e7588c02bfcb None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:44.419415 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 428/858] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Sep 21 12:07:44 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:07:44.425180 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3d9d3-43ce-47a7-b598-e7588c02bfcb None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:44.430151 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a823ac-b6aa-40f5-947e-c8b01b5b629a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:44.430795 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a823ac-b6aa-40f5-947e-c8b01b5b629a None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:44.431072 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a823ac-b6aa-40f5-947e-c8b01b5b629a None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:44.431339 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a823ac-b6aa-40f5-947e-c8b01b5b629a None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:44.432007 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a823ac-b6aa-40f5-947e-c8b01b5b629a None admin] RBAC: Adding query filter params (name=service) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:44.432304 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a823ac-b6aa-40f5-947e-c8b01b5b629a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:44.433670 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a823ac-b6aa-40f5-947e-c8b01b5b629a None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:44.445886 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 431/859] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Sep 21 12:07:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:44.451679 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a823ac-b6aa-40f5-947e-c8b01b5b629a None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:44.547139 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3d9d3-43ce-47a7-b598-e7588c02bfcb None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:44.588054 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a823ac-b6aa-40f5-947e-c8b01b5b629a None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:44.595608 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b01c7c-e6e7-4d44-be64-c2a1803c6561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:44.597097 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b01c7c-e6e7-4d44-be64-c2a1803c6561 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:44.597602 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b01c7c-e6e7-4d44-be64-c2a1803c6561 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:44.598091 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b01c7c-e6e7-4d44-be64-c2a1803c6561 None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:44.599430 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b01c7c-e6e7-4d44-be64-c2a1803c6561 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:44.600577 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b01c7c-e6e7-4d44-be64-c2a1803c6561 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:44.603077 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b01c7c-e6e7-4d44-be64-c2a1803c6561 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:44.615054 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 429/860] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Sep 21 12:07:44 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:07:44.631621 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0569584-a143-464c-ba67-e62c183ecb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:44.632333 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0569584-a143-464c-ba67-e62c183ecb71 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:44.632607 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0569584-a143-464c-ba67-e62c183ecb71 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:44.632879 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0569584-a143-464c-ba67-e62c183ecb71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:44.645969 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0569584-a143-464c-ba67-e62c183ecb71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:44.648177 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0569584-a143-464c-ba67-e62c183ecb71 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:44.665018 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-a0569584-a143-464c-ba67-e62c183ecb71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:44.665018 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:44.665018 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:44.665018 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:44.665018 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:44.665018 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:44.665018 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:44.665018 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:44.665018 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:44.665018 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:44.665018 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:44.665018 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:44.665018 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:44.665018 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:44.665018 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:44.665018 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:44.666061 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:44.666061 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:44.666061 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:44.666061 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:44.666061 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:44.666061 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:44.666061 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:44.666061 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:44.666061 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:44.666061 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:44.666061 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:44.666061 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:44.666061 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:44.666061 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:44.666061 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:44.666061 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:44.666061 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:44.667022 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:44.667022 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:44.667022 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:44.670671 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 432/861] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:44.672483 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b01c7c-e6e7-4d44-be64-c2a1803c6561 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:44.678926 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:44.807548 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b01c7c-e6e7-4d44-be64-c2a1803c6561 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:44.852623 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28499225-6643-4036-b314-5572c4cbaf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:44.853691 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28499225-6643-4036-b314-5572c4cbaf23 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:44.853917 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28499225-6643-4036-b314-5572c4cbaf23 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:44.854179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28499225-6643-4036-b314-5572c4cbaf23 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:44.854850 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28499225-6643-4036-b314-5572c4cbaf23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:44.855161 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28499225-6643-4036-b314-5572c4cbaf23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:44.856548 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28499225-6643-4036-b314-5572c4cbaf23 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:44.870960 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 430/862] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:44.876485 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0569584-a143-464c-ba67-e62c183ecb71 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:44.902325 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:44.994944 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0569584-a143-464c-ba67-e62c183ecb71 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:45.035743 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff18b47-816e-446a-a07a-d3e97cdaa014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:45.036722 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff18b47-816e-446a-a07a-d3e97cdaa014 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:45.037151 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff18b47-816e-446a-a07a-d3e97cdaa014 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:45.037936 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff18b47-816e-446a-a07a-d3e97cdaa014 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:45.049331 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff18b47-816e-446a-a07a-d3e97cdaa014 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:45.051076 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff18b47-816e-446a-a07a-d3e97cdaa014 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:45.064464 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-8ff18b47-816e-446a-a07a-d3e97cdaa014 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 12:07:45.064464 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:45.064464 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:45.064464 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:45.064464 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:45.064464 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:45.064464 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:45.064464 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:45.064464 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:45.064464 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:45.064464 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:45.064464 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:45.064464 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 12:07:45.064464 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 12:07:45.064464 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 12:07:45.064464 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 12:07:45.065645 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:45.065645 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:45.065645 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 12:07:45.065645 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:45.065645 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 12:07:45.065645 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:45.065645 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:45.065645 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:45.065645 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:45.065645 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:45.065645 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:45.065645 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:45.065645 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:45.065645 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:45.065645 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:45.065645 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:45.065645 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:45.065645 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:45.066709 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:45.066709 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:45.066709 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 12:07:45.066709 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 12:07:45.066709 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 12:07:45.066709 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 12:07:45.066709 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 12:07:45.066709 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 12:07:45.066709 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 12:07:45.066709 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:45.069401 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 433/863] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Sep 21 12:07:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:45.078407 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28499225-6643-4036-b314-5572c4cbaf23 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:45.153268 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:45.194728 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28499225-6643-4036-b314-5572c4cbaf23 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:45.237497 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10624b-0330-4234-96a5-399e0a282903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:45.238105 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10624b-0330-4234-96a5-399e0a282903 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:45.238395 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10624b-0330-4234-96a5-399e0a282903 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:45.238672 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10624b-0330-4234-96a5-399e0a282903 None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:45.239388 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10624b-0330-4234-96a5-399e0a282903 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:45.239749 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10624b-0330-4234-96a5-399e0a282903 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:45.241191 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10624b-0330-4234-96a5-399e0a282903 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:45.260497 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 431/864] 10.222.0.60 () {56 vars in 1149 bytes} [Wed Sep 21 12:07:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:45.266461 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff18b47-816e-446a-a07a-d3e97cdaa014 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:45.358046 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:45.382786 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff18b47-816e-446a-a07a-d3e97cdaa014 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:45.422572 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ad700-480c-4ddc-867f-ee81b67fce18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:45.423447 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ad700-480c-4ddc-867f-ee81b67fce18 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:45.423875 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ad700-480c-4ddc-867f-ee81b67fce18 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:45.424292 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ad700-480c-4ddc-867f-ee81b67fce18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:45.508088 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ad700-480c-4ddc-867f-ee81b67fce18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:45.509800 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ad700-480c-4ddc-867f-ee81b67fce18 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:45.603115 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:45.626344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 434/865] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:07:45 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 12:07:45.631784 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10624b-0330-4234-96a5-399e0a282903 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:45.755335 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10624b-0330-4234-96a5-399e0a282903 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:45.782991 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:45.794837 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f4ee9-a82a-44dd-9346-f0c85ee4c3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:45.795473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f4ee9-a82a-44dd-9346-f0c85ee4c3c8 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:45.795749 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f4ee9-a82a-44dd-9346-f0c85ee4c3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:45.796022 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f4ee9-a82a-44dd-9346-f0c85ee4c3c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:45.807765 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068f4ee9-a82a-44dd-9346-f0c85ee4c3c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:45.809219 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068f4ee9-a82a-44dd-9346-f0c85ee4c3c8 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:45.824947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-068f4ee9-a82a-44dd-9346-f0c85ee4c3c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:45.824947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:45.824947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:45.824947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:45.824947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:45.824947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:45.824947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:45.824947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:45.824947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:45.824947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:45.824947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:45.824947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:45.824947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:45.824947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:45.824947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:45.824947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:45.825885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:45.825885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:45.825885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:45.825885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:45.825885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:45.825885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:45.825885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:45.825885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:45.825885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:45.825885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:45.825885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:45.825885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:45.825885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:45.825885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:45.825885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:45.825885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:45.825885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:45.826823 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:45.826823 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:45.826823 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:45.826823 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 432/866] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:45.832021 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ad700-480c-4ddc-867f-ee81b67fce18 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:45.942842 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ad700-480c-4ddc-867f-ee81b67fce18 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:45.978899 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f365c9f-0436-4349-9785-f1f7bb4802fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:45.979505 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f365c9f-0436-4349-9785-f1f7bb4802fe None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:45.979784 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f365c9f-0436-4349-9785-f1f7bb4802fe None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:45.980056 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f365c9f-0436-4349-9785-f1f7bb4802fe None admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:45.980695 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f365c9f-0436-4349-9785-f1f7bb4802fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:45.980991 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f365c9f-0436-4349-9785-f1f7bb4802fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:45.982346 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f365c9f-0436-4349-9785-f1f7bb4802fe None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:45.995108 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 435/867] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:46.000377 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f4ee9-a82a-44dd-9346-f0c85ee4c3c8 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:46.109236 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f4ee9-a82a-44dd-9346-f0c85ee4c3c8 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:46.145210 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc85827-528a-4024-af43-17f9708876f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:46.145838 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc85827-528a-4024-af43-17f9708876f8 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:46.146112 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc85827-528a-4024-af43-17f9708876f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:46.146401 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc85827-528a-4024-af43-17f9708876f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:46.153659 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc85827-528a-4024-af43-17f9708876f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:46.155811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc85827-528a-4024-af43-17f9708876f8 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:46.169231 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-4cc85827-528a-4024-af43-17f9708876f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:46.169231 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:46.169231 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:46.169231 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:46.169231 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:46.169231 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:46.169231 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:46.169231 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:46.169231 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:46.169231 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:46.169231 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:46.169231 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:46.169231 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 12:07:46.169231 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 12:07:46.169231 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 12:07:46.171792 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 12:07:46.171792 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:46.171792 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:46.171792 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:46.171792 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:46.171792 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:46.171792 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:46.171792 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:46.171792 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:46.171792 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:46.171792 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:46.171792 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:46.171792 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:46.171792 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:46.171792 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:46.171792 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:46.171792 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:46.173902 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 12:07:46.173902 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 12:07:46.173902 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 12:07:46.173902 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 12:07:46.173902 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 12:07:46.173902 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 12:07:46.173902 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:46.173902 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:46.173902 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 433/868] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:07:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:46.177167 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f365c9f-0436-4349-9785-f1f7bb4802fe None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:46.229199 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:46.293348 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f365c9f-0436-4349-9785-f1f7bb4802fe None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:46.293542 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752bee2-0933-4748-b122-451475b996d0 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:46.293801 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752bee2-0933-4748-b122-451475b996d0 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:46.294065 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752bee2-0933-4748-b122-451475b996d0 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:46.295677 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 434/869] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:07:46.301049 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af7029-9fc7-4c64-b36a-5a1e513c594d None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:46.301571 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af7029-9fc7-4c64-b36a-5a1e513c594d None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:46.302071 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af7029-9fc7-4c64-b36a-5a1e513c594d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:46.322391 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-71af7029-9fc7-4c64-b36a-5a1e513c594d None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:46.324112 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-71af7029-9fc7-4c64-b36a-5a1e513c594d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:46.329111 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c23aaf-5378-4c1f-b0e3-7567463e5f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:46.329720 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c23aaf-5378-4c1f-b0e3-7567463e5f84 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:46.329997 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c23aaf-5378-4c1f-b0e3-7567463e5f84 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:46.330264 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c23aaf-5378-4c1f-b0e3-7567463e5f84 None admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:46.330978 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c23aaf-5378-4c1f-b0e3-7567463e5f84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:46.331567 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c23aaf-5378-4c1f-b0e3-7567463e5f84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:46.332987 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c23aaf-5378-4c1f-b0e3-7567463e5f84 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:46.347229 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 436/870] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Sep 21 12:07:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:46.354104 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c23aaf-5378-4c1f-b0e3-7567463e5f84 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:46.358161 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:46.413099 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 435/871] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:46 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 12:07:46.478933 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:46.482098 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c23aaf-5378-4c1f-b0e3-7567463e5f84 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:46.523509 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eccb5be-4b5b-4527-a81a-8afd87f17398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:46.524463 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eccb5be-4b5b-4527-a81a-8afd87f17398 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:46.524926 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eccb5be-4b5b-4527-a81a-8afd87f17398 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:46.525407 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eccb5be-4b5b-4527-a81a-8afd87f17398 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:46.526310 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eccb5be-4b5b-4527-a81a-8afd87f17398 None admin] RBAC: Adding query filter params (role.id=327398b6ec324647b6c4ea84a59a026b, scope.project.id=b0abcc6f2ce14825bfc26e6210889c21, user.id=bbd7a1d5a8d04e3798ffcab27bad936b) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:46.526836 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eccb5be-4b5b-4527-a81a-8afd87f17398 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:46.528457 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eccb5be-4b5b-4527-a81a-8afd87f17398 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:46.535271 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 437/872] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:07:46 2022] GET /identity/v3/role_assignments?user.id=bbd7a1d5a8d04e3798ffcab27bad936b&scope.project.id=b0abcc6f2ce14825bfc26e6210889c21&role.id=327398b6ec324647b6c4ea84a59a026b => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:07:46.569951 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27791181-0c30-49b4-ba62-9c7cd411f9f1 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:46.570573 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27791181-0c30-49b4-ba62-9c7cd411f9f1 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:46.571040 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27791181-0c30-49b4-ba62-9c7cd411f9f1 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:46.572645 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 436/873] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:07:46.580680 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ad2b2-d7ab-4a90-8ef2-28918237d4a6 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:46.581004 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ad2b2-d7ab-4a90-8ef2-28918237d4a6 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:46.581234 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ad2b2-d7ab-4a90-8ef2-28918237d4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:46.601951 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-3e7ad2b2-d7ab-4a90-8ef2-28918237d4a6 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:46.603230 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-3e7ad2b2-d7ab-4a90-8ef2-28918237d4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:46.685552 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 438/874] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:46 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:07:46.729507 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27791181-0c30-49b4-ba62-9c7cd411f9f1 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:46.840219 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27791181-0c30-49b4-ba62-9c7cd411f9f1 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:46.880879 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bec480-b8f6-4f1f-a170-d7fe685de78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:46.881840 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bec480-b8f6-4f1f-a170-d7fe685de78a None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:46.882466 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bec480-b8f6-4f1f-a170-d7fe685de78a None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:46.882968 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bec480-b8f6-4f1f-a170-d7fe685de78a None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:46.883820 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bec480-b8f6-4f1f-a170-d7fe685de78a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:46.885383 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bec480-b8f6-4f1f-a170-d7fe685de78a None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:46.910586 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 437/875] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Sep 21 12:07:46 2022] POST /identity/v3/services => generated 251 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:07:46.957170 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ad2b2-d7ab-4a90-8ef2-28918237d4a6 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:47.077029 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:47.086290 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ad2b2-d7ab-4a90-8ef2-28918237d4a6 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:47.133142 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff1c0d9-7d95-4c34-b0f9-a2330da3bd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:47.133785 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1c0d9-7d95-4c34-b0f9-a2330da3bd02 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:47.134063 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1c0d9-7d95-4c34-b0f9-a2330da3bd02 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:47.134332 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1c0d9-7d95-4c34-b0f9-a2330da3bd02 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:47.134940 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff1c0d9-7d95-4c34-b0f9-a2330da3bd02 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:47.136302 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff1c0d9-7d95-4c34-b0f9-a2330da3bd02 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:47.139202 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a3cdb-2a69-40bd-a1c8-1791bebaaf4d None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:47.139665 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a3cdb-2a69-40bd-a1c8-1791bebaaf4d None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:47.139757 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a3cdb-2a69-40bd-a1c8-1791bebaaf4d None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:47.142427 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 438/876] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:07:47.145851 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-eff1c0d9-7d95-4c34-b0f9-a2330da3bd02 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 12:07:47.145851 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:47.145851 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 12:07:47.145851 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 12:07:47.145851 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 12:07:47.145851 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 12:07:47.145851 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 12:07:47.145851 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:07:47.145851 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 12:07:47.145851 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:47.145851 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 12:07:47.145851 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:47.145851 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:47.145851 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:47.145851 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:47.145851 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:47.145851 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:47.147408 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:47.147408 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:47.147408 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:47.147408 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:47.147408 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:47.147408 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:47.147408 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 12:07:47.147408 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 12:07:47.147408 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 12:07:47.147408 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 12:07:47.147408 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:47.147408 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:47.147408 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:47.147408 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:47.147408 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:47.147408 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:47.148229 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:47.148229 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:47.148229 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:47.148229 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:47.148229 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:47.148229 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:47.148229 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:47.148229 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:47.148229 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:47.148229 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:47.148229 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 12:07:47.148229 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:07:47.148229 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 12:07:47.148229 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:47.151011 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d4ffa-40aa-4879-bb84-c023469b1cee None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:47.151011 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d4ffa-40aa-4879-bb84-c023469b1cee None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:47.151011 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d4ffa-40aa-4879-bb84-c023469b1cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:47.151888 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 439/877] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Sep 21 12:07:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:47.154264 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff1c0d9-7d95-4c34-b0f9-a2330da3bd02 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:47.172898 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-a55d4ffa-40aa-4879-bb84-c023469b1cee None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:47.174099 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a55d4ffa-40aa-4879-bb84-c023469b1cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:47.207650 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:47.291668 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 439/878] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:47 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 12:07:47.295840 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff1c0d9-7d95-4c34-b0f9-a2330da3bd02 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:47.333908 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6413d-92b9-42de-b7fc-90db8dfc0cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:47.334925 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6413d-92b9-42de-b7fc-90db8dfc0cc7 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:47.335355 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6413d-92b9-42de-b7fc-90db8dfc0cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:47.335773 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6413d-92b9-42de-b7fc-90db8dfc0cc7 None admin] PATH_INFO: `/v3/services` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:47.336586 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b6413d-92b9-42de-b7fc-90db8dfc0cc7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:47.337058 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b6413d-92b9-42de-b7fc-90db8dfc0cc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:47.338725 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b6413d-92b9-42de-b7fc-90db8dfc0cc7 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:47.344787 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 440/879] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Sep 21 12:07:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:07:47.352852 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d4ffa-40aa-4879-bb84-c023469b1cee None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:47.460778 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d4ffa-40aa-4879-bb84-c023469b1cee None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:47.499266 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc404e8-8334-43cc-817f-2661513068aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:47.499879 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc404e8-8334-43cc-817f-2661513068aa None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:47.500157 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc404e8-8334-43cc-817f-2661513068aa None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:47.500433 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc404e8-8334-43cc-817f-2661513068aa None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:47.501070 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc404e8-8334-43cc-817f-2661513068aa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:47.501370 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc404e8-8334-43cc-817f-2661513068aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:47.502776 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc404e8-8334-43cc-817f-2661513068aa None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:47.508394 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 440/880] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Sep 21 12:07:47 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:47.558433 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6413d-92b9-42de-b7fc-90db8dfc0cc7 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:47.593522 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:47.692946 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6413d-92b9-42de-b7fc-90db8dfc0cc7 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:47.730612 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392698e8-a7c0-497d-8b24-ad201eb75517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:47.731154 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392698e8-a7c0-497d-8b24-ad201eb75517 None admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:47.731435 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392698e8-a7c0-497d-8b24-ad201eb75517 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:47.731706 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392698e8-a7c0-497d-8b24-ad201eb75517 None admin] PATH_INFO: `/v3/services` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:47.732362 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392698e8-a7c0-497d-8b24-ad201eb75517 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:47.733743 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392698e8-a7c0-497d-8b24-ad201eb75517 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:47.751063 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 441/881] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Sep 21 12:07:47 2022] POST /identity/v3/services => generated 269 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:07:48.951321 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbef84a-7afd-495e-8dbf-41064790cde8 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:48.951846 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbef84a-7afd-495e-8dbf-41064790cde8 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:48.951846 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbef84a-7afd-495e-8dbf-41064790cde8 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:48.953431 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 441/882] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:07:48.959211 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce97622-1726-4a09-8adb-ed02bcf1c4e5 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:48.959668 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce97622-1726-4a09-8adb-ed02bcf1c4e5 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:48.959872 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce97622-1726-4a09-8adb-ed02bcf1c4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:48.978825 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-7ce97622-1726-4a09-8adb-ed02bcf1c4e5 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:48.980032 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-7ce97622-1726-4a09-8adb-ed02bcf1c4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:49.062502 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 442/883] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:48 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:07:49.276537 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578c9c6-bd34-44b9-b148-aa25a70810c9 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:49.276736 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578c9c6-bd34-44b9-b148-aa25a70810c9 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:49.277006 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578c9c6-bd34-44b9-b148-aa25a70810c9 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:49.278492 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 442/884] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:07:49.284118 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d7b0c-eb16-44a6-8bf9-fcc6e72e58f8 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:49.284405 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d7b0c-eb16-44a6-8bf9-fcc6e72e58f8 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:49.284682 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d7b0c-eb16-44a6-8bf9-fcc6e72e58f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:49.296972 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:49.312544 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-101d7b0c-eb16-44a6-8bf9-fcc6e72e58f8 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:49.314119 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-101d7b0c-eb16-44a6-8bf9-fcc6e72e58f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:49.350898 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6578c9c6-bd34-44b9-b148-aa25a70810c9 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:49.375320 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:49.392675 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 443/885] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:49 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:07:49.468964 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6578c9c6-bd34-44b9-b148-aa25a70810c9 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:49.514182 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0b337-b9c7-4918-be26-a9b223391a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:49.514868 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0b337-b9c7-4918-be26-a9b223391a50 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:49.515150 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0b337-b9c7-4918-be26-a9b223391a50 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:49.515422 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0b337-b9c7-4918-be26-a9b223391a50 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:49.527742 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e0b337-b9c7-4918-be26-a9b223391a50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:07:49.532684 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-26e0b337-b9c7-4918-be26-a9b223391a50 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 12:07:49.532684 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:49.532684 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:49.532684 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:49.532684 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:49.532684 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:49.532684 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:49.532684 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:49.532684 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:49.532684 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:49.532684 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:49.532684 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:49.532684 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:07:49.532684 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:07:49.532684 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:07:49.532684 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:07:49.533641 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:07:49.533641 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:07:49.533641 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:07:49.533641 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:07:49.533641 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:49.533641 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:49.533641 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:49.533641 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:49.533641 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:49.533641 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:49.533641 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:49.533641 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:49.533641 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:49.533641 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:49.533641 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:49.533641 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:49.534510 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:49.534510 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:49.534510 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:49.534510 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:49.534510 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:07:49.534510 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:07:49.534510 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:07:49.534510 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:07:49.534510 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:07:49.534510 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:07:49.534510 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 12:07:49.534510 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:49.534510 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 443/886] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Sep 21 12:07:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:49.540129 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d7b0c-eb16-44a6-8bf9-fcc6e72e58f8 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:49.657037 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d7b0c-eb16-44a6-8bf9-fcc6e72e58f8 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:49.698707 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652585b5-5c02-4d70-82e8-edf72760dfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:49.699685 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652585b5-5c02-4d70-82e8-edf72760dfc0 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:49.700200 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652585b5-5c02-4d70-82e8-edf72760dfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:49.700689 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652585b5-5c02-4d70-82e8-edf72760dfc0 None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:49.701551 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652585b5-5c02-4d70-82e8-edf72760dfc0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:49.702061 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652585b5-5c02-4d70-82e8-edf72760dfc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:49.703649 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652585b5-5c02-4d70-82e8-edf72760dfc0 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:49.710018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0b337-b9c7-4918-be26-a9b223391a50 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:49.713826 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 444/887] 10.222.0.60 () {56 vars in 1115 bytes} [Wed Sep 21 12:07:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:49.714310 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:49.720296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652585b5-5c02-4d70-82e8-edf72760dfc0 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:49.807915 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:49.834177 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0b337-b9c7-4918-be26-a9b223391a50 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:49.834499 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652585b5-5c02-4d70-82e8-edf72760dfc0 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:49.871138 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2315e-69a4-47e1-9bbf-7a7b68234527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:49.871773 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2315e-69a4-47e1-9bbf-7a7b68234527 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:49.872104 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2315e-69a4-47e1-9bbf-7a7b68234527 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:49.872416 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2315e-69a4-47e1-9bbf-7a7b68234527 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:49.872693 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d4aa3-aad2-4c47-949b-f26d1feb9644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:49.872982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2315e-69a4-47e1-9bbf-7a7b68234527 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:49.873382 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d4aa3-aad2-4c47-949b-f26d1feb9644 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:49.873664 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d4aa3-aad2-4c47-949b-f26d1feb9644 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:49.873935 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d4aa3-aad2-4c47-949b-f26d1feb9644 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:49.874548 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2315e-69a4-47e1-9bbf-7a7b68234527 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:49.885188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-58d2315e-69a4-47e1-9bbf-7a7b68234527 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 21 12:07:49.885188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:49.885188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 12:07:49.885188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 12:07:49.885188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 12:07:49.885188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 12:07:49.885188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 12:07:49.885188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:07:49.885188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 21 12:07:49.885188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:49.885188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 12:07:49.885188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:49.885188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:49.885188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:49.885188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:49.885188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:49.885188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:49.886213 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:49.886213 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:49.886213 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:49.886213 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:49.886213 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:49.886213 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:49.886213 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 12:07:49.886213 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 12:07:49.886213 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 12:07:49.886213 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 12:07:49.886213 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:49.886213 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:49.886213 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:49.886213 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:49.886213 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:49.886213 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:49.887094 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:49.887094 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:49.887094 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:49.887094 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:49.887094 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:49.887094 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:49.887094 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:49.887094 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:49.887094 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:49.887094 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:49.887094 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 12:07:49.887094 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:07:49.887094 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 21 12:07:49.887094 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:49.888105 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98d4aa3-aad2-4c47-949b-f26d1feb9644 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:49.888105 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98d4aa3-aad2-4c47-949b-f26d1feb9644 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:49.891388 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 444/888] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Sep 21 12:07:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:49.892884 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c1932-f195-4a26-ace7-bda1bc5cb9c1 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:49.893177 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c1932-f195-4a26-ace7-bda1bc5cb9c1 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:49.893451 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c1932-f195-4a26-ace7-bda1bc5cb9c1 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:49.898840 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 445/889] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:07:49.898840 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c1932-f195-4a26-ace7-bda1bc5cb9c1 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:49.904987 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-c98d4aa3-aad2-4c47-949b-f26d1feb9644 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:49.904987 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:49.904987 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:49.904987 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:49.904987 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:49.904987 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:49.904987 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:49.904987 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:49.904987 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:49.904987 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:49.904987 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:49.904987 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:49.904987 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:49.904987 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:49.904987 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:49.904987 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:49.905957 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:49.905957 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:49.905957 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:49.905957 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:49.905957 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:49.905957 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:49.905957 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:49.905957 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:49.905957 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:49.905957 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:49.905957 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:49.905957 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:49.905957 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:49.905957 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:49.905957 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:49.905957 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:49.905957 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:49.906879 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:49.906879 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:49.906879 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:49.910729 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 445/890] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:49.913116 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69a4cb-e8d5-4703-8534-1235ba0d9646 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:49.913399 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69a4cb-e8d5-4703-8534-1235ba0d9646 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:49.913668 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69a4cb-e8d5-4703-8534-1235ba0d9646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:49.937226 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-8d69a4cb-e8d5-4703-8534-1235ba0d9646 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:49.938503 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-8d69a4cb-e8d5-4703-8534-1235ba0d9646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:49.984660 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:50.010639 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 446/891] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:49 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:07:50.019501 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69a4cb-e8d5-4703-8534-1235ba0d9646 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:50.035017 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c1932-f195-4a26-ace7-bda1bc5cb9c1 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:50.075115 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb88737-bba5-4d30-a6d4-ac879bf6a56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:50.075680 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb88737-bba5-4d30-a6d4-ac879bf6a56b None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:50.075923 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb88737-bba5-4d30-a6d4-ac879bf6a56b None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:50.076165 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb88737-bba5-4d30-a6d4-ac879bf6a56b None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:50.076786 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb88737-bba5-4d30-a6d4-ac879bf6a56b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:50.077097 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb88737-bba5-4d30-a6d4-ac879bf6a56b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:50.078520 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb88737-bba5-4d30-a6d4-ac879bf6a56b None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:50.086912 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 446/892] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Sep 21 12:07:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:50.086912 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571e811-14b8-4e14-b016-1fa73d2a158a None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:50.086912 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571e811-14b8-4e14-b016-1fa73d2a158a None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:50.086912 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571e811-14b8-4e14-b016-1fa73d2a158a None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:50.088199 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 447/893] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:07:50.093406 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571e811-14b8-4e14-b016-1fa73d2a158a None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:50.103547 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:50.159402 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69a4cb-e8d5-4703-8534-1235ba0d9646 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:50.199713 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45629eaf-d4c3-412c-8241-23aec0f15ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:50.200386 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45629eaf-d4c3-412c-8241-23aec0f15ccc None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:50.200671 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45629eaf-d4c3-412c-8241-23aec0f15ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:50.200944 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45629eaf-d4c3-412c-8241-23aec0f15ccc None admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:50.201641 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45629eaf-d4c3-412c-8241-23aec0f15ccc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:50.201949 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45629eaf-d4c3-412c-8241-23aec0f15ccc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:50.203456 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45629eaf-d4c3-412c-8241-23aec0f15ccc None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:50.218745 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 447/894] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:50.220869 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54036b-eea1-4799-b56f-3977c4de39b7 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:50.221374 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54036b-eea1-4799-b56f-3977c4de39b7 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:50.222300 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54036b-eea1-4799-b56f-3977c4de39b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:50.226568 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571e811-14b8-4e14-b016-1fa73d2a158a None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:50.244788 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-1c54036b-eea1-4799-b56f-3977c4de39b7 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:50.246063 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-1c54036b-eea1-4799-b56f-3977c4de39b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:50.267547 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd0d43-af99-4076-a61e-edc68e0052ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:50.268169 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd0d43-af99-4076-a61e-edc68e0052ca None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:50.268461 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd0d43-af99-4076-a61e-edc68e0052ca None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:50.268725 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd0d43-af99-4076-a61e-edc68e0052ca None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:50.269371 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd0d43-af99-4076-a61e-edc68e0052ca None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:50.269674 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd0d43-af99-4076-a61e-edc68e0052ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:50.272069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd0d43-af99-4076-a61e-edc68e0052ca None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:50.277747 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 448/895] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Sep 21 12:07:50 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:50.278621 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd0d43-af99-4076-a61e-edc68e0052ca None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:50.281772 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:50.323657 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 448/896] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:50 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:07:50.324593 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54036b-eea1-4799-b56f-3977c4de39b7 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:50.356271 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:50.393324 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd0d43-af99-4076-a61e-edc68e0052ca None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:50.431711 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533bc3d4-3d11-46af-acb4-975eb6844874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:50.432348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bc3d4-3d11-46af-acb4-975eb6844874 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:50.432627 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bc3d4-3d11-46af-acb4-975eb6844874 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:50.432901 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bc3d4-3d11-46af-acb4-975eb6844874 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:50.437231 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54036b-eea1-4799-b56f-3977c4de39b7 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:50.441494 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533bc3d4-3d11-46af-acb4-975eb6844874 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:50.442969 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533bc3d4-3d11-46af-acb4-975eb6844874 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:50.455714 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-533bc3d4-3d11-46af-acb4-975eb6844874 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 12:07:50.455714 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:50.455714 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:50.455714 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:50.455714 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:50.455714 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:50.455714 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:50.455714 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:50.455714 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:50.455714 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:50.455714 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:50.455714 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:50.455714 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 12:07:50.455714 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 12:07:50.455714 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 12:07:50.455714 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 12:07:50.456725 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:50.456725 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:50.456725 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 12:07:50.456725 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:50.456725 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 12:07:50.456725 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:50.456725 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:50.456725 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:50.456725 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:50.456725 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:50.456725 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:50.456725 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:50.456725 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:50.456725 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:50.456725 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:50.456725 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:50.456725 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:50.456725 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:50.462922 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:50.462922 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:50.462922 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 12:07:50.462922 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 12:07:50.462922 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 12:07:50.462922 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 12:07:50.462922 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 12:07:50.462922 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 12:07:50.462922 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 12:07:50.462922 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:50.462922 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 449/897] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Sep 21 12:07:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:50.462922 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533bc3d4-3d11-46af-acb4-975eb6844874 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:50.480834 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897aab65-05e3-4a14-880e-3bac420b5ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:50.481443 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897aab65-05e3-4a14-880e-3bac420b5ce0 None admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:50.481724 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897aab65-05e3-4a14-880e-3bac420b5ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:50.481987 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897aab65-05e3-4a14-880e-3bac420b5ce0 None admin] PATH_INFO: `/v3/services` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:50.482673 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897aab65-05e3-4a14-880e-3bac420b5ce0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:50.484032 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897aab65-05e3-4a14-880e-3bac420b5ce0 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:50.499212 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 449/898] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Sep 21 12:07:50 2022] POST /identity/v3/services => generated 241 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:07:50.500028 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897aab65-05e3-4a14-880e-3bac420b5ce0 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:50.545191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:50.611415 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533bc3d4-3d11-46af-acb4-975eb6844874 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:50.644195 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:50.655992 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897aab65-05e3-4a14-880e-3bac420b5ce0 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:50.659549 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e792f-dc05-4dc5-9b6d-27ba7bfeb3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:50.660177 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e792f-dc05-4dc5-9b6d-27ba7bfeb3cc None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:50.660459 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e792f-dc05-4dc5-9b6d-27ba7bfeb3cc None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:50.660724 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e792f-dc05-4dc5-9b6d-27ba7bfeb3cc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:50.661440 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e792f-dc05-4dc5-9b6d-27ba7bfeb3cc None admin] RBAC: Adding query filter params (interface=public, service_id=b612da16ddbb4d9a9c8c19cc32d3298e, region_id=RegionOne) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:50.661754 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e792f-dc05-4dc5-9b6d-27ba7bfeb3cc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:50.663743 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e792f-dc05-4dc5-9b6d-27ba7bfeb3cc None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:50.674054 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 450/899] 10.222.0.60 () {56 vars in 1251 bytes} [Wed Sep 21 12:07:50 2022] GET /identity/v3/endpoints?service_id=b612da16ddbb4d9a9c8c19cc32d3298e&interface=public®ion_id=RegionOne => generated 194 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:50.674054 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e792f-dc05-4dc5-9b6d-27ba7bfeb3cc None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:50.701947 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a8477-d76f-49ab-be36-2e0345794f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:50.702597 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a8477-d76f-49ab-be36-2e0345794f6a None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:50.702872 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a8477-d76f-49ab-be36-2e0345794f6a None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:50.703144 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a8477-d76f-49ab-be36-2e0345794f6a None admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:50.703886 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a8477-d76f-49ab-be36-2e0345794f6a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:50.705089 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a8477-d76f-49ab-be36-2e0345794f6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:50.706579 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a8477-d76f-49ab-be36-2e0345794f6a None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:50.730785 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 450/900] 10.222.0.60 () {56 vars in 1149 bytes} [Wed Sep 21 12:07:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:50.731162 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a8477-d76f-49ab-be36-2e0345794f6a None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:50.789715 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e792f-dc05-4dc5-9b6d-27ba7bfeb3cc None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:50.822278 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:50.829319 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad9f5bf-31cc-4a33-94ac-69b77979fd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:50.829962 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9f5bf-31cc-4a33-94ac-69b77979fd57 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:50.830246 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9f5bf-31cc-4a33-94ac-69b77979fd57 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:50.830569 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9f5bf-31cc-4a33-94ac-69b77979fd57 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:50.831162 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad9f5bf-31cc-4a33-94ac-69b77979fd57 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:50.832542 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad9f5bf-31cc-4a33-94ac-69b77979fd57 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:50.842115 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-4ad9f5bf-31cc-4a33-94ac-69b77979fd57 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 21 12:07:50.842115 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:50.842115 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 12:07:50.842115 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 12:07:50.842115 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 12:07:50.842115 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 12:07:50.842115 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 12:07:50.842115 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:07:50.842115 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 21 12:07:50.842115 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:50.842115 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 12:07:50.842115 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:50.842115 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:50.842115 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:50.842115 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:50.842115 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:50.843098 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:50.843098 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:50.843098 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:50.843098 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:50.843098 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:50.843098 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:50.843098 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:50.843098 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 12:07:50.843098 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 12:07:50.843098 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 12:07:50.843098 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 12:07:50.843098 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:50.843098 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:50.843098 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:50.843098 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:50.843098 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:50.843098 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:50.847702 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:50.847702 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:50.847702 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:50.847702 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:50.847702 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:50.847702 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:50.847702 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:50.847702 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:50.847702 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:50.847702 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:50.847702 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 12:07:50.847702 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:07:50.847702 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 21 12:07:50.847702 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:50.847702 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 451/901] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Sep 21 12:07:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:50.848497 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a8477-d76f-49ab-be36-2e0345794f6a None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:50.848580 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad9f5bf-31cc-4a33-94ac-69b77979fd57 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:50.884572 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f374e-e86d-4108-8f6e-7d522151bdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:50.885118 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f374e-e86d-4108-8f6e-7d522151bdcf None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:50.885398 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f374e-e86d-4108-8f6e-7d522151bdcf None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:50.885669 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f374e-e86d-4108-8f6e-7d522151bdcf None admin] PATH_INFO: `/v3/services` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:50.886282 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f374e-e86d-4108-8f6e-7d522151bdcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:50.887964 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f374e-e86d-4108-8f6e-7d522151bdcf None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:50.898088 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 451/902] 10.222.0.60 () {56 vars in 1087 bytes} [Wed Sep 21 12:07:50 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:07:50.898575 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f374e-e86d-4108-8f6e-7d522151bdcf None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:50.939144 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:51.013801 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad9f5bf-31cc-4a33-94ac-69b77979fd57 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:51.063151 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f374e-e86d-4108-8f6e-7d522151bdcf None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:51.072984 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f89527-6e29-4770-96fc-a9edd63869ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:51.073681 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f89527-6e29-4770-96fc-a9edd63869ca None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:51.073966 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f89527-6e29-4770-96fc-a9edd63869ca None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:51.074232 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f89527-6e29-4770-96fc-a9edd63869ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:51.107873 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82fa470-e456-42d9-b431-0446ecb577d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:51.108899 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82fa470-e456-42d9-b431-0446ecb577d1 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:51.109397 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82fa470-e456-42d9-b431-0446ecb577d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:51.109754 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82fa470-e456-42d9-b431-0446ecb577d1 None admin] PATH_INFO: `/v3/services` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:51.110506 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82fa470-e456-42d9-b431-0446ecb577d1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:51.110880 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82fa470-e456-42d9-b431-0446ecb577d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:51.112432 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82fa470-e456-42d9-b431-0446ecb577d1 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:51.118410 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 452/903] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Sep 21 12:07:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:51.124306 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82fa470-e456-42d9-b431-0446ecb577d1 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:51.139827 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:51.160551 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f89527-6e29-4770-96fc-a9edd63869ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:51.162940 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f89527-6e29-4770-96fc-a9edd63869ca None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:51.237583 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:51.242774 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82fa470-e456-42d9-b431-0446ecb577d1 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:51.289435 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc4645-e363-41a9-9cd7-cee1dca7a11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:51.290336 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc4645-e363-41a9-9cd7-cee1dca7a11b None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:51.290807 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc4645-e363-41a9-9cd7-cee1dca7a11b None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:51.291394 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc4645-e363-41a9-9cd7-cee1dca7a11b None admin] PATH_INFO: `/v3/services` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:51.292293 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc4645-e363-41a9-9cd7-cee1dca7a11b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:51.292750 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc4645-e363-41a9-9cd7-cee1dca7a11b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:51.294425 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc4645-e363-41a9-9cd7-cee1dca7a11b None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:51.300666 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 453/904] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Sep 21 12:07:51 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:51.310461 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 452/905] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:07:50 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 12:07:51.310992 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc4645-e363-41a9-9cd7-cee1dca7a11b None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:51.311869 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f89527-6e29-4770-96fc-a9edd63869ca None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:51.405122 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:51.443849 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f89527-6e29-4770-96fc-a9edd63869ca None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:51.444077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc4645-e363-41a9-9cd7-cee1dca7a11b None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:51.485332 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d13f6-2c0b-4645-bc1c-785a09c7cd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:51.486303 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d13f6-2c0b-4645-bc1c-785a09c7cd40 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:51.486830 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d13f6-2c0b-4645-bc1c-785a09c7cd40 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:51.487324 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d13f6-2c0b-4645-bc1c-785a09c7cd40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:51.492971 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a682f-0626-45bd-a21b-93418aa23701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:51.493656 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a682f-0626-45bd-a21b-93418aa23701 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:51.493938 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a682f-0626-45bd-a21b-93418aa23701 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:51.494209 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a682f-0626-45bd-a21b-93418aa23701 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:51.494947 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6a682f-0626-45bd-a21b-93418aa23701 None admin] RBAC: Adding query filter params (interface=public, service_id=f0f7cdd477b94d9aa2ccdc0a8e4f4058, region_id=RegionOne) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:51.495257 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6a682f-0626-45bd-a21b-93418aa23701 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:51.496623 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6a682f-0626-45bd-a21b-93418aa23701 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:51.501820 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d13f6-2c0b-4645-bc1c-785a09c7cd40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:51.503605 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d13f6-2c0b-4645-bc1c-785a09c7cd40 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:51.506521 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 454/906] 10.222.0.60 () {56 vars in 1251 bytes} [Wed Sep 21 12:07:51 2022] GET /identity/v3/endpoints?service_id=f0f7cdd477b94d9aa2ccdc0a8e4f4058&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:51.509541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a682f-0626-45bd-a21b-93418aa23701 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:51.523947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-1e0d13f6-2c0b-4645-bc1c-785a09c7cd40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:51.523947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:51.523947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:51.523947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:51.523947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:51.523947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:51.523947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:51.523947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:51.523947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:51.523947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:51.523947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:51.523947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:51.523947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:51.523947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:51.523947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:51.523947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:51.524958 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:51.524958 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:51.524958 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:51.524958 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:51.524958 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:51.524958 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:51.524958 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:51.524958 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:51.524958 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:51.524958 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:51.524958 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:51.524958 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:51.524958 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:51.524958 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:51.524958 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:51.524958 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:51.524958 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:51.531039 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:51.531039 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:51.531039 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:51.531039 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 453/907] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:51.531039 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d13f6-2c0b-4645-bc1c-785a09c7cd40 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:51.542990 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:51.640272 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a682f-0626-45bd-a21b-93418aa23701 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:51.652878 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d13f6-2c0b-4645-bc1c-785a09c7cd40 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:51.680191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b7a6d-cc26-468d-8983-b4f2a58939db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:51.680812 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b7a6d-cc26-468d-8983-b4f2a58939db None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:51.681166 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b7a6d-cc26-468d-8983-b4f2a58939db None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:51.681515 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b7a6d-cc26-468d-8983-b4f2a58939db None admin] PATH_INFO: `/v3/services` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:51.682402 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b7a6d-cc26-468d-8983-b4f2a58939db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:51.684069 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b7a6d-cc26-468d-8983-b4f2a58939db None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:51.698388 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 455/908] 10.222.0.60 () {56 vars in 1087 bytes} [Wed Sep 21 12:07:51 2022] GET /identity/v3/services => generated 1497 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:07:51.702610 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f518acf-51d4-4e11-96d7-e79c9bf9b79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:51.703241 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f518acf-51d4-4e11-96d7-e79c9bf9b79a None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:51.703526 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f518acf-51d4-4e11-96d7-e79c9bf9b79a None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:51.703800 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f518acf-51d4-4e11-96d7-e79c9bf9b79a None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:51.704469 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f518acf-51d4-4e11-96d7-e79c9bf9b79a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:51.704771 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f518acf-51d4-4e11-96d7-e79c9bf9b79a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:51.706193 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f518acf-51d4-4e11-96d7-e79c9bf9b79a None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:51.721909 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 454/909] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:07:51.728190 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b7a6d-cc26-468d-8983-b4f2a58939db None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:51.731699 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:51.851695 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b7a6d-cc26-468d-8983-b4f2a58939db None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:51.892939 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a76e1-a0f4-4b32-8f26-63247a4f3fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:51.893615 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a76e1-a0f4-4b32-8f26-63247a4f3fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:51.893897 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a76e1-a0f4-4b32-8f26-63247a4f3fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:51.894170 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a76e1-a0f4-4b32-8f26-63247a4f3fb7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:51.903542 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a76e1-a0f4-4b32-8f26-63247a4f3fb7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:51.905088 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a76e1-a0f4-4b32-8f26-63247a4f3fb7 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:51.921288 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-324a76e1-a0f4-4b32-8f26-63247a4f3fb7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:51.921288 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:51.921288 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:51.921288 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:51.921288 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:51.921288 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:51.921288 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:51.921288 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:51.921288 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:51.921288 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:51.921288 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:51.921288 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:51.921288 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 12:07:51.921288 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 12:07:51.921288 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 12:07:51.922222 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 12:07:51.922222 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:51.922222 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:51.922222 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:51.922222 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:51.922222 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:51.922222 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:51.922222 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:51.922222 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:51.922222 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:51.922222 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:51.922222 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:51.922222 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:51.922222 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:51.922222 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:51.922222 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:51.922222 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:51.923206 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 12:07:51.923206 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 12:07:51.923206 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 12:07:51.923206 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 12:07:51.923206 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 12:07:51.923206 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 12:07:51.923206 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:51.923206 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:51.923206 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 456/910] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:07:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:51.931597 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f518acf-51d4-4e11-96d7-e79c9bf9b79a None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:52.003388 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:52.039374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f518acf-51d4-4e11-96d7-e79c9bf9b79a None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:52.074802 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b5cb8-54e3-41be-9505-3debdc97f007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:52.075477 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b5cb8-54e3-41be-9505-3debdc97f007 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:52.075706 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b5cb8-54e3-41be-9505-3debdc97f007 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:52.075941 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b5cb8-54e3-41be-9505-3debdc97f007 None admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:52.076633 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b5cb8-54e3-41be-9505-3debdc97f007 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:52.076930 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b5cb8-54e3-41be-9505-3debdc97f007 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:52.078375 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b5cb8-54e3-41be-9505-3debdc97f007 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:52.091246 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 455/911] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Sep 21 12:07:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:52.097284 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a76e1-a0f4-4b32-8f26-63247a4f3fb7 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:52.173440 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:52.219397 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a76e1-a0f4-4b32-8f26-63247a4f3fb7 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:52.261729 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456c535-7500-4128-9a32-d56f48216e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:52.262632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456c535-7500-4128-9a32-d56f48216e66 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:52.262914 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456c535-7500-4128-9a32-d56f48216e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:52.263184 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456c535-7500-4128-9a32-d56f48216e66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:52.263940 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456c535-7500-4128-9a32-d56f48216e66 None admin] RBAC: Adding query filter params (role.id=a0f76a5a7b9c4af794c33ce6078ca7be, scope.project.id=b0abcc6f2ce14825bfc26e6210889c21, user.id=bbd7a1d5a8d04e3798ffcab27bad936b) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:52.264251 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456c535-7500-4128-9a32-d56f48216e66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:52.265754 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456c535-7500-4128-9a32-d56f48216e66 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:52.273213 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 457/912] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:07:52 2022] GET /identity/v3/role_assignments?user.id=bbd7a1d5a8d04e3798ffcab27bad936b&scope.project.id=b0abcc6f2ce14825bfc26e6210889c21&role.id=a0f76a5a7b9c4af794c33ce6078ca7be => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:52.832068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e649ac0-c114-4f62-ac6d-5154d642a9bc None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:52.832250 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e649ac0-c114-4f62-ac6d-5154d642a9bc None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:52.832534 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e649ac0-c114-4f62-ac6d-5154d642a9bc None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:52.834079 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 456/913] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:07:52.840145 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b2e93-f737-486e-b53d-98fb5d115fa4 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:52.840483 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b2e93-f737-486e-b53d-98fb5d115fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:52.840699 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b2e93-f737-486e-b53d-98fb5d115fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:52.860890 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-3c0b2e93-f737-486e-b53d-98fb5d115fa4 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:52.862124 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-3c0b2e93-f737-486e-b53d-98fb5d115fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:52.942730 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 458/914] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:07:53.212067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e649ac0-c114-4f62-ac6d-5154d642a9bc None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:53.252981 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e0707-ab65-4394-9e9d-eb25b884d320 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:53.253961 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e0707-ab65-4394-9e9d-eb25b884d320 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:53.254466 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e0707-ab65-4394-9e9d-eb25b884d320 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:53.256295 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 459/915] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:07:53.261408 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1477f93-14a7-4367-9db6-ce69077ed3b4 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:53.261916 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1477f93-14a7-4367-9db6-ce69077ed3b4 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:53.262673 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1477f93-14a7-4367-9db6-ce69077ed3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:53.284130 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-c1477f93-14a7-4367-9db6-ce69077ed3b4 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:53.285659 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-c1477f93-14a7-4367-9db6-ce69077ed3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:53.327973 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e649ac0-c114-4f62-ac6d-5154d642a9bc None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:53.345837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:53.359901 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:53.373881 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 460/916] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:07:53.376420 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bcb55-bc49-4fc7-b092-0cb5d78519c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:53.377277 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bcb55-bc49-4fc7-b092-0cb5d78519c8 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:53.377757 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bcb55-bc49-4fc7-b092-0cb5d78519c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:53.378248 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bcb55-bc49-4fc7-b092-0cb5d78519c8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:53.379084 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362bcb55-bc49-4fc7-b092-0cb5d78519c8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:53.381285 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362bcb55-bc49-4fc7-b092-0cb5d78519c8 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:53.391021 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-362bcb55-bc49-4fc7-b092-0cb5d78519c8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 12:07:53.391021 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:53.391021 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 12:07:53.391021 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 12:07:53.391021 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 12:07:53.391021 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 12:07:53.391021 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 12:07:53.391021 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:07:53.391021 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 12:07:53.391021 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:53.391021 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 12:07:53.391021 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:53.391021 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:53.391021 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:53.391021 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:53.391021 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:53.391021 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:53.392047 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:53.392047 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:53.392047 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:53.392047 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:53.392047 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:53.392047 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:53.392047 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 12:07:53.392047 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 12:07:53.392047 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 12:07:53.392047 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 12:07:53.392047 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:53.392047 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:53.392047 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:53.392047 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:53.392047 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:53.392047 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:53.392899 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:53.392899 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:53.392899 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:53.392899 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:53.392899 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:53.392899 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:53.392899 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:53.392899 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:53.392899 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:53.392899 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:53.392899 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 12:07:53.392899 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:07:53.392899 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 12:07:53.392899 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:53.395685 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 457/917] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Sep 21 12:07:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:53.402090 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1477f93-14a7-4367-9db6-ce69077ed3b4 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:53.509941 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1477f93-14a7-4367-9db6-ce69077ed3b4 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:53.547294 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b182c5-2d5d-47b2-b9d2-c34fb79d180f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:53.547922 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b182c5-2d5d-47b2-b9d2-c34fb79d180f None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:53.548204 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b182c5-2d5d-47b2-b9d2-c34fb79d180f None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:53.548477 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b182c5-2d5d-47b2-b9d2-c34fb79d180f None admin] PATH_INFO: `/v3/services` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:53.549140 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b182c5-2d5d-47b2-b9d2-c34fb79d180f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:53.549414 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b182c5-2d5d-47b2-b9d2-c34fb79d180f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:53.550924 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b182c5-2d5d-47b2-b9d2-c34fb79d180f None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:53.557146 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 461/918] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Sep 21 12:07:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:53.564424 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bcb55-bc49-4fc7-b092-0cb5d78519c8 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:53.658158 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b182c5-2d5d-47b2-b9d2-c34fb79d180f None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:53.691517 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bcb55-bc49-4fc7-b092-0cb5d78519c8 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:53.711890 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:53.741293 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6737cf0-9d95-42a0-8806-93bffd46c032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:53.741908 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6737cf0-9d95-42a0-8806-93bffd46c032 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:53.742183 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6737cf0-9d95-42a0-8806-93bffd46c032 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:53.742478 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6737cf0-9d95-42a0-8806-93bffd46c032 None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:53.743633 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6737cf0-9d95-42a0-8806-93bffd46c032 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:53.743938 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6737cf0-9d95-42a0-8806-93bffd46c032 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:53.745886 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6737cf0-9d95-42a0-8806-93bffd46c032 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:53.756494 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 458/919] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Sep 21 12:07:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:53.757712 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6737cf0-9d95-42a0-8806-93bffd46c032 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:53.771817 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b182c5-2d5d-47b2-b9d2-c34fb79d180f None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:53.812010 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b056e5-1bc7-4016-84a3-48ccbbd3f0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:53.813020 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b056e5-1bc7-4016-84a3-48ccbbd3f0ff None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:53.813495 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b056e5-1bc7-4016-84a3-48ccbbd3f0ff None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:53.813959 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b056e5-1bc7-4016-84a3-48ccbbd3f0ff None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:53.814789 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b056e5-1bc7-4016-84a3-48ccbbd3f0ff None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:53.816449 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b056e5-1bc7-4016-84a3-48ccbbd3f0ff None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:53.826504 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-30b056e5-1bc7-4016-84a3-48ccbbd3f0ff None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 21 12:07:53.826504 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:53.826504 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 12:07:53.826504 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 12:07:53.826504 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 12:07:53.826504 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 12:07:53.826504 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 12:07:53.826504 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:07:53.826504 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 21 12:07:53.826504 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:53.826504 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 12:07:53.826504 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:53.826504 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:53.826504 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:53.826504 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:53.826504 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:53.826504 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:53.827532 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:53.827532 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:53.827532 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:53.827532 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:53.827532 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:53.827532 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:53.827532 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 12:07:53.827532 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 12:07:53.827532 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 12:07:53.827532 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 12:07:53.827532 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:53.827532 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:53.827532 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:53.827532 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:53.827532 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:53.827532 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:53.828389 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:53.828389 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:53.828389 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:53.828389 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:53.828389 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:53.828389 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:53.828389 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:53.828389 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:53.828389 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:53.828389 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:53.828389 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 12:07:53.828389 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:07:53.828389 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 21 12:07:53.828389 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:53.830813 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:53.835605 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 462/920] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Sep 21 12:07:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:53.837160 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b056e5-1bc7-4016-84a3-48ccbbd3f0ff None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:53.882954 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6737cf0-9d95-42a0-8806-93bffd46c032 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:53.923495 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f45204-6e1b-40e7-bf24-52fe48d468d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:53.924659 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f45204-6e1b-40e7-bf24-52fe48d468d7 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:53.925093 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f45204-6e1b-40e7-bf24-52fe48d468d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:53.926467 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f45204-6e1b-40e7-bf24-52fe48d468d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:53.927346 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f45204-6e1b-40e7-bf24-52fe48d468d7 None admin] RBAC: Adding query filter params (interface=public, service_id=3c7f97c16c6c43ac9abed947b57d7c62, region_id=RegionOne) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:53.928454 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f45204-6e1b-40e7-bf24-52fe48d468d7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:53.930010 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f45204-6e1b-40e7-bf24-52fe48d468d7 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:53.937895 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 459/921] 10.222.0.60 () {56 vars in 1251 bytes} [Wed Sep 21 12:07:53 2022] GET /identity/v3/endpoints?service_id=3c7f97c16c6c43ac9abed947b57d7c62&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:53.944380 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f45204-6e1b-40e7-bf24-52fe48d468d7 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:53.964685 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b056e5-1bc7-4016-84a3-48ccbbd3f0ff None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:53.981362 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:54.007673 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97533c74-8f35-4644-ac21-fce4330fedc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:54.008302 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97533c74-8f35-4644-ac21-fce4330fedc6 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:54.008621 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97533c74-8f35-4644-ac21-fce4330fedc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:54.008893 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97533c74-8f35-4644-ac21-fce4330fedc6 None admin] PATH_INFO: `/v3/services` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:54.009525 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97533c74-8f35-4644-ac21-fce4330fedc6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:54.009822 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97533c74-8f35-4644-ac21-fce4330fedc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:54.011343 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97533c74-8f35-4644-ac21-fce4330fedc6 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:54.022200 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 463/922] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Sep 21 12:07:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:54.023054 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97533c74-8f35-4644-ac21-fce4330fedc6 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:54.096257 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f45204-6e1b-40e7-bf24-52fe48d468d7 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:54.117543 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:54.128805 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97533c74-8f35-4644-ac21-fce4330fedc6 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:54.137226 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcaf73a-fc22-4b19-8599-7a7e1bcdb9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:54.138084 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcaf73a-fc22-4b19-8599-7a7e1bcdb9ed None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:54.138372 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcaf73a-fc22-4b19-8599-7a7e1bcdb9ed None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:54.138657 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcaf73a-fc22-4b19-8599-7a7e1bcdb9ed None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:54.139262 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcaf73a-fc22-4b19-8599-7a7e1bcdb9ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:54.140620 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcaf73a-fc22-4b19-8599-7a7e1bcdb9ed None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:54.147604 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 460/923] 10.222.0.60 () {56 vars in 1087 bytes} [Wed Sep 21 12:07:53 2022] GET /identity/v3/services => generated 1497 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:07:54.148780 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f83adb-e039-4ad9-adfa-a5d363d86f79 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:54.149136 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f83adb-e039-4ad9-adfa-a5d363d86f79 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:54.149335 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f83adb-e039-4ad9-adfa-a5d363d86f79 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:54.150958 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 461/924] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:07:54.160397 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904548e3-e1a6-41db-a0f6-5eb7f84e2c29 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:54.160773 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904548e3-e1a6-41db-a0f6-5eb7f84e2c29 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:54.161153 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904548e3-e1a6-41db-a0f6-5eb7f84e2c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:54.176014 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601f3ac-0a23-43fe-9d50-d7c2b413cffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:54.177793 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601f3ac-0a23-43fe-9d50-d7c2b413cffb None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:54.178299 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601f3ac-0a23-43fe-9d50-d7c2b413cffb None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:54.178794 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601f3ac-0a23-43fe-9d50-d7c2b413cffb None admin] PATH_INFO: `/v3/services` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:54.179752 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601f3ac-0a23-43fe-9d50-d7c2b413cffb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:54.180397 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601f3ac-0a23-43fe-9d50-d7c2b413cffb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:54.182017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601f3ac-0a23-43fe-9d50-d7c2b413cffb None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:54.185236 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-904548e3-e1a6-41db-a0f6-5eb7f84e2c29 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:54.186987 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-904548e3-e1a6-41db-a0f6-5eb7f84e2c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:54.193998 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 464/925] 10.222.0.60 () {56 vars in 1114 bytes} [Wed Sep 21 12:07:54 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:54.195902 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601f3ac-0a23-43fe-9d50-d7c2b413cffb None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:54.251188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:54.281361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 462/926] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:07:54.320924 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601f3ac-0a23-43fe-9d50-d7c2b413cffb None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:54.358600 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44311e-be16-4939-bb26-498edf447324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:54.359476 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44311e-be16-4939-bb26-498edf447324 None admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:54.359904 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44311e-be16-4939-bb26-498edf447324 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:54.360321 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44311e-be16-4939-bb26-498edf447324 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:54.361137 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d44311e-be16-4939-bb26-498edf447324 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:54.362536 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d44311e-be16-4939-bb26-498edf447324 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:54.388483 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 465/927] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:07:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:07:54.507791 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f09cc8-4748-4875-b3fb-9bb2d55b1878 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:54.508128 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f09cc8-4748-4875-b3fb-9bb2d55b1878 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:54.508367 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f09cc8-4748-4875-b3fb-9bb2d55b1878 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:54.510031 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 463/928] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:07:54.516068 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c15f7e-61d1-4437-8ba2-9c8ba9e6a63d None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:54.516727 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c15f7e-61d1-4437-8ba2-9c8ba9e6a63d None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:54.517259 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c15f7e-61d1-4437-8ba2-9c8ba9e6a63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:54.538493 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-f3c15f7e-61d1-4437-8ba2-9c8ba9e6a63d None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:54.540144 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-f3c15f7e-61d1-4437-8ba2-9c8ba9e6a63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:54.579452 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f09cc8-4748-4875-b3fb-9bb2d55b1878 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:54.630536 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 466/929] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:07:54.698315 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f09cc8-4748-4875-b3fb-9bb2d55b1878 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:54.713414 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:54.736066 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2297661-69f4-4cb4-a475-a8a0f6850f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:54.736983 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2297661-69f4-4cb4-a475-a8a0f6850f9d None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:54.737407 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2297661-69f4-4cb4-a475-a8a0f6850f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:54.737827 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2297661-69f4-4cb4-a475-a8a0f6850f9d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:54.738574 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2297661-69f4-4cb4-a475-a8a0f6850f9d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:54.740613 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2297661-69f4-4cb4-a475-a8a0f6850f9d None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:54.749960 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-d2297661-69f4-4cb4-a475-a8a0f6850f9d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 21 12:07:54.749960 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:54.749960 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 12:07:54.749960 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 12:07:54.749960 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 12:07:54.749960 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 12:07:54.749960 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 12:07:54.749960 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:07:54.749960 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 21 12:07:54.749960 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:54.749960 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 12:07:54.749960 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:54.749960 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:54.749960 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:54.749960 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:54.749960 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:54.751101 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:54.751101 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:54.751101 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:54.751101 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:54.751101 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:54.751101 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:54.751101 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:54.751101 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 12:07:54.751101 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 12:07:54.751101 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 12:07:54.751101 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 12:07:54.751101 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:54.751101 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:54.751101 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:54.751101 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:54.751101 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:54.751101 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:54.752202 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:54.752202 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:54.752202 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:54.752202 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:54.752202 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:54.752202 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:54.752202 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:54.752202 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:54.752202 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:54.752202 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:54.752202 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 12:07:54.752202 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:07:54.752202 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 21 12:07:54.752202 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:54.754586 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 464/930] 10.222.0.60 () {56 vars in 1132 bytes} [Wed Sep 21 12:07:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:54.762565 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c15f7e-61d1-4437-8ba2-9c8ba9e6a63d None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:54.787780 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:54.869822 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c15f7e-61d1-4437-8ba2-9c8ba9e6a63d None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:54.909735 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a378e0-b75b-4f36-bf7c-f9ca363d44c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:54.910765 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a378e0-b75b-4f36-bf7c-f9ca363d44c8 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:54.911244 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a378e0-b75b-4f36-bf7c-f9ca363d44c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:54.911696 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2297661-69f4-4cb4-a475-a8a0f6850f9d None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:54.912438 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a378e0-b75b-4f36-bf7c-f9ca363d44c8 None admin] PATH_INFO: `/v3/services` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:54.913370 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a378e0-b75b-4f36-bf7c-f9ca363d44c8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:54.913923 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a378e0-b75b-4f36-bf7c-f9ca363d44c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:54.916926 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a378e0-b75b-4f36-bf7c-f9ca363d44c8 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:54.923554 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 467/931] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Sep 21 12:07:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:54.929503 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a378e0-b75b-4f36-bf7c-f9ca363d44c8 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:55.027712 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2297661-69f4-4cb4-a475-a8a0f6850f9d None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:55.036641 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:55.050906 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a378e0-b75b-4f36-bf7c-f9ca363d44c8 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:55.068826 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414821b-b200-443e-86dc-578622bc54a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:55.069459 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414821b-b200-443e-86dc-578622bc54a0 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:55.069736 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414821b-b200-443e-86dc-578622bc54a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:55.070003 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414821b-b200-443e-86dc-578622bc54a0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:55.087265 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414821b-b200-443e-86dc-578622bc54a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:07:55.093357 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-1414821b-b200-443e-86dc-578622bc54a0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 12:07:55.093357 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:55.093357 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:55.093357 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:55.093357 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:55.093357 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:55.093357 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:55.093357 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:55.093357 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:55.093357 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:55.093357 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:55.093357 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:55.093357 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:07:55.093357 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:07:55.093357 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:07:55.093357 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:07:55.094296 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:07:55.094296 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:07:55.094296 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:07:55.094296 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:07:55.094296 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:55.094296 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:55.094296 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:55.094296 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:55.094296 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:55.094296 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:55.094296 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:55.094296 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:55.094296 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:55.094296 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:55.094296 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:55.094296 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:55.100809 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:55.100809 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:55.100809 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:55.100809 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:55.100809 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:07:55.100809 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:07:55.100809 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:07:55.100809 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:07:55.100809 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:07:55.100809 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:07:55.100809 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 12:07:55.100809 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:55.100809 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 465/932] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Sep 21 12:07:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 12:07:55.100809 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414821b-b200-443e-86dc-578622bc54a0 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:55.102616 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9207c2f6-9eef-4739-aaef-e6d190ce1dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:55.103226 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207c2f6-9eef-4739-aaef-e6d190ce1dba None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:55.103502 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207c2f6-9eef-4739-aaef-e6d190ce1dba None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:55.103771 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207c2f6-9eef-4739-aaef-e6d190ce1dba None admin] PATH_INFO: `/v3/services` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:55.104402 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9207c2f6-9eef-4739-aaef-e6d190ce1dba None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:55.104704 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9207c2f6-9eef-4739-aaef-e6d190ce1dba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:55.107206 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9207c2f6-9eef-4739-aaef-e6d190ce1dba None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:55.114443 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 468/933] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Sep 21 12:07:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:07:55.120504 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9207c2f6-9eef-4739-aaef-e6d190ce1dba None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:55.154230 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:55.232605 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414821b-b200-443e-86dc-578622bc54a0 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:55.235410 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9207c2f6-9eef-4739-aaef-e6d190ce1dba None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:55.271913 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6444c3-d956-4bc2-9bec-672c5c7677aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:55.272157 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32edffd0-0617-4ab1-aa8b-53e863c3406c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:55.272829 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edffd0-0617-4ab1-aa8b-53e863c3406c None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:55.273077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6444c3-d956-4bc2-9bec-672c5c7677aa None admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:55.273300 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edffd0-0617-4ab1-aa8b-53e863c3406c None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:55.273655 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6444c3-d956-4bc2-9bec-672c5c7677aa None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:55.273766 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edffd0-0617-4ab1-aa8b-53e863c3406c None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:55.274248 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6444c3-d956-4bc2-9bec-672c5c7677aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:55.274758 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32edffd0-0617-4ab1-aa8b-53e863c3406c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:55.275161 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32edffd0-0617-4ab1-aa8b-53e863c3406c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:55.275389 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6444c3-d956-4bc2-9bec-672c5c7677aa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:55.276725 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32edffd0-0617-4ab1-aa8b-53e863c3406c None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:55.277053 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6444c3-d956-4bc2-9bec-672c5c7677aa None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:55.287647 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 466/934] 10.222.0.60 () {56 vars in 1115 bytes} [Wed Sep 21 12:07:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:55.294200 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32edffd0-0617-4ab1-aa8b-53e863c3406c None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:55.310643 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 469/935] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:07:55 2022] POST /identity/v3/endpoints => generated 347 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:07:55.413580 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:55.419770 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32edffd0-0617-4ab1-aa8b-53e863c3406c None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:55.465436 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee6dd66-0081-4b10-953d-85751cde7418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:55.466081 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6dd66-0081-4b10-953d-85751cde7418 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:55.466491 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6dd66-0081-4b10-953d-85751cde7418 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:55.466767 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6dd66-0081-4b10-953d-85751cde7418 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:55.479695 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee6dd66-0081-4b10-953d-85751cde7418 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:55.481231 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee6dd66-0081-4b10-953d-85751cde7418 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:55.498148 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-9ee6dd66-0081-4b10-953d-85751cde7418 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:55.498148 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:55.498148 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:55.498148 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:55.498148 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:55.498148 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:55.498148 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:55.498148 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:55.498148 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:55.498148 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:55.498148 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:55.498148 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:55.498148 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:55.498148 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:55.498148 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:55.498148 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:55.499201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:55.499201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:55.499201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:55.499201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:55.499201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:55.499201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:55.499201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:55.499201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:55.499201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:55.499201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:55.499201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:55.499201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:55.499201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:55.499201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:55.499201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:55.499201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:55.499201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:55.500100 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:55.500100 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:55.500100 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:55.500100 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 467/936] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 12:07:55.505610 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6444c3-d956-4bc2-9bec-672c5c7677aa None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:55.518900 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:55.625767 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6444c3-d956-4bc2-9bec-672c5c7677aa None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:55.664626 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70cff8-465f-4277-9342-6e46d97d3627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:55.665633 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70cff8-465f-4277-9342-6e46d97d3627 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:55.666165 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70cff8-465f-4277-9342-6e46d97d3627 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:55.666707 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70cff8-465f-4277-9342-6e46d97d3627 None admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:55.667650 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70cff8-465f-4277-9342-6e46d97d3627 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:55.668194 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70cff8-465f-4277-9342-6e46d97d3627 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:55.669799 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70cff8-465f-4277-9342-6e46d97d3627 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:55.683945 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 470/937] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:55.689530 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee6dd66-0081-4b10-953d-85751cde7418 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:55.802761 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee6dd66-0081-4b10-953d-85751cde7418 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:55.841865 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d0af4-19e9-4035-98e8-5cc8f11e2679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:55.842868 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d0af4-19e9-4035-98e8-5cc8f11e2679 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:55.843371 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d0af4-19e9-4035-98e8-5cc8f11e2679 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:55.843828 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d0af4-19e9-4035-98e8-5cc8f11e2679 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:55.852777 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d0af4-19e9-4035-98e8-5cc8f11e2679 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:55.854531 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d0af4-19e9-4035-98e8-5cc8f11e2679 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:55.866820 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-cb6d0af4-19e9-4035-98e8-5cc8f11e2679 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 12:07:55.866820 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:55.866820 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:55.866820 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:55.866820 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:55.866820 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:55.866820 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:55.866820 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:55.866820 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:55.866820 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:55.866820 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:55.866820 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:55.866820 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 12:07:55.866820 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 12:07:55.866820 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 12:07:55.866820 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 12:07:55.867799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:55.867799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:55.867799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 12:07:55.867799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:55.867799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 12:07:55.867799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:07:55.867799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:55.867799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:55.867799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:55.867799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:55.867799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:55.867799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:55.867799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:55.867799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:55.867799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:55.867799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:55.867799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:55.867799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:55.868739 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:55.868739 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:55.868739 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 12:07:55.868739 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 12:07:55.868739 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 12:07:55.868739 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 12:07:55.868739 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 12:07:55.868739 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 12:07:55.868739 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 12:07:55.868739 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:55.871016 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 468/938] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Sep 21 12:07:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 12:07:55.879588 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70cff8-465f-4277-9342-6e46d97d3627 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:55.949680 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:55.986615 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70cff8-465f-4277-9342-6e46d97d3627 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:56.026916 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d348a5-1a5a-44e6-8aad-87bf2a7770b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:56.027894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d348a5-1a5a-44e6-8aad-87bf2a7770b6 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:56.028375 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d348a5-1a5a-44e6-8aad-87bf2a7770b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:56.028850 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d348a5-1a5a-44e6-8aad-87bf2a7770b6 None admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:56.029785 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d348a5-1a5a-44e6-8aad-87bf2a7770b6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:56.030313 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d348a5-1a5a-44e6-8aad-87bf2a7770b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:56.032029 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d348a5-1a5a-44e6-8aad-87bf2a7770b6 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:56.055028 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 471/939] 10.222.0.60 () {56 vars in 1149 bytes} [Wed Sep 21 12:07:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:56.060764 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d0af4-19e9-4035-98e8-5cc8f11e2679 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:56.076666 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:56.177222 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d0af4-19e9-4035-98e8-5cc8f11e2679 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:56.214054 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a94b68-7bf5-4bf0-8de3-94d7b729cfc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:56.215023 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a94b68-7bf5-4bf0-8de3-94d7b729cfc4 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:56.215463 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a94b68-7bf5-4bf0-8de3-94d7b729cfc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:56.215887 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a94b68-7bf5-4bf0-8de3-94d7b729cfc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:56.227446 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a94b68-7bf5-4bf0-8de3-94d7b729cfc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:56.229141 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a94b68-7bf5-4bf0-8de3-94d7b729cfc4 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:56.244833 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-31a94b68-7bf5-4bf0-8de3-94d7b729cfc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:56.244833 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:56.244833 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:56.244833 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:56.244833 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:56.244833 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:56.244833 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:56.244833 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:56.244833 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:56.244833 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:56.244833 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:56.244833 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:56.244833 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:07:56.244833 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:07:56.244833 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:07:56.244833 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:07:56.246036 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:56.246036 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:56.246036 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:56.246036 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:56.246036 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:56.246036 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:56.246036 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:56.246036 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:56.246036 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:56.246036 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:56.246036 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:56.246036 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:56.246036 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:56.246036 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:56.246036 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:56.246036 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:56.246036 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:07:56.247146 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:07:56.247146 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:07:56.247146 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:56.248856 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 469/940] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:07:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:56.254755 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d348a5-1a5a-44e6-8aad-87bf2a7770b6 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:56.357874 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d348a5-1a5a-44e6-8aad-87bf2a7770b6 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:56.386960 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:56.397962 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f610e05-1ae1-411e-9e43-8fb7732c112f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:56.398614 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f610e05-1ae1-411e-9e43-8fb7732c112f None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:56.398891 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f610e05-1ae1-411e-9e43-8fb7732c112f None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:56.399157 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f610e05-1ae1-411e-9e43-8fb7732c112f None admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:56.399807 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f610e05-1ae1-411e-9e43-8fb7732c112f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:56.400106 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f610e05-1ae1-411e-9e43-8fb7732c112f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:56.401567 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f610e05-1ae1-411e-9e43-8fb7732c112f None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:56.415642 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 472/941] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:07:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:56.421203 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a94b68-7bf5-4bf0-8de3-94d7b729cfc4 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:56.488140 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:56.530962 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532b65a-519b-4804-b426-d4a1d7fc9807 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:56.531518 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532b65a-519b-4804-b426-d4a1d7fc9807 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:56.531631 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532b65a-519b-4804-b426-d4a1d7fc9807 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:56.532425 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a94b68-7bf5-4bf0-8de3-94d7b729cfc4 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:56.533354 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 473/942] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:07:56.539058 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefeac3-38fc-46d3-93a7-3dd6391a5a37 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:56.539403 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefeac3-38fc-46d3-93a7-3dd6391a5a37 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:56.539741 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefeac3-38fc-46d3-93a7-3dd6391a5a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:56.562941 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-4cefeac3-38fc-46d3-93a7-3dd6391a5a37 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:56.564420 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-4cefeac3-38fc-46d3-93a7-3dd6391a5a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:56.584164 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48045cc-c793-477c-af68-49fa0875aa6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:56.585100 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48045cc-c793-477c-af68-49fa0875aa6e None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:56.585448 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48045cc-c793-477c-af68-49fa0875aa6e None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:56.585814 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48045cc-c793-477c-af68-49fa0875aa6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:56.593622 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48045cc-c793-477c-af68-49fa0875aa6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:56.595160 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48045cc-c793-477c-af68-49fa0875aa6e None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:56.607109 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-d48045cc-c793-477c-af68-49fa0875aa6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:56.607109 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:56.607109 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:56.607109 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:56.607109 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:56.607109 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:56.607109 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:56.607109 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:56.607109 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:56.607109 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:56.607109 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:56.607109 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:56.607109 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 12:07:56.607109 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 12:07:56.607109 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 12:07:56.608240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 12:07:56.608240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:56.608240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:56.608240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:56.608240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:56.608240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:56.608240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:56.608240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:56.608240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:56.608240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:56.608240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:56.608240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:56.608240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:56.608240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:56.608240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:56.608240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:56.608240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:56.609378 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 12:07:56.609378 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 12:07:56.609378 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 12:07:56.609378 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 12:07:56.609378 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 12:07:56.609378 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 12:07:56.609378 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:56.609378 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:56.610595 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 470/943] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:07:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:56.617868 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48045cc-c793-477c-af68-49fa0875aa6e None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:56.666400 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 474/944] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 12:07:56.734179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48045cc-c793-477c-af68-49fa0875aa6e None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:56.745047 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41744c-2410-4bc0-b1a1-438d901b4414 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:56.745348 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41744c-2410-4bc0-b1a1-438d901b4414 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:56.745690 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41744c-2410-4bc0-b1a1-438d901b4414 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:56.747853 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 475/945] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:07:56.753358 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13497d3e-35d5-4a20-af42-4236ccbee5a1 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:56.753642 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13497d3e-35d5-4a20-af42-4236ccbee5a1 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:56.753948 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13497d3e-35d5-4a20-af42-4236ccbee5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:56.756799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:56.776950 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81996d4e-b912-4372-ac9c-ee9648ce34c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:56.777913 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81996d4e-b912-4372-ac9c-ee9648ce34c9 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:56.778468 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81996d4e-b912-4372-ac9c-ee9648ce34c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:56.778894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-13497d3e-35d5-4a20-af42-4236ccbee5a1 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:56.779134 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81996d4e-b912-4372-ac9c-ee9648ce34c9 None admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:56.780028 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81996d4e-b912-4372-ac9c-ee9648ce34c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:56.780143 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-13497d3e-35d5-4a20-af42-4236ccbee5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:56.780670 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81996d4e-b912-4372-ac9c-ee9648ce34c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:56.782290 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81996d4e-b912-4372-ac9c-ee9648ce34c9 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:56.798048 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 471/946] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Sep 21 12:07:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:07:56.810435 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81996d4e-b912-4372-ac9c-ee9648ce34c9 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:56.862488 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 476/947] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:07:56.942752 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81996d4e-b912-4372-ac9c-ee9648ce34c9 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:56.945347 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13497d3e-35d5-4a20-af42-4236ccbee5a1 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:56.980995 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2ec47-79fe-4072-b222-a30a5f4e1025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:56.981655 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2ec47-79fe-4072-b222-a30a5f4e1025 None admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:56.981932 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2ec47-79fe-4072-b222-a30a5f4e1025 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:56.982202 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2ec47-79fe-4072-b222-a30a5f4e1025 None admin] PATH_INFO: `/v3/projects/b0abcc6f2ce14825bfc26e6210889c21/users/bbd7a1d5a8d04e3798ffcab27bad936b/roles/a0f76a5a7b9c4af794c33ce6078ca7be` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:56.984392 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c2ec47-79fe-4072-b222-a30a5f4e1025 None admin] RBAC: Authorizing `identity:create_grant(project_id=b0abcc6f2ce14825bfc26e6210889c21, user_id=bbd7a1d5a8d04e3798ffcab27bad936b, role_id=a0f76a5a7b9c4af794c33ce6078ca7be)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:56.985827 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c2ec47-79fe-4072-b222-a30a5f4e1025 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:57.002013 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 472/948] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Sep 21 12:07:56 2022] PUT /identity/v3/projects/b0abcc6f2ce14825bfc26e6210889c21/users/bbd7a1d5a8d04e3798ffcab27bad936b/roles/a0f76a5a7b9c4af794c33ce6078ca7be => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:07:57.010938 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:57.072269 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13497d3e-35d5-4a20-af42-4236ccbee5a1 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:57.113577 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a0bed-8b6b-44ab-84b1-1e06fe4fcb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:57.114269 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a0bed-8b6b-44ab-84b1-1e06fe4fcb04 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:57.114571 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a0bed-8b6b-44ab-84b1-1e06fe4fcb04 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:57.114873 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a0bed-8b6b-44ab-84b1-1e06fe4fcb04 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:57.115567 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a0bed-8b6b-44ab-84b1-1e06fe4fcb04 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:57.116998 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a0bed-8b6b-44ab-84b1-1e06fe4fcb04 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:57.127067 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-fc1a0bed-8b6b-44ab-84b1-1e06fe4fcb04 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 12:07:57.127067 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:57.127067 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 12:07:57.127067 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 12:07:57.127067 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 12:07:57.127067 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 12:07:57.127067 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 12:07:57.127067 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:07:57.127067 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 12:07:57.127067 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:57.127067 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 12:07:57.127067 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:57.127067 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:57.127067 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:57.127067 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:57.127067 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:57.127067 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:57.128110 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:57.128110 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:57.128110 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:57.128110 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:57.128110 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:57.128110 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:57.128110 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 12:07:57.128110 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 12:07:57.128110 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 12:07:57.128110 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 12:07:57.128110 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:57.128110 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:57.128110 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:57.128110 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:57.128110 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:57.128110 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:57.128943 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:57.128943 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:57.128943 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:57.128943 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:57.128943 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:57.128943 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:57.128943 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:57.128943 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:57.128943 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:57.128943 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:57.128943 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 12:07:57.128943 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:07:57.128943 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 12:07:57.128943 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:57.128943 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 477/949] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Sep 21 12:07:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:57.134863 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2ec47-79fe-4072-b222-a30a5f4e1025 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:57.173388 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a0bed-8b6b-44ab-84b1-1e06fe4fcb04 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:57.180517 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:57.265167 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2ec47-79fe-4072-b222-a30a5f4e1025 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:57.292667 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a0bed-8b6b-44ab-84b1-1e06fe4fcb04 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:57.307023 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023b26d-5c41-49be-bd2c-a99e4fc03059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:57.307638 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023b26d-5c41-49be-bd2c-a99e4fc03059 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:57.307915 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023b26d-5c41-49be-bd2c-a99e4fc03059 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:57.308187 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023b26d-5c41-49be-bd2c-a99e4fc03059 None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:57.308819 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c023b26d-5c41-49be-bd2c-a99e4fc03059 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:57.309125 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c023b26d-5c41-49be-bd2c-a99e4fc03059 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:57.310523 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c023b26d-5c41-49be-bd2c-a99e4fc03059 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:57.316814 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 473/950] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Sep 21 12:07:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:57.324684 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:57.325198 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023b26d-5c41-49be-bd2c-a99e4fc03059 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:57.337536 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328a982-8607-40e8-8e8d-4e5aa04589ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:57.338184 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328a982-8607-40e8-8e8d-4e5aa04589ca None admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:57.338494 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328a982-8607-40e8-8e8d-4e5aa04589ca None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:57.338918 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328a982-8607-40e8-8e8d-4e5aa04589ca None admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:57.339625 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b328a982-8607-40e8-8e8d-4e5aa04589ca None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:57.341344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b328a982-8607-40e8-8e8d-4e5aa04589ca None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:57.344308 dv-cinder-858678-1-smb devstack@keystone.service[81377]: WARNING keystone.server.flask.common [None req-b328a982-8607-40e8-8e8d-4e5aa04589ca None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 21 12:07:57.364623 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.sql.core [None req-b328a982-8607-40e8-8e8d-4e5aa04589ca None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 21 12:07:57.364623 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 21 12:07:57.364623 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [parameters: {'id': 'a91e7ff6423a4cd3b0c88df52f0cf89a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 21 12:07:57.364623 dv-cinder-858678-1-smb devstack@keystone.service[81377]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81377) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 21 12:07:57.384166 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-b328a982-8607-40e8-8e8d-4e5aa04589ca None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a91e7ff6423a4cd3b0c88df52f0cf89a.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a91e7ff6423a4cd3b0c88df52f0cf89a. Sep 21 12:07:57.384166 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:57.384166 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 21 12:07:57.384166 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 21 12:07:57.384166 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 21 12:07:57.384166 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 21 12:07:57.384166 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 21 12:07:57.384166 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application result = self._query(query) Sep 21 12:07:57.384166 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 21 12:07:57.384166 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application conn.query(q) Sep 21 12:07:57.384166 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 21 12:07:57.384166 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 21 12:07:57.384166 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 21 12:07:57.385091 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application result.read() Sep 21 12:07:57.385091 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 21 12:07:57.385091 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 21 12:07:57.385091 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 21 12:07:57.385091 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 21 12:07:57.385091 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 21 12:07:57.385091 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 21 12:07:57.385091 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 21 12:07:57.385091 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 21 12:07:57.385091 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 21 12:07:57.385091 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:57.385091 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 21 12:07:57.385091 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:57.385091 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:57.385091 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 21 12:07:57.385091 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 21 12:07:57.385091 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 21 12:07:57.385091 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 21 12:07:57.386047 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 21 12:07:57.386047 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application next(self.gen) Sep 21 12:07:57.386047 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 21 12:07:57.386047 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application yield resource Sep 21 12:07:57.386047 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 21 12:07:57.386047 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application next(self.gen) Sep 21 12:07:57.386047 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 21 12:07:57.386047 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application self.session.rollback() Sep 21 12:07:57.386047 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 21 12:07:57.386047 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application self.force_reraise() Sep 21 12:07:57.386047 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 21 12:07:57.386047 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise self.value Sep 21 12:07:57.386047 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 21 12:07:57.386047 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 21 12:07:57.386047 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 21 12:07:57.386047 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application session.commit() Sep 21 12:07:57.386047 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 21 12:07:57.387008 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 21 12:07:57.387008 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 21 12:07:57.387008 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application self._prepare_impl() Sep 21 12:07:57.387008 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 21 12:07:57.387008 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application self.session.flush() Sep 21 12:07:57.387008 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 21 12:07:57.387008 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application self._flush(objects) Sep 21 12:07:57.387008 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 21 12:07:57.387008 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 21 12:07:57.387008 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 21 12:07:57.387008 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application compat.raise_( Sep 21 12:07:57.387008 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 21 12:07:57.387008 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception Sep 21 12:07:57.387008 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 21 12:07:57.387008 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application flush_context.execute() Sep 21 12:07:57.387008 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 21 12:07:57.387008 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rec.execute(self) Sep 21 12:07:57.388161 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 21 12:07:57.388161 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 21 12:07:57.388161 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 21 12:07:57.388161 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 21 12:07:57.388161 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 21 12:07:57.388161 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 21 12:07:57.388161 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 21 12:07:57.388161 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 21 12:07:57.388161 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 21 12:07:57.388161 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 21 12:07:57.388161 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 21 12:07:57.388161 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 21 12:07:57.388161 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 21 12:07:57.388161 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 21 12:07:57.388161 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 21 12:07:57.388961 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 21 12:07:57.388961 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 21 12:07:57.388961 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception Sep 21 12:07:57.388961 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 21 12:07:57.388961 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 21 12:07:57.388961 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 21 12:07:57.388961 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 21 12:07:57.388961 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 21 12:07:57.388961 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application result = self._query(query) Sep 21 12:07:57.388961 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 21 12:07:57.388961 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application conn.query(q) Sep 21 12:07:57.388961 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 21 12:07:57.388961 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 21 12:07:57.388961 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 21 12:07:57.388961 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application result.read() Sep 21 12:07:57.388961 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 21 12:07:57.388961 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 21 12:07:57.389834 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 21 12:07:57.389834 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 21 12:07:57.389834 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 21 12:07:57.389834 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 21 12:07:57.389834 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 21 12:07:57.389834 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 21 12:07:57.389834 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 21 12:07:57.389834 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 21 12:07:57.389834 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [parameters: {'id': 'a91e7ff6423a4cd3b0c88df52f0cf89a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 21 12:07:57.389834 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 21 12:07:57.389834 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:57.389834 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 12:07:57.389834 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:57.389834 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:57.389834 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 21 12:07:57.390680 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 21 12:07:57.390680 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 21 12:07:57.390680 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 21 12:07:57.390680 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 21 12:07:57.390680 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:57.390680 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 12:07:57.390680 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:57.390680 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:57.390680 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:57.390680 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:57.390680 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:57.390680 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:57.390680 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:57.390680 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:57.390680 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:57.390680 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:57.390680 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:57.391588 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:57.391588 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 21 12:07:57.391588 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 21 12:07:57.391588 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:57.391588 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:57.391588 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 21 12:07:57.391588 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 21 12:07:57.391588 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a91e7ff6423a4cd3b0c88df52f0cf89a. Sep 21 12:07:57.391588 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:57.391588 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 478/951] 10.222.0.60 () {60 vars in 1140 bytes} [Wed Sep 21 12:07:57 2022] POST /identity/v3/projects => generated 262 bytes in 213 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 21 12:07:57.393242 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328a982-8607-40e8-8e8d-4e5aa04589ca None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:57.452465 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023b26d-5c41-49be-bd2c-a99e4fc03059 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:57.460775 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:57.492555 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832cf811-8bda-48d2-8254-1c7f283fd1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:57.492989 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832cf811-8bda-48d2-8254-1c7f283fd1e2 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:57.493273 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832cf811-8bda-48d2-8254-1c7f283fd1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:57.493610 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832cf811-8bda-48d2-8254-1c7f283fd1e2 None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:57.494250 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832cf811-8bda-48d2-8254-1c7f283fd1e2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:57.494581 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832cf811-8bda-48d2-8254-1c7f283fd1e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:57.496290 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832cf811-8bda-48d2-8254-1c7f283fd1e2 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:57.508663 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 474/952] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Sep 21 12:07:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:07:57.509840 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832cf811-8bda-48d2-8254-1c7f283fd1e2 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:57.515854 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328a982-8607-40e8-8e8d-4e5aa04589ca None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:57.559479 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e443cb-444b-4e9d-bbec-a25053576e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:57.561168 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e443cb-444b-4e9d-bbec-a25053576e6b None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:57.561670 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e443cb-444b-4e9d-bbec-a25053576e6b None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:57.562223 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e443cb-444b-4e9d-bbec-a25053576e6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:57.573962 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e443cb-444b-4e9d-bbec-a25053576e6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:57.576950 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e443cb-444b-4e9d-bbec-a25053576e6b None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:57.592077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-83e443cb-444b-4e9d-bbec-a25053576e6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:57.592077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:57.592077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:57.592077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:57.592077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:57.592077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:57.592077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:57.592077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:57.592077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:57.592077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:57.592077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:57.592077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:57.592077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 12:07:57.592077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 12:07:57.592077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 12:07:57.593083 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 12:07:57.593083 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:57.593083 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:57.593083 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:57.593083 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:57.593083 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:57.593083 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:57.593083 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:57.593083 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:57.593083 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:57.593083 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:57.593083 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:57.593083 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:57.593083 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:57.593083 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:57.593083 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:57.593083 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:57.594044 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 12:07:57.594044 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 12:07:57.594044 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 12:07:57.594044 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 12:07:57.594044 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 12:07:57.594044 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 12:07:57.594044 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:07:57.594044 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:57.597954 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 479/953] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:07:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 12:07:57.600263 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e443cb-444b-4e9d-bbec-a25053576e6b None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:57.629138 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:57.651842 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832cf811-8bda-48d2-8254-1c7f283fd1e2 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:57.696495 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7fff3-4c87-4293-8f58-f37368127358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:57.697770 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7fff3-4c87-4293-8f58-f37368127358 None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:57.698255 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7fff3-4c87-4293-8f58-f37368127358 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:57.699009 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7fff3-4c87-4293-8f58-f37368127358 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:57.700290 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc7fff3-4c87-4293-8f58-f37368127358 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:57.701851 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc7fff3-4c87-4293-8f58-f37368127358 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:57.717622 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e443cb-444b-4e9d-bbec-a25053576e6b None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:57.742688 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 475/954] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:07:57 2022] POST /identity/v3/endpoints => generated 349 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:07:57.782562 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759b1e1-31ca-4a6e-896b-aaafbaddc4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:57.783584 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759b1e1-31ca-4a6e-896b-aaafbaddc4fd None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:57.783897 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759b1e1-31ca-4a6e-896b-aaafbaddc4fd None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:57.784174 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759b1e1-31ca-4a6e-896b-aaafbaddc4fd None admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:57.784949 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e759b1e1-31ca-4a6e-896b-aaafbaddc4fd None admin] RBAC: Adding query filter params (name=service) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:57.785260 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e759b1e1-31ca-4a6e-896b-aaafbaddc4fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:57.787578 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e759b1e1-31ca-4a6e-896b-aaafbaddc4fd None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:57.814616 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 480/955] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Sep 21 12:07:57 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:07:57.880620 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b8af7-f84a-45d4-b417-695e9b7811ce None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:57.880908 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b8af7-f84a-45d4-b417-695e9b7811ce None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:57.881212 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b8af7-f84a-45d4-b417-695e9b7811ce None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:57.883088 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 476/956] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:07:57.889330 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a6aa0-661c-4b95-a5df-b31e23da745d None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:57.889716 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a6aa0-661c-4b95-a5df-b31e23da745d None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:57.890070 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a6aa0-661c-4b95-a5df-b31e23da745d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:57.912240 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-483a6aa0-661c-4b95-a5df-b31e23da745d None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:57.914111 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-483a6aa0-661c-4b95-a5df-b31e23da745d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:58.006740 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 481/957] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:07:58.273455 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b8af7-f84a-45d4-b417-695e9b7811ce None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:58.299567 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:58.382384 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b8af7-f84a-45d4-b417-695e9b7811ce None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:58.419220 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821c13a-d8e7-4351-924c-c1d54607ccb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:58.419838 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821c13a-d8e7-4351-924c-c1d54607ccb5 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:58.420115 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821c13a-d8e7-4351-924c-c1d54607ccb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:58.420381 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821c13a-d8e7-4351-924c-c1d54607ccb5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:58.420953 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821c13a-d8e7-4351-924c-c1d54607ccb5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:58.422392 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821c13a-d8e7-4351-924c-c1d54607ccb5 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:58.431195 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-a821c13a-d8e7-4351-924c-c1d54607ccb5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 21 12:07:58.431195 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:58.431195 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 12:07:58.431195 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 12:07:58.431195 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 12:07:58.431195 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 12:07:58.431195 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 12:07:58.431195 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:07:58.431195 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 21 12:07:58.431195 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:58.431195 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 12:07:58.431195 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:58.431195 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:58.431195 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:58.431195 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:58.431195 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:58.431195 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:58.432249 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:58.432249 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:58.432249 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:58.432249 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:58.432249 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:58.432249 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:58.432249 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 12:07:58.432249 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 12:07:58.432249 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 12:07:58.432249 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 12:07:58.432249 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:58.432249 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:58.432249 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:58.432249 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:58.432249 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:58.432249 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:58.433188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:58.433188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:58.433188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:58.433188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:58.433188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:58.433188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:58.433188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:58.433188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:58.433188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:58.433188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:58.433188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 12:07:58.433188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:07:58.433188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 21 12:07:58.433188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:07:58.433188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 477/958] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:07:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:58.438643 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a6aa0-661c-4b95-a5df-b31e23da745d None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:58.453144 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:58.544260 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a6aa0-661c-4b95-a5df-b31e23da745d None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:58.584772 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1152d3c5-a456-41af-9104-9f60f55324db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:58.586085 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152d3c5-a456-41af-9104-9f60f55324db None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:58.586605 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152d3c5-a456-41af-9104-9f60f55324db None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:58.587130 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152d3c5-a456-41af-9104-9f60f55324db None admin] PATH_INFO: `/v3/services` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:58.587962 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1152d3c5-a456-41af-9104-9f60f55324db None admin] RBAC: Adding query filter params (name=compute) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:58.588476 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1152d3c5-a456-41af-9104-9f60f55324db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:58.590035 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1152d3c5-a456-41af-9104-9f60f55324db None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:58.595763 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 482/959] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Sep 21 12:07:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:58.603769 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821c13a-d8e7-4351-924c-c1d54607ccb5 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:58.695361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:58.710702 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821c13a-d8e7-4351-924c-c1d54607ccb5 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:58.748804 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6270aa57-6271-43e1-96c8-a47c7fcd0dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:58.749461 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270aa57-6271-43e1-96c8-a47c7fcd0dd8 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:58.749737 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270aa57-6271-43e1-96c8-a47c7fcd0dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:58.750046 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270aa57-6271-43e1-96c8-a47c7fcd0dd8 None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:58.750703 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6270aa57-6271-43e1-96c8-a47c7fcd0dd8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:58.750998 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6270aa57-6271-43e1-96c8-a47c7fcd0dd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:58.752354 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6270aa57-6271-43e1-96c8-a47c7fcd0dd8 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:58.757899 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 478/960] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Sep 21 12:07:58 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:07:59.287940 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b70b0-2447-4b24-91ba-ac1c429922b3 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:59.288328 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b70b0-2447-4b24-91ba-ac1c429922b3 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:59.288505 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b70b0-2447-4b24-91ba-ac1c429922b3 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:59.290100 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 483/961] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:07:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:07:59.295231 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1de62-84f1-46c5-8756-a384b9d98226 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:59.295514 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1de62-84f1-46c5-8756-a384b9d98226 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:59.295783 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1de62-84f1-46c5-8756-a384b9d98226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:59.314624 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-8df1de62-84f1-46c5-8756-a384b9d98226 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:07:59.315801 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-8df1de62-84f1-46c5-8756-a384b9d98226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:07:59.389539 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 479/962] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:07:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:07:59.660912 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b70b0-2447-4b24-91ba-ac1c429922b3 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:59.746461 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:59.776460 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b70b0-2447-4b24-91ba-ac1c429922b3 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:59.813374 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d6830-c667-4f27-a02b-b6a22e4bd444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:59.814390 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d6830-c667-4f27-a02b-b6a22e4bd444 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:59.814899 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d6830-c667-4f27-a02b-b6a22e4bd444 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:59.815368 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d6830-c667-4f27-a02b-b6a22e4bd444 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:59.826551 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d6830-c667-4f27-a02b-b6a22e4bd444 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:07:59.831552 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-ae3d6830-c667-4f27-a02b-b6a22e4bd444 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 12:07:59.831552 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:07:59.831552 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:07:59.831552 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:07:59.831552 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:07:59.831552 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:07:59.831552 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:07:59.831552 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:07:59.831552 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:07:59.831552 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:07:59.831552 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:07:59.831552 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:07:59.831552 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:07:59.831552 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:07:59.831552 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:07:59.831552 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:07:59.832497 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:07:59.832497 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:07:59.832497 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:07:59.832497 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:07:59.832497 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:07:59.832497 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:07:59.832497 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:07:59.832497 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:07:59.832497 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:07:59.832497 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:07:59.832497 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:07:59.832497 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:07:59.832497 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:07:59.832497 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:07:59.832497 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:07:59.832497 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:07:59.833343 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:07:59.833343 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:07:59.833343 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:07:59.833343 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:07:59.833343 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:07:59.833343 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:07:59.833343 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:07:59.833343 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:07:59.833343 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:07:59.833343 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:07:59.833343 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 12:07:59.833343 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:07:59.836125 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 484/963] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Sep 21 12:07:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:07:59.842389 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df1de62-84f1-46c5-8756-a384b9d98226 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:07:59.938834 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:07:59.947689 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df1de62-84f1-46c5-8756-a384b9d98226 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:07:59.987127 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f27a8-d064-4011-9fac-3663059b9a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:07:59.987734 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f27a8-d064-4011-9fac-3663059b9a94 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:07:59.988011 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f27a8-d064-4011-9fac-3663059b9a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:07:59.988279 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f27a8-d064-4011-9fac-3663059b9a94 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:07:59.988949 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f27a8-d064-4011-9fac-3663059b9a94 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:07:59.989248 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f27a8-d064-4011-9fac-3663059b9a94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:07:59.990682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f27a8-d064-4011-9fac-3663059b9a94 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:07:59.999695 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 480/964] 10.222.0.60 () {56 vars in 1115 bytes} [Wed Sep 21 12:07:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:00.005061 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d6830-c667-4f27-a02b-b6a22e4bd444 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:00.076314 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457f9cd-858f-4fc9-98bf-c0c71017dc58 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:00.076661 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457f9cd-858f-4fc9-98bf-c0c71017dc58 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:00.076883 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457f9cd-858f-4fc9-98bf-c0c71017dc58 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:00.080264 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 481/965] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:08:00.086178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601e535-b636-4634-b18c-a1cad31636e0 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:00.086510 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601e535-b636-4634-b18c-a1cad31636e0 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:00.086790 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601e535-b636-4634-b18c-a1cad31636e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:00.108248 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-e601e535-b636-4634-b18c-a1cad31636e0 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:08:00.109448 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-e601e535-b636-4634-b18c-a1cad31636e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:08:00.129074 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d6830-c667-4f27-a02b-b6a22e4bd444 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:00.167408 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b52d3-bb71-4676-b70a-f663f9cab82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:00.168042 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b52d3-bb71-4676-b70a-f663f9cab82b None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:00.168323 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b52d3-bb71-4676-b70a-f663f9cab82b None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:00.168595 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b52d3-bb71-4676-b70a-f663f9cab82b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:00.171658 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:00.182815 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b52d3-bb71-4676-b70a-f663f9cab82b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:00.184427 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b52d3-bb71-4676-b70a-f663f9cab82b None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:00.188565 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 482/966] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:08:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 12:08:00.204179 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-328b52d3-bb71-4676-b70a-f663f9cab82b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:08:00.204179 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:00.204179 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:08:00.204179 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:08:00.204179 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:08:00.204179 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:08:00.204179 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:08:00.204179 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:08:00.204179 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:08:00.204179 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:08:00.204179 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:08:00.204179 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:08:00.204179 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:08:00.204179 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:08:00.204179 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:08:00.204179 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:08:00.205209 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:08:00.205209 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:08:00.205209 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:08:00.205209 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:08:00.205209 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:08:00.205209 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:08:00.205209 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:08:00.205209 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:08:00.205209 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:08:00.205209 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:08:00.205209 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:08:00.205209 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:08:00.205209 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:08:00.205209 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:08:00.205209 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:08:00.205209 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:08:00.205209 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:08:00.206112 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:08:00.206112 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:08:00.206112 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:08:00.206112 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 485/967] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:08:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:08:00.207095 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33893a-3d36-4d11-a3e4-7410632698ac None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:00.207606 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33893a-3d36-4d11-a3e4-7410632698ac None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:00.208070 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33893a-3d36-4d11-a3e4-7410632698ac None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:00.210469 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 483/968] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:08:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:08:00.211268 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b52d3-bb71-4676-b70a-f663f9cab82b None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:00.215766 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed167f-b0d4-4222-a88d-7fd494ff9875 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:00.216156 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed167f-b0d4-4222-a88d-7fd494ff9875 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:00.216521 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed167f-b0d4-4222-a88d-7fd494ff9875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:00.237378 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-e5ed167f-b0d4-4222-a88d-7fd494ff9875 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:08:00.238740 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-e5ed167f-b0d4-4222-a88d-7fd494ff9875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:08:00.319502 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b52d3-bb71-4676-b70a-f663f9cab82b None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:00.320792 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 484/969] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:08:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:08:00.358843 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a614b-defc-4a88-8ac8-e27bef89efda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:00.359368 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a614b-defc-4a88-8ac8-e27bef89efda None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:00.359643 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a614b-defc-4a88-8ac8-e27bef89efda None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:00.359914 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a614b-defc-4a88-8ac8-e27bef89efda None admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:00.360545 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a614b-defc-4a88-8ac8-e27bef89efda None admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:00.360844 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a614b-defc-4a88-8ac8-e27bef89efda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:00.362192 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a614b-defc-4a88-8ac8-e27bef89efda None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:00.375382 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 486/970] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:00.383481 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed167f-b0d4-4222-a88d-7fd494ff9875 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:00.386290 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:00.457943 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a614b-defc-4a88-8ac8-e27bef89efda None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:00.493458 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed167f-b0d4-4222-a88d-7fd494ff9875 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:00.518973 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:00.534716 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f3f29-5a0f-4cc0-906e-1639cf6a722f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:00.535857 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f3f29-5a0f-4cc0-906e-1639cf6a722f None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:00.536317 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f3f29-5a0f-4cc0-906e-1639cf6a722f None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:00.537667 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f3f29-5a0f-4cc0-906e-1639cf6a722f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:00.548284 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f3f29-5a0f-4cc0-906e-1639cf6a722f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:00.549742 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f3f29-5a0f-4cc0-906e-1639cf6a722f None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:00.577914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-424f3f29-5a0f-4cc0-906e-1639cf6a722f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 12:08:00.577914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:00.577914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:08:00.577914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:08:00.577914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:08:00.577914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:08:00.577914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:08:00.577914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:08:00.577914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:08:00.577914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:08:00.577914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:08:00.577914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:08:00.577914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 12:08:00.577914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 12:08:00.577914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 12:08:00.577914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 12:08:00.578901 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:08:00.578901 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:08:00.578901 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 12:08:00.578901 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:08:00.578901 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 12:08:00.578901 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:08:00.578901 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:08:00.578901 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:08:00.578901 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:08:00.578901 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:08:00.578901 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:08:00.578901 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:08:00.578901 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:08:00.578901 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:08:00.578901 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:08:00.578901 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:08:00.578901 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:08:00.578901 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:08:00.579914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:08:00.579914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:08:00.579914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 12:08:00.579914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 12:08:00.579914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 12:08:00.579914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 12:08:00.579914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 12:08:00.579914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 12:08:00.579914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 21 12:08:00.579914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:08:00.582546 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 485/971] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Sep 21 12:08:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:08:00.591032 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f3f29-5a0f-4cc0-906e-1639cf6a722f None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:00.595927 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a614b-defc-4a88-8ac8-e27bef89efda None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:00.639270 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfc1ad-dbde-4132-87cf-59b48aa8ea3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:00.639918 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfc1ad-dbde-4132-87cf-59b48aa8ea3f None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:00.640198 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfc1ad-dbde-4132-87cf-59b48aa8ea3f None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:00.640658 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfc1ad-dbde-4132-87cf-59b48aa8ea3f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:00.641150 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdfc1ad-dbde-4132-87cf-59b48aa8ea3f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:00.642541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdfc1ad-dbde-4132-87cf-59b48aa8ea3f None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:00.652245 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:00.654134 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-dbdfc1ad-dbde-4132-87cf-59b48aa8ea3f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 12:08:00.654134 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:00.654134 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 12:08:00.654134 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 12:08:00.654134 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 12:08:00.654134 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 12:08:00.654134 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 12:08:00.654134 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:08:00.654134 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 12:08:00.654134 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:08:00.654134 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 12:08:00.654134 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:08:00.654134 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:00.654134 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:08:00.654134 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:08:00.654134 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:08:00.654134 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:08:00.655218 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:08:00.655218 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:08:00.655218 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:08:00.655218 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:08:00.655218 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:08:00.655218 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:08:00.655218 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 12:08:00.655218 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 12:08:00.655218 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 12:08:00.655218 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 12:08:00.655218 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:08:00.655218 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:08:00.655218 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:08:00.655218 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:08:00.655218 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:08:00.655218 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:08:00.659278 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:08:00.659278 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:08:00.659278 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:08:00.659278 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:08:00.659278 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:08:00.659278 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:08:00.659278 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:08:00.659278 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:08:00.659278 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:08:00.659278 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:08:00.659278 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 12:08:00.659278 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:08:00.659278 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 12:08:00.659278 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:08:00.659278 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 487/972] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Sep 21 12:08:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 12:08:00.660076 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfc1ad-dbde-4132-87cf-59b48aa8ea3f None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:00.698354 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f3f29-5a0f-4cc0-906e-1639cf6a722f None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:00.737382 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9958e5d-cc2d-487a-a116-4cf07557e63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:00.737989 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9958e5d-cc2d-487a-a116-4cf07557e63d None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:00.738268 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9958e5d-cc2d-487a-a116-4cf07557e63d None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:00.738573 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9958e5d-cc2d-487a-a116-4cf07557e63d None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:00.739300 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9958e5d-cc2d-487a-a116-4cf07557e63d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:00.739636 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9958e5d-cc2d-487a-a116-4cf07557e63d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:00.741076 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9958e5d-cc2d-487a-a116-4cf07557e63d None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:00.764045 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 486/973] 10.222.0.60 () {56 vars in 1149 bytes} [Wed Sep 21 12:08:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:00.764045 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9958e5d-cc2d-487a-a116-4cf07557e63d None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:00.777378 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfc1ad-dbde-4132-87cf-59b48aa8ea3f None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:00.792347 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:00.815556 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab695c-2fa8-4771-b6f2-e6e1557ddcc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:00.816164 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab695c-2fa8-4771-b6f2-e6e1557ddcc4 None admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:00.816444 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab695c-2fa8-4771-b6f2-e6e1557ddcc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:00.816837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab695c-2fa8-4771-b6f2-e6e1557ddcc4 None admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:00.817469 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cab695c-2fa8-4771-b6f2-e6e1557ddcc4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:00.818985 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cab695c-2fa8-4771-b6f2-e6e1557ddcc4 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:00.836879 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.sql.core [None req-5cab695c-2fa8-4771-b6f2-e6e1557ddcc4 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 21 12:08:00.836879 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 21 12:08:00.836879 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [parameters: {'user_id': '053c7393147b4ad9b22bff4f2707189f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 21 12:08:00.836879 dv-cinder-858678-1-smb devstack@keystone.service[81377]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81377) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 21 12:08:00.845011 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-5cab695c-2fa8-4771-b6f2-e6e1557ddcc4 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 21 12:08:00.845011 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:00.845011 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 21 12:08:00.845011 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 21 12:08:00.845011 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 21 12:08:00.845011 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 21 12:08:00.845011 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 21 12:08:00.845011 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application result = self._query(query) Sep 21 12:08:00.845011 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 21 12:08:00.845011 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application conn.query(q) Sep 21 12:08:00.845011 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 21 12:08:00.845011 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 21 12:08:00.845011 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 21 12:08:00.845011 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application result.read() Sep 21 12:08:00.845011 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 21 12:08:00.846031 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 21 12:08:00.846031 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 21 12:08:00.846031 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 21 12:08:00.846031 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 21 12:08:00.846031 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 21 12:08:00.846031 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 21 12:08:00.846031 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 21 12:08:00.846031 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 21 12:08:00.846031 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:08:00.846031 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 21 12:08:00.846031 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:08:00.846031 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:00.846031 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 21 12:08:00.846031 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 21 12:08:00.846031 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 21 12:08:00.846031 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 21 12:08:00.846031 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 21 12:08:00.846031 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application next(self.gen) Sep 21 12:08:00.847025 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 21 12:08:00.847025 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application yield resource Sep 21 12:08:00.847025 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 21 12:08:00.847025 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application next(self.gen) Sep 21 12:08:00.847025 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 21 12:08:00.847025 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application self.session.rollback() Sep 21 12:08:00.847025 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 21 12:08:00.847025 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application self.force_reraise() Sep 21 12:08:00.847025 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 21 12:08:00.847025 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise self.value Sep 21 12:08:00.847025 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 21 12:08:00.847025 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 21 12:08:00.847025 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 21 12:08:00.847025 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application session.commit() Sep 21 12:08:00.847025 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 21 12:08:00.847025 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 21 12:08:00.847025 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 21 12:08:00.847919 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application self._prepare_impl() Sep 21 12:08:00.847919 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 21 12:08:00.847919 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application self.session.flush() Sep 21 12:08:00.847919 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 21 12:08:00.847919 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application self._flush(objects) Sep 21 12:08:00.847919 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 21 12:08:00.847919 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 21 12:08:00.847919 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 21 12:08:00.847919 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application compat.raise_( Sep 21 12:08:00.847919 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 21 12:08:00.847919 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception Sep 21 12:08:00.847919 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 21 12:08:00.847919 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application flush_context.execute() Sep 21 12:08:00.847919 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 21 12:08:00.847919 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rec.execute(self) Sep 21 12:08:00.847919 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 21 12:08:00.847919 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 21 12:08:00.850101 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 21 12:08:00.850101 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 21 12:08:00.850101 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 21 12:08:00.850101 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 21 12:08:00.850101 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 21 12:08:00.850101 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 21 12:08:00.850101 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 21 12:08:00.850101 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 21 12:08:00.850101 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 21 12:08:00.850101 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 21 12:08:00.850101 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 21 12:08:00.850101 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 21 12:08:00.850101 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 21 12:08:00.850101 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 21 12:08:00.850101 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 21 12:08:00.850101 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception Sep 21 12:08:00.853412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 21 12:08:00.853412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 21 12:08:00.853412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 21 12:08:00.853412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 21 12:08:00.853412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 21 12:08:00.853412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application result = self._query(query) Sep 21 12:08:00.853412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 21 12:08:00.853412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application conn.query(q) Sep 21 12:08:00.853412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 21 12:08:00.853412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 21 12:08:00.853412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 21 12:08:00.853412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application result.read() Sep 21 12:08:00.853412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 21 12:08:00.853412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 21 12:08:00.853412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 21 12:08:00.853412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 21 12:08:00.854816 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 21 12:08:00.854816 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 21 12:08:00.854816 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 21 12:08:00.854816 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 21 12:08:00.854816 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 21 12:08:00.854816 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 21 12:08:00.854816 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [parameters: {'user_id': '053c7393147b4ad9b22bff4f2707189f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 21 12:08:00.854816 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 21 12:08:00.854816 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:08:00.854816 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 12:08:00.854816 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:08:00.854816 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:00.854816 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:08:00.854816 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:08:00.854816 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:08:00.855826 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:08:00.855826 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:08:00.855826 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:08:00.855826 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:08:00.855826 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:08:00.855826 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:08:00.855826 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:08:00.855826 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 21 12:08:00.855826 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 21 12:08:00.855826 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:08:00.855826 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:08:00.855826 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 12:08:00.855826 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:08:00.855826 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 12:08:00.855826 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:08:00.855826 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 21 12:08:00.855826 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 21 12:08:00.856951 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 21 12:08:00.856951 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 21 12:08:00.856951 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 21 12:08:00.856951 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 21 12:08:00.856951 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 21 12:08:00.856951 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:08:00.856951 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 488/974] 10.222.0.60 () {60 vars in 1131 bytes} [Wed Sep 21 12:08:00 2022] POST /identity/v3/users => generated 160 bytes in 191 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:08:00.856951 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab695c-2fa8-4771-b6f2-e6e1557ddcc4 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:00.879506 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9958e5d-cc2d-487a-a116-4cf07557e63d None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:00.905319 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:00.924891 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4fae1-33c9-4125-8883-60700f9073ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:00.925507 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4fae1-33c9-4125-8883-60700f9073ff None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:00.925826 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4fae1-33c9-4125-8883-60700f9073ff None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:00.926049 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4fae1-33c9-4125-8883-60700f9073ff None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:00.926712 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d4fae1-33c9-4125-8883-60700f9073ff None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:00.927011 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d4fae1-33c9-4125-8883-60700f9073ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:00.928424 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d4fae1-33c9-4125-8883-60700f9073ff None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:00.933579 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 487/975] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Sep 21 12:08:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:00.934344 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4fae1-33c9-4125-8883-60700f9073ff None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:00.982947 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab695c-2fa8-4771-b6f2-e6e1557ddcc4 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:01.029787 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ff8d8-a178-44a1-8876-8f9f3699a83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:01.031090 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ff8d8-a178-44a1-8876-8f9f3699a83b None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:01.031796 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ff8d8-a178-44a1-8876-8f9f3699a83b None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:01.032271 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ff8d8-a178-44a1-8876-8f9f3699a83b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:01.048647 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4fae1-33c9-4125-8883-60700f9073ff None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:01.082656 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:01.086118 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f72c3f-5d33-4d7b-962a-403a093b3cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:01.086788 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f72c3f-5d33-4d7b-962a-403a093b3cb4 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:01.087064 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f72c3f-5d33-4d7b-962a-403a093b3cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:01.087335 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f72c3f-5d33-4d7b-962a-403a093b3cb4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:01.095418 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f72c3f-5d33-4d7b-962a-403a093b3cb4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:01.096883 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f72c3f-5d33-4d7b-962a-403a093b3cb4 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:01.108201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-03f72c3f-5d33-4d7b-962a-403a093b3cb4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 21 12:08:01.108201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:01.108201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:08:01.108201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:08:01.108201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:08:01.108201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:08:01.108201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:08:01.108201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:08:01.108201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:08:01.108201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:08:01.108201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:08:01.108201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:08:01.108201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 12:08:01.108201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 12:08:01.108201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 12:08:01.108201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 12:08:01.109188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:08:01.109188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:08:01.109188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 12:08:01.109188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:08:01.109188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 12:08:01.109188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:08:01.109188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:08:01.109188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:08:01.109188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:08:01.109188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:08:01.109188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:08:01.109188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:08:01.109188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:08:01.109188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:08:01.109188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:08:01.109188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:08:01.109188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:08:01.109188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:08:01.110225 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:08:01.110225 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:08:01.110225 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 12:08:01.110225 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 12:08:01.110225 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 12:08:01.110225 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 12:08:01.110225 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 12:08:01.110225 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 12:08:01.110225 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 21 12:08:01.110225 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:08:01.110225 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 488/976] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:08:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:08:01.110225 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f72c3f-5d33-4d7b-962a-403a093b3cb4 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:01.112607 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ff8d8-a178-44a1-8876-8f9f3699a83b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:01.114621 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ff8d8-a178-44a1-8876-8f9f3699a83b None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:01.157037 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:01.220275 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 489/977] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:08:00 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 12:08:01.221759 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae942a7-a352-4e5d-8ef2-9dca2251d5f3 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:01.222166 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae942a7-a352-4e5d-8ef2-9dca2251d5f3 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:01.222610 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae942a7-a352-4e5d-8ef2-9dca2251d5f3 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:01.223652 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f72c3f-5d33-4d7b-962a-403a093b3cb4 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:01.228901 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 490/978] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:08:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:08:01.229675 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae942a7-a352-4e5d-8ef2-9dca2251d5f3 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:01.261218 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973f42a-b468-4bff-b76e-6f6a95cc31c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:01.261847 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973f42a-b468-4bff-b76e-6f6a95cc31c9 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:01.262134 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973f42a-b468-4bff-b76e-6f6a95cc31c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:01.262688 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973f42a-b468-4bff-b76e-6f6a95cc31c9 None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:01.263317 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e973f42a-b468-4bff-b76e-6f6a95cc31c9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:01.263620 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e973f42a-b468-4bff-b76e-6f6a95cc31c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:01.265032 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e973f42a-b468-4bff-b76e-6f6a95cc31c9 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:01.269877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 489/979] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Sep 21 12:08:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:01.272205 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973f42a-b468-4bff-b76e-6f6a95cc31c9 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:01.307975 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:01.334288 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae942a7-a352-4e5d-8ef2-9dca2251d5f3 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:01.368305 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc2295-66f4-4fb1-b683-4169af5637d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:01.368910 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc2295-66f4-4fb1-b683-4169af5637d6 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:01.369194 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc2295-66f4-4fb1-b683-4169af5637d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:01.369468 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc2295-66f4-4fb1-b683-4169af5637d6 None admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:01.370165 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc2295-66f4-4fb1-b683-4169af5637d6 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:01.370492 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc2295-66f4-4fb1-b683-4169af5637d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:01.371188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973f42a-b468-4bff-b76e-6f6a95cc31c9 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:01.371920 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc2295-66f4-4fb1-b683-4169af5637d6 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:01.380916 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:01.409661 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 491/980] 10.222.0.60 () {56 vars in 1101 bytes} [Wed Sep 21 12:08:01 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:01.410750 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff1b0a-bf2c-48c8-afb6-8cce6cb365b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:01.410880 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba657e-dec1-4829-9169-9323180f5e19 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:01.411116 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba657e-dec1-4829-9169-9323180f5e19 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:01.411381 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff1b0a-bf2c-48c8-afb6-8cce6cb365b9 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:01.411530 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba657e-dec1-4829-9169-9323180f5e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:01.412276 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff1b0a-bf2c-48c8-afb6-8cce6cb365b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:01.412555 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff1b0a-bf2c-48c8-afb6-8cce6cb365b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:01.424974 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff1b0a-bf2c-48c8-afb6-8cce6cb365b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:01.426512 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff1b0a-bf2c-48c8-afb6-8cce6cb365b9 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:01.431590 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-94ba657e-dec1-4829-9169-9323180f5e19 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:08:01.433195 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-94ba657e-dec1-4829-9169-9323180f5e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:08:01.442899 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-35ff1b0a-bf2c-48c8-afb6-8cce6cb365b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:08:01.442899 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:01.442899 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:08:01.442899 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:08:01.442899 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:08:01.442899 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:08:01.442899 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:08:01.442899 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:08:01.442899 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:08:01.442899 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:08:01.442899 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:08:01.442899 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:08:01.442899 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:08:01.442899 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:08:01.442899 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:08:01.442899 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:08:01.443982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:08:01.443982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:08:01.443982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:08:01.443982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:08:01.443982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:08:01.443982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:08:01.443982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:08:01.443982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:08:01.443982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:08:01.443982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:08:01.443982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:08:01.443982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:08:01.443982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:08:01.443982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:08:01.443982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:08:01.443982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:08:01.443982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:08:01.444939 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:08:01.444939 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:08:01.444939 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:08:01.444939 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 490/981] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:08:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:08:01.446680 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff1b0a-bf2c-48c8-afb6-8cce6cb365b9 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:01.526338 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 492/982] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:08:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:08:01.527534 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba657e-dec1-4829-9169-9323180f5e19 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:01.581008 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff1b0a-bf2c-48c8-afb6-8cce6cb365b9 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:01.607882 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:01.623628 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8465b4-d6c3-47f1-9873-f35e6695b5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:01.624247 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8465b4-d6c3-47f1-9873-f35e6695b5ea None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:01.624528 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8465b4-d6c3-47f1-9873-f35e6695b5ea None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:01.624800 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8465b4-d6c3-47f1-9873-f35e6695b5ea None admin] PATH_INFO: `/v3/endpoints` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:01.626022 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8465b4-d6c3-47f1-9873-f35e6695b5ea None admin] RBAC: Adding query filter params (interface=admin, service_id=3c7f97c16c6c43ac9abed947b57d7c62, region_id=RegionOne) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:01.626349 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8465b4-d6c3-47f1-9873-f35e6695b5ea None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:01.628414 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8465b4-d6c3-47f1-9873-f35e6695b5ea None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:01.635791 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 491/983] 10.222.0.60 () {56 vars in 1249 bytes} [Wed Sep 21 12:08:01 2022] GET /identity/v3/endpoints?service_id=3c7f97c16c6c43ac9abed947b57d7c62&interface=admin®ion_id=RegionOne => generated 193 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:01.641271 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8465b4-d6c3-47f1-9873-f35e6695b5ea None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:01.654736 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba657e-dec1-4829-9169-9323180f5e19 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:01.676410 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:01.700931 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5bf359-4faf-43da-9f71-2896404838ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:01.701898 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5bf359-4faf-43da-9f71-2896404838ac None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:01.702195 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5bf359-4faf-43da-9f71-2896404838ac None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:01.702522 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5bf359-4faf-43da-9f71-2896404838ac None admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:01.703229 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5bf359-4faf-43da-9f71-2896404838ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:01.703548 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5bf359-4faf-43da-9f71-2896404838ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:01.705003 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5bf359-4faf-43da-9f71-2896404838ac None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:01.724536 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 493/984] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:01.731230 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5bf359-4faf-43da-9f71-2896404838ac None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:01.772370 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8465b4-d6c3-47f1-9873-f35e6695b5ea None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:01.812845 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9f77a-3471-47cf-a21b-c48602b2ee58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:01.813761 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9f77a-3471-47cf-a21b-c48602b2ee58 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:01.814219 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9f77a-3471-47cf-a21b-c48602b2ee58 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:01.814699 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9f77a-3471-47cf-a21b-c48602b2ee58 None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:01.815452 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae9f77a-3471-47cf-a21b-c48602b2ee58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:01.818395 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae9f77a-3471-47cf-a21b-c48602b2ee58 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:01.830565 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 492/985] 10.222.0.60 () {56 vars in 1087 bytes} [Wed Sep 21 12:08:01 2022] GET /identity/v3/services => generated 1497 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:08:01.831508 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9f77a-3471-47cf-a21b-c48602b2ee58 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:01.852716 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5bf359-4faf-43da-9f71-2896404838ac None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:01.884286 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:01.900750 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540659e2-a6bf-44ca-bd7c-a1b9d0c8c4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:01.901521 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540659e2-a6bf-44ca-bd7c-a1b9d0c8c4fc None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:01.901909 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540659e2-a6bf-44ca-bd7c-a1b9d0c8c4fc None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:01.902191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540659e2-a6bf-44ca-bd7c-a1b9d0c8c4fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:01.910523 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540659e2-a6bf-44ca-bd7c-a1b9d0c8c4fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:01.912843 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540659e2-a6bf-44ca-bd7c-a1b9d0c8c4fc None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:01.926180 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-540659e2-a6bf-44ca-bd7c-a1b9d0c8c4fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:08:01.926180 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:01.926180 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:08:01.926180 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:08:01.926180 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:08:01.926180 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:08:01.926180 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:08:01.926180 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:08:01.926180 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:08:01.926180 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:08:01.926180 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:08:01.926180 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:08:01.926180 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 12:08:01.926180 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 12:08:01.926180 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 12:08:01.928188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 12:08:01.928188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:08:01.928188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:08:01.928188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:08:01.928188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:08:01.928188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:08:01.928188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:08:01.928188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:08:01.928188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:08:01.928188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:08:01.928188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:08:01.928188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:08:01.928188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:08:01.928188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:08:01.928188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:08:01.928188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:08:01.928188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:08:01.929191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 12:08:01.929191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 12:08:01.929191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 12:08:01.929191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 12:08:01.929191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 12:08:01.929191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 12:08:01.929191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:08:01.929191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:08:01.929191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 494/986] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:08:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:08:01.934350 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540659e2-a6bf-44ca-bd7c-a1b9d0c8c4fc None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:01.942232 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:01.957067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9f77a-3471-47cf-a21b-c48602b2ee58 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:01.996110 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d993080-0f13-4b44-88b6-ea551e597d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:01.996732 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d993080-0f13-4b44-88b6-ea551e597d9e None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:01.997012 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d993080-0f13-4b44-88b6-ea551e597d9e None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:01.997287 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d993080-0f13-4b44-88b6-ea551e597d9e None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:01.997945 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d993080-0f13-4b44-88b6-ea551e597d9e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:01.999374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d993080-0f13-4b44-88b6-ea551e597d9e None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:02.016406 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 493/987] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Sep 21 12:08:01 2022] POST /identity/v3/services => generated 242 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:08:02.055314 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540659e2-a6bf-44ca-bd7c-a1b9d0c8c4fc None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:02.110986 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae651c73-f74f-4eba-8a02-4f73f909a48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:02.111615 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae651c73-f74f-4eba-8a02-4f73f909a48d None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:02.111892 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae651c73-f74f-4eba-8a02-4f73f909a48d None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:02.112160 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae651c73-f74f-4eba-8a02-4f73f909a48d None admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:02.112863 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae651c73-f74f-4eba-8a02-4f73f909a48d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:02.113217 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae651c73-f74f-4eba-8a02-4f73f909a48d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:02.114806 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae651c73-f74f-4eba-8a02-4f73f909a48d None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:02.133954 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 495/988] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Sep 21 12:08:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:02.135470 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d993080-0f13-4b44-88b6-ea551e597d9e None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:02.251401 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d993080-0f13-4b44-88b6-ea551e597d9e None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:02.285506 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baeab3b-ff10-42be-b97d-ebca0cbdd76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:02.286106 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baeab3b-ff10-42be-b97d-ebca0cbdd76a None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:02.286399 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baeab3b-ff10-42be-b97d-ebca0cbdd76a None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:02.287223 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baeab3b-ff10-42be-b97d-ebca0cbdd76a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:02.287941 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baeab3b-ff10-42be-b97d-ebca0cbdd76a None admin] RBAC: Adding query filter params (role.id=a0f76a5a7b9c4af794c33ce6078ca7be, scope.project.id=b0abcc6f2ce14825bfc26e6210889c21, user.id=bbd7a1d5a8d04e3798ffcab27bad936b) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:02.288240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baeab3b-ff10-42be-b97d-ebca0cbdd76a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:02.289667 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baeab3b-ff10-42be-b97d-ebca0cbdd76a None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:02.295537 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 494/989] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:08:02 2022] GET /identity/v3/role_assignments?user.id=bbd7a1d5a8d04e3798ffcab27bad936b&scope.project.id=b0abcc6f2ce14825bfc26e6210889c21&role.id=a0f76a5a7b9c4af794c33ce6078ca7be => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:08:04.051822 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581f49f-78fc-45db-b611-ace0aa1e08df None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:04.052957 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581f49f-78fc-45db-b611-ace0aa1e08df None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:04.053040 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581f49f-78fc-45db-b611-ace0aa1e08df None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:04.054417 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 496/990] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:08:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:08:04.059971 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e25239-cae2-4458-86ae-64753bc57277 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:04.060385 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e25239-cae2-4458-86ae-64753bc57277 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:04.060573 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e25239-cae2-4458-86ae-64753bc57277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:04.079000 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-a8e25239-cae2-4458-86ae-64753bc57277 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:08:04.080199 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a8e25239-cae2-4458-86ae-64753bc57277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:08:04.088180 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:04.157937 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 495/991] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:08:04 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:08:04.242839 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b603eca-b543-4059-996e-1d04d5ffa9fb None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:04.243174 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b603eca-b543-4059-996e-1d04d5ffa9fb None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:04.243385 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b603eca-b543-4059-996e-1d04d5ffa9fb None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:04.244870 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 497/992] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:08:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:08:04.249825 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55cc7e-ceda-41a1-b268-c24a1570941d None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:04.250117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55cc7e-ceda-41a1-b268-c24a1570941d None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:04.250413 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55cc7e-ceda-41a1-b268-c24a1570941d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:04.269334 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-9a55cc7e-ceda-41a1-b268-c24a1570941d None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:08:04.270569 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-9a55cc7e-ceda-41a1-b268-c24a1570941d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:08:04.338509 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 496/993] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:08:04 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:08:04.428142 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b603eca-b543-4059-996e-1d04d5ffa9fb None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:04.461915 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea925b-4406-49d4-8ba2-a4ad0dacad7a None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:04.462278 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea925b-4406-49d4-8ba2-a4ad0dacad7a None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:04.462495 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea925b-4406-49d4-8ba2-a4ad0dacad7a None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:04.464105 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 497/994] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:08:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:08:04.469136 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2bc89-4f13-4d08-a4c4-be5584f03e08 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:04.469417 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2bc89-4f13-4d08-a4c4-be5584f03e08 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:04.470241 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2bc89-4f13-4d08-a4c4-be5584f03e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:04.470351 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:04.488283 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-2ec2bc89-4f13-4d08-a4c4-be5584f03e08 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:08:04.489499 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2ec2bc89-4f13-4d08-a4c4-be5584f03e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:08:04.538579 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b603eca-b543-4059-996e-1d04d5ffa9fb None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:04.568529 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 498/995] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:08:04 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 12:08:04.587514 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc1104-526d-4a5b-a0e2-145fdf40c0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:04.588149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc1104-526d-4a5b-a0e2-145fdf40c0a2 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:04.588431 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc1104-526d-4a5b-a0e2-145fdf40c0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:04.588759 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc1104-526d-4a5b-a0e2-145fdf40c0a2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:04.589293 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc1104-526d-4a5b-a0e2-145fdf40c0a2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:04.590688 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc1104-526d-4a5b-a0e2-145fdf40c0a2 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:04.599867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-8ecc1104-526d-4a5b-a0e2-145fdf40c0a2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 12:08:04.599867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:04.599867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 12:08:04.599867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 12:08:04.599867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 12:08:04.599867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 12:08:04.599867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 12:08:04.599867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:08:04.599867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 12:08:04.599867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:08:04.599867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 12:08:04.599867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:08:04.599867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:04.599867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:08:04.599867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:08:04.599867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:08:04.599867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:08:04.600873 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:08:04.600873 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:08:04.600873 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:08:04.600873 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:08:04.600873 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:08:04.600873 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:08:04.600873 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 12:08:04.600873 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 12:08:04.600873 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 12:08:04.600873 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 12:08:04.600873 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:08:04.600873 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:08:04.600873 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:08:04.600873 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:08:04.600873 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:08:04.600873 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:08:04.601774 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:08:04.601774 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:08:04.601774 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:08:04.601774 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:08:04.601774 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:08:04.601774 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:08:04.601774 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:08:04.601774 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:08:04.601774 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:08:04.601774 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:08:04.601774 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 12:08:04.601774 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:08:04.601774 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 21 12:08:04.601774 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:08:04.601774 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 498/996] 10.222.0.60 () {56 vars in 1126 bytes} [Wed Sep 21 12:08:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:08:04.608215 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2bc89-4f13-4d08-a4c4-be5584f03e08 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:04.608951 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc1104-526d-4a5b-a0e2-145fdf40c0a2 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:04.610850 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:04.713007 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc1104-526d-4a5b-a0e2-145fdf40c0a2 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:04.714587 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:04.722371 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2bc89-4f13-4d08-a4c4-be5584f03e08 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:04.747848 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630573e-ae71-45aa-923a-80e2f8ad1de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:04.748454 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630573e-ae71-45aa-923a-80e2f8ad1de6 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:04.748733 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630573e-ae71-45aa-923a-80e2f8ad1de6 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:04.748995 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630573e-ae71-45aa-923a-80e2f8ad1de6 None admin] PATH_INFO: `/v3/services` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:04.749622 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630573e-ae71-45aa-923a-80e2f8ad1de6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:04.749922 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630573e-ae71-45aa-923a-80e2f8ad1de6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:04.751305 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630573e-ae71-45aa-923a-80e2f8ad1de6 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:04.756898 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 499/997] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Sep 21 12:08:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:08:04.762763 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7278f-b7be-4f7a-9a3f-aa9514990b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:04.763036 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630573e-ae71-45aa-923a-80e2f8ad1de6 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:04.763391 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7278f-b7be-4f7a-9a3f-aa9514990b75 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:04.763667 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7278f-b7be-4f7a-9a3f-aa9514990b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:04.763935 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7278f-b7be-4f7a-9a3f-aa9514990b75 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:04.764540 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e7278f-b7be-4f7a-9a3f-aa9514990b75 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:04.765896 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e7278f-b7be-4f7a-9a3f-aa9514990b75 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:04.775363 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-45e7278f-b7be-4f7a-9a3f-aa9514990b75 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 21 12:08:04.775363 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:04.775363 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 12:08:04.775363 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 12:08:04.775363 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 12:08:04.775363 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 12:08:04.775363 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 12:08:04.775363 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:08:04.775363 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 21 12:08:04.775363 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:08:04.775363 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 12:08:04.775363 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:08:04.775363 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:04.775363 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:08:04.775363 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:08:04.775363 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:08:04.775363 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:08:04.776374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:08:04.776374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:08:04.776374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:08:04.776374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:08:04.776374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:08:04.776374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:08:04.776374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 12:08:04.776374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 12:08:04.776374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 12:08:04.776374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 12:08:04.776374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:08:04.776374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:08:04.776374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:08:04.776374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:08:04.776374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:08:04.776374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:08:04.782274 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:08:04.782274 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:08:04.782274 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:08:04.782274 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:08:04.782274 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:08:04.782274 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:08:04.782274 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:08:04.782274 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:08:04.782274 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:08:04.782274 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:08:04.782274 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 12:08:04.782274 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:08:04.782274 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 21 12:08:04.782274 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:08:04.782274 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 499/998] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:08:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:08:04.783109 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7278f-b7be-4f7a-9a3f-aa9514990b75 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:04.852946 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:04.870228 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630573e-ae71-45aa-923a-80e2f8ad1de6 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:04.891430 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7278f-b7be-4f7a-9a3f-aa9514990b75 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:04.908948 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17397fc9-1954-47cd-882a-31491891b337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:04.912306 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17397fc9-1954-47cd-882a-31491891b337 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:04.912604 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17397fc9-1954-47cd-882a-31491891b337 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:04.912883 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17397fc9-1954-47cd-882a-31491891b337 None admin] PATH_INFO: `/v3/services` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:04.913558 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17397fc9-1954-47cd-882a-31491891b337 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:04.913883 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17397fc9-1954-47cd-882a-31491891b337 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:04.915639 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17397fc9-1954-47cd-882a-31491891b337 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:04.922268 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 500/999] 10.222.0.60 () {56 vars in 1122 bytes} [Wed Sep 21 12:08:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:08:04.923160 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17397fc9-1954-47cd-882a-31491891b337 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:04.937018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9442082-0a92-44de-a796-67cf4f81c037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:04.937906 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9442082-0a92-44de-a796-67cf4f81c037 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:04.938328 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9442082-0a92-44de-a796-67cf4f81c037 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:04.938777 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9442082-0a92-44de-a796-67cf4f81c037 None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:04.939742 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9442082-0a92-44de-a796-67cf4f81c037 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:04.940204 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9442082-0a92-44de-a796-67cf4f81c037 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:04.942351 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9442082-0a92-44de-a796-67cf4f81c037 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:04.954402 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 500/1000] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Sep 21 12:08:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:04.954402 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9442082-0a92-44de-a796-67cf4f81c037 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:04.958144 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:05.029917 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17397fc9-1954-47cd-882a-31491891b337 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:05.060194 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9442082-0a92-44de-a796-67cf4f81c037 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:05.063865 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e452b-3aec-4a2f-89a5-9149020b798a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:05.064493 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e452b-3aec-4a2f-89a5-9149020b798a None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:05.064770 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e452b-3aec-4a2f-89a5-9149020b798a None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:05.065038 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e452b-3aec-4a2f-89a5-9149020b798a None admin] PATH_INFO: `/v3/services/image` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:05.065613 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e452b-3aec-4a2f-89a5-9149020b798a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:05.067010 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e452b-3aec-4a2f-89a5-9149020b798a None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:05.076699 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-405e452b-3aec-4a2f-89a5-9149020b798a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 21 12:08:05.076699 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:05.076699 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 12:08:05.076699 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 12:08:05.076699 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 12:08:05.076699 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 12:08:05.076699 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 12:08:05.076699 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:08:05.076699 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 21 12:08:05.076699 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:08:05.076699 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 12:08:05.076699 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:08:05.076699 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:05.076699 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:08:05.076699 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:08:05.076699 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:08:05.076699 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:08:05.077828 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:08:05.077828 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:08:05.077828 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:08:05.077828 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:08:05.077828 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:08:05.077828 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:08:05.077828 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 12:08:05.077828 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 12:08:05.077828 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 12:08:05.077828 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 12:08:05.077828 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:08:05.077828 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:08:05.077828 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:08:05.077828 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:08:05.077828 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:08:05.077828 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:08:05.079284 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:08:05.079284 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:08:05.079284 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:08:05.079284 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:08:05.079284 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:08:05.079284 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:08:05.079284 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:08:05.079284 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:08:05.079284 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:08:05.079284 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:08:05.079284 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 12:08:05.079284 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:08:05.079284 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 21 12:08:05.079284 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:08:05.079284 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 501/1001] 10.222.0.60 () {56 vars in 1105 bytes} [Wed Sep 21 12:08:04 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:08:05.080176 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e452b-3aec-4a2f-89a5-9149020b798a None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:05.092317 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:05.099492 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a015d-a7b5-48d9-92ea-0de710de6fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:05.100104 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a015d-a7b5-48d9-92ea-0de710de6fbb None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:05.100381 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a015d-a7b5-48d9-92ea-0de710de6fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:05.100650 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a015d-a7b5-48d9-92ea-0de710de6fbb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:05.101307 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a015d-a7b5-48d9-92ea-0de710de6fbb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:05.102773 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a015d-a7b5-48d9-92ea-0de710de6fbb None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:05.120271 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 501/1002] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:08:04 2022] POST /identity/v3/endpoints => generated 325 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:08:05.121003 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a015d-a7b5-48d9-92ea-0de710de6fbb None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:05.184703 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:05.194368 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e452b-3aec-4a2f-89a5-9149020b798a None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:05.250561 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f0192-df22-41c3-938e-dfef800b8e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:05.251584 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f0192-df22-41c3-938e-dfef800b8e51 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:05.252053 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f0192-df22-41c3-938e-dfef800b8e51 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:05.252492 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f0192-df22-41c3-938e-dfef800b8e51 None admin] PATH_INFO: `/v3/services` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:05.253324 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f0192-df22-41c3-938e-dfef800b8e51 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:05.254148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f0192-df22-41c3-938e-dfef800b8e51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:05.254697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a015d-a7b5-48d9-92ea-0de710de6fbb None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:05.256859 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f0192-df22-41c3-938e-dfef800b8e51 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:05.263101 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 502/1003] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Sep 21 12:08:05 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:05.269817 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f0192-df22-41c3-938e-dfef800b8e51 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:05.309695 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e3dcce-88ba-4f46-8ed2-78c5e6fce5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:05.309991 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3dcce-88ba-4f46-8ed2-78c5e6fce5d3 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:05.310281 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3dcce-88ba-4f46-8ed2-78c5e6fce5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:05.310581 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3dcce-88ba-4f46-8ed2-78c5e6fce5d3 None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:05.311233 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e3dcce-88ba-4f46-8ed2-78c5e6fce5d3 None admin] RBAC: Adding query filter params (name=image) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:05.311536 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e3dcce-88ba-4f46-8ed2-78c5e6fce5d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:05.312927 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e3dcce-88ba-4f46-8ed2-78c5e6fce5d3 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:05.321097 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 502/1004] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:08:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:05.326453 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e3dcce-88ba-4f46-8ed2-78c5e6fce5d3 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:05.396460 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f0192-df22-41c3-938e-dfef800b8e51 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:05.397994 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:05.432472 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33143402-2ffc-431b-b239-d2a2cb94da55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:05.433086 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33143402-2ffc-431b-b239-d2a2cb94da55 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:05.433430 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33143402-2ffc-431b-b239-d2a2cb94da55 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:05.433710 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33143402-2ffc-431b-b239-d2a2cb94da55 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:05.434435 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33143402-2ffc-431b-b239-d2a2cb94da55 None admin] RBAC: Adding query filter params (interface=public, service_id=4d33fe980f4b414281dd0325b8356246, region_id=RegionOne) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:05.434741 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33143402-2ffc-431b-b239-d2a2cb94da55 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:05.436105 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33143402-2ffc-431b-b239-d2a2cb94da55 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:05.446971 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 503/1005] 10.222.0.60 () {56 vars in 1251 bytes} [Wed Sep 21 12:08:05 2022] GET /identity/v3/endpoints?service_id=4d33fe980f4b414281dd0325b8356246&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:08:05.448066 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33143402-2ffc-431b-b239-d2a2cb94da55 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:05.457233 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e3dcce-88ba-4f46-8ed2-78c5e6fce5d3 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:05.467767 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:05.495276 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e9613-649c-415f-8960-95a77b62e222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:05.495894 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e9613-649c-415f-8960-95a77b62e222 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:05.496174 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e9613-649c-415f-8960-95a77b62e222 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:05.496564 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e9613-649c-415f-8960-95a77b62e222 None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:05.497556 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e9613-649c-415f-8960-95a77b62e222 None admin] RBAC: Adding query filter params (type=image) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:05.497690 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e9613-649c-415f-8960-95a77b62e222 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:05.499050 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e9613-649c-415f-8960-95a77b62e222 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:05.504556 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 503/1006] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:08:05 2022] GET /identity/v3/services?type=image => generated 122 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:08:05.554723 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33143402-2ffc-431b-b239-d2a2cb94da55 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:05.599745 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b3db6-35d1-4232-b3c1-683485da501e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:05.600370 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b3db6-35d1-4232-b3c1-683485da501e None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:05.600647 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b3db6-35d1-4232-b3c1-683485da501e None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:05.600917 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b3db6-35d1-4232-b3c1-683485da501e None admin] PATH_INFO: `/v3/services` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:05.601541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b3db6-35d1-4232-b3c1-683485da501e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:05.602996 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b3db6-35d1-4232-b3c1-683485da501e None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:05.610282 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 504/1007] 10.222.0.60 () {56 vars in 1087 bytes} [Wed Sep 21 12:08:05 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:08:07.379450 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f19b7-89d3-49f0-b842-c2b4320fee4b None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:07.380008 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f19b7-89d3-49f0-b842-c2b4320fee4b None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:07.380281 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f19b7-89d3-49f0-b842-c2b4320fee4b None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:07.381936 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 504/1008] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:08:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:08:07.387589 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039b954-f315-4d1f-a55b-1c5ee0d7e041 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:07.387983 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039b954-f315-4d1f-a55b-1c5ee0d7e041 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:07.388160 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039b954-f315-4d1f-a55b-1c5ee0d7e041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:07.406138 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-7039b954-f315-4d1f-a55b-1c5ee0d7e041 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:08:07.407350 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-7039b954-f315-4d1f-a55b-1c5ee0d7e041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:08:07.484768 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 505/1009] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:08:07 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:08:07.697801 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17654b5-18d0-45c0-8d81-42822f9d977b None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:07.697992 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17654b5-18d0-45c0-8d81-42822f9d977b None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:07.698263 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17654b5-18d0-45c0-8d81-42822f9d977b None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:07.699769 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 505/1010] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:08:07.704796 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41958f24-fbc0-4317-9a7a-b3248d8a61dc None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:07.705089 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41958f24-fbc0-4317-9a7a-b3248d8a61dc None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:07.705366 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41958f24-fbc0-4317-9a7a-b3248d8a61dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:07.724406 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-41958f24-fbc0-4317-9a7a-b3248d8a61dc None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:08:07.725600 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-41958f24-fbc0-4317-9a7a-b3248d8a61dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:08:07.734117 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:07.751412 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17654b5-18d0-45c0-8d81-42822f9d977b None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:07.803152 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 506/1011] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:08:07 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:08:07.858737 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17654b5-18d0-45c0-8d81-42822f9d977b None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:07.862851 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eebc4b-9e45-4a1f-946c-ce705562024e None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:07.863141 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eebc4b-9e45-4a1f-946c-ce705562024e None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:07.863412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eebc4b-9e45-4a1f-946c-ce705562024e None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:07.868682 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 507/1012] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:08:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:08:07.870568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7c42e-ad31-4737-8e6c-816cf0635ac5 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:07.870852 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7c42e-ad31-4737-8e6c-816cf0635ac5 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:07.871128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7c42e-ad31-4737-8e6c-816cf0635ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:07.877386 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:07.890461 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-b5b7c42e-ad31-4737-8e6c-816cf0635ac5 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:08:07.891668 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-b5b7c42e-ad31-4737-8e6c-816cf0635ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:08:07.897009 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c476cb-a717-4faf-be58-6b0edc4e5d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:07.897866 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c476cb-a717-4faf-be58-6b0edc4e5d0d None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:07.898287 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c476cb-a717-4faf-be58-6b0edc4e5d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:07.898725 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c476cb-a717-4faf-be58-6b0edc4e5d0d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:07.899995 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c476cb-a717-4faf-be58-6b0edc4e5d0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:07.901569 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c476cb-a717-4faf-be58-6b0edc4e5d0d None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:07.903303 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 506/1013] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:08:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:08:07.909074 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c476cb-a717-4faf-be58-6b0edc4e5d0d None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:07.978491 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 508/1014] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:08:07 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 12:08:08.021771 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c476cb-a717-4faf-be58-6b0edc4e5d0d None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:08.055903 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e3003-092d-4614-9f5d-1b51dcdb2648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:08.056752 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e3003-092d-4614-9f5d-1b51dcdb2648 None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:08.056752 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e3003-092d-4614-9f5d-1b51dcdb2648 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:08.057056 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e3003-092d-4614-9f5d-1b51dcdb2648 None admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:08.057677 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21e3003-092d-4614-9f5d-1b51dcdb2648 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:08.059134 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21e3003-092d-4614-9f5d-1b51dcdb2648 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:08.081353 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7c42e-ad31-4737-8e6c-816cf0635ac5 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:08.094388 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 507/1015] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Sep 21 12:08:07 2022] POST /identity/v3/projects => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:08:08.160783 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:08.196834 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7c42e-ad31-4737-8e6c-816cf0635ac5 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:08.233792 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1086a59-30ef-4bd2-9e10-ae8387963191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:08.234328 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1086a59-30ef-4bd2-9e10-ae8387963191 None admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:08.234633 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1086a59-30ef-4bd2-9e10-ae8387963191 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:08.234904 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1086a59-30ef-4bd2-9e10-ae8387963191 None admin] PATH_INFO: `/v3/services` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:08.235566 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1086a59-30ef-4bd2-9e10-ae8387963191 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:08.236962 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1086a59-30ef-4bd2-9e10-ae8387963191 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:08.254397 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 509/1016] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Sep 21 12:08:08 2022] POST /identity/v3/services => generated 242 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:08:08.264903 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e3003-092d-4614-9f5d-1b51dcdb2648 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:08.318035 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:08.388090 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e3003-092d-4614-9f5d-1b51dcdb2648 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:08.431453 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b3903-cdec-4c70-92c7-92d2218ee345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:08.432095 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b3903-cdec-4c70-92c7-92d2218ee345 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:08.432367 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b3903-cdec-4c70-92c7-92d2218ee345 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:08.432632 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b3903-cdec-4c70-92c7-92d2218ee345 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:08.433705 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104b3903-cdec-4c70-92c7-92d2218ee345 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:08.434578 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104b3903-cdec-4c70-92c7-92d2218ee345 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:08.445994 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-104b3903-cdec-4c70-92c7-92d2218ee345 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 21 12:08:08.445994 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:08.445994 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 12:08:08.445994 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 12:08:08.445994 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 12:08:08.445994 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 12:08:08.445994 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 12:08:08.445994 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:08:08.445994 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 21 12:08:08.445994 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:08:08.445994 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 12:08:08.445994 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:08:08.445994 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:08.445994 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:08:08.445994 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:08:08.445994 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:08:08.445994 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:08:08.447048 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:08:08.447048 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:08:08.447048 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:08:08.447048 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:08:08.447048 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:08:08.447048 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:08:08.447048 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 12:08:08.447048 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 12:08:08.447048 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 12:08:08.447048 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 12:08:08.447048 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:08:08.447048 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:08:08.447048 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:08:08.447048 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:08:08.447048 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:08:08.447048 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:08:08.447908 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:08:08.447908 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:08:08.447908 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:08:08.447908 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:08:08.447908 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:08:08.447908 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:08:08.447908 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:08:08.447908 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:08:08.447908 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:08:08.447908 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:08:08.447908 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 12:08:08.447908 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:08:08.447908 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 21 12:08:08.447908 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:08:08.447908 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 508/1017] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:08:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:08:08.454529 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1086a59-30ef-4bd2-9e10-ae8387963191 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:08.558866 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1086a59-30ef-4bd2-9e10-ae8387963191 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:08.592378 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:08.598329 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ab72f-ab0a-4d62-9e6b-13d5519e8a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:08.598982 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ab72f-ab0a-4d62-9e6b-13d5519e8a93 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:08.599645 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ab72f-ab0a-4d62-9e6b-13d5519e8a93 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:08.600272 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ab72f-ab0a-4d62-9e6b-13d5519e8a93 None admin] PATH_INFO: `/v3/services` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:08.601271 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ab72f-ab0a-4d62-9e6b-13d5519e8a93 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:08.601568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ab72f-ab0a-4d62-9e6b-13d5519e8a93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:08.602960 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ab72f-ab0a-4d62-9e6b-13d5519e8a93 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:08.608523 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 510/1018] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Sep 21 12:08:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:08.613944 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b3903-cdec-4c70-92c7-92d2218ee345 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:08.713991 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:08.718898 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b3903-cdec-4c70-92c7-92d2218ee345 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:08.751927 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34cc174-1fd5-4ede-83fe-78c2adfab9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:08.752522 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34cc174-1fd5-4ede-83fe-78c2adfab9c7 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:08.752802 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34cc174-1fd5-4ede-83fe-78c2adfab9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:08.753065 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34cc174-1fd5-4ede-83fe-78c2adfab9c7 None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:08.753684 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34cc174-1fd5-4ede-83fe-78c2adfab9c7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:08.753979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34cc174-1fd5-4ede-83fe-78c2adfab9c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:08.755888 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34cc174-1fd5-4ede-83fe-78c2adfab9c7 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:08.760951 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 509/1019] 10.222.0.60 () {56 vars in 1112 bytes} [Wed Sep 21 12:08:08 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:08.766657 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ab72f-ab0a-4d62-9e6b-13d5519e8a93 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:08.869144 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ab72f-ab0a-4d62-9e6b-13d5519e8a93 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:08.903297 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee4d5a-ff13-4eaa-8999-e116fbf72fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:08.903898 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee4d5a-ff13-4eaa-8999-e116fbf72fd3 None admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:08.904172 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee4d5a-ff13-4eaa-8999-e116fbf72fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:08.904433 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee4d5a-ff13-4eaa-8999-e116fbf72fd3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:08.905092 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee4d5a-ff13-4eaa-8999-e116fbf72fd3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:08.906469 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee4d5a-ff13-4eaa-8999-e116fbf72fd3 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:08.928485 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 511/1020] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:08:08 2022] POST /identity/v3/endpoints => generated 334 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:08:10.356696 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2904fd-94e3-4d4d-8556-bbe4df47f805 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:10.357244 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2904fd-94e3-4d4d-8556-bbe4df47f805 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:10.357244 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2904fd-94e3-4d4d-8556-bbe4df47f805 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:10.358655 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 510/1021] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:08:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:08:10.365533 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4dbe5f-adda-4bc4-bfc2-d7da7a12b1a2 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:10.366048 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4dbe5f-adda-4bc4-bfc2-d7da7a12b1a2 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:10.366123 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4dbe5f-adda-4bc4-bfc2-d7da7a12b1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:10.386086 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-4d4dbe5f-adda-4bc4-bfc2-d7da7a12b1a2 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:08:10.387581 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-4d4dbe5f-adda-4bc4-bfc2-d7da7a12b1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:08:10.435566 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:10.465475 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 512/1022] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:08:10 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:08:10.469899 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bcdd7-6303-4e2b-833c-b734a91ef4a4 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:10.470489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bcdd7-6303-4e2b-833c-b734a91ef4a4 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:10.470769 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bcdd7-6303-4e2b-833c-b734a91ef4a4 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:10.472204 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 511/1023] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:08:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:08:10.477170 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88159e53-dedd-4699-acfe-f62d80f7d7f7 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:10.477463 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88159e53-dedd-4699-acfe-f62d80f7d7f7 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:10.477743 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88159e53-dedd-4699-acfe-f62d80f7d7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:10.495968 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-88159e53-dedd-4699-acfe-f62d80f7d7f7 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:08:10.497156 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-88159e53-dedd-4699-acfe-f62d80f7d7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:08:10.574183 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 513/1024] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:08:10 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:08:10.742836 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195bcdd7-6303-4e2b-833c-b734a91ef4a4 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:10.837034 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88159e53-dedd-4699-acfe-f62d80f7d7f7 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:10.850521 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195bcdd7-6303-4e2b-833c-b734a91ef4a4 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:10.889128 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd4c47-1341-4e14-a5bc-2a4af5d002e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:10.889761 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd4c47-1341-4e14-a5bc-2a4af5d002e2 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:10.890039 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd4c47-1341-4e14-a5bc-2a4af5d002e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:10.890309 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd4c47-1341-4e14-a5bc-2a4af5d002e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:10.891725 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd4c47-1341-4e14-a5bc-2a4af5d002e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:10.893167 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fd4c47-1341-4e14-a5bc-2a4af5d002e2 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:10.894783 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 512/1025] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:08:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:10.900772 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd4c47-1341-4e14-a5bc-2a4af5d002e2 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:10.933322 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:10.946911 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88159e53-dedd-4699-acfe-f62d80f7d7f7 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:10.957808 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:10.985529 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ce1f4-a8e6-4e0a-a7d7-37c7d5cc8673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:10.986164 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ce1f4-a8e6-4e0a-a7d7-37c7d5cc8673 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:10.986474 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ce1f4-a8e6-4e0a-a7d7-37c7d5cc8673 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:10.986748 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ce1f4-a8e6-4e0a-a7d7-37c7d5cc8673 None admin] PATH_INFO: `/v3/services/image` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:10.987333 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42ce1f4-a8e6-4e0a-a7d7-37c7d5cc8673 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:10.988709 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42ce1f4-a8e6-4e0a-a7d7-37c7d5cc8673 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:10.997908 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-f42ce1f4-a8e6-4e0a-a7d7-37c7d5cc8673 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 21 12:08:10.997908 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:10.997908 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 12:08:10.997908 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 12:08:10.997908 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 12:08:10.997908 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 12:08:10.997908 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 12:08:10.997908 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:08:10.997908 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 21 12:08:10.997908 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:08:10.997908 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 12:08:10.997908 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:08:10.997908 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:10.997908 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:08:10.997908 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:08:10.997908 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:08:10.997908 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:08:11.000586 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:08:11.000586 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:08:11.000586 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:08:11.000586 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:08:11.000586 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:08:11.000586 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:08:11.000586 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 12:08:11.000586 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 12:08:11.000586 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 12:08:11.000586 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 12:08:11.000586 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:08:11.000586 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:08:11.000586 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:08:11.000586 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:08:11.000586 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:08:11.000586 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:08:11.002234 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:08:11.002234 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:08:11.002234 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:08:11.002234 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:08:11.002234 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:08:11.002234 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:08:11.002234 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:08:11.002234 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:08:11.002234 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:08:11.002234 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:08:11.002234 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 12:08:11.002234 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:08:11.002234 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 21 12:08:11.002234 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:08:11.002234 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 514/1026] 10.222.0.60 () {56 vars in 1105 bytes} [Wed Sep 21 12:08:10 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 12:08:11.005480 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ce1f4-a8e6-4e0a-a7d7-37c7d5cc8673 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:11.021642 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd4c47-1341-4e14-a5bc-2a4af5d002e2 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:11.064534 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee314a34-4dfa-4929-82f7-f060679b4c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:11.065306 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee314a34-4dfa-4929-82f7-f060679b4c3f None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:11.065595 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee314a34-4dfa-4929-82f7-f060679b4c3f None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:11.065870 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee314a34-4dfa-4929-82f7-f060679b4c3f None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:11.066574 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee314a34-4dfa-4929-82f7-f060679b4c3f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:11.068626 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee314a34-4dfa-4929-82f7-f060679b4c3f None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:11.102396 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 513/1027] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Sep 21 12:08:10 2022] POST /identity/v3/users => generated 285 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:08:11.136059 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ce1f4-a8e6-4e0a-a7d7-37c7d5cc8673 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:11.173190 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9061e2-0c57-4265-938a-bb7030399914 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:11.173478 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9061e2-0c57-4265-938a-bb7030399914 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:11.173755 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9061e2-0c57-4265-938a-bb7030399914 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:11.175542 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 514/1028] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:08:11.180965 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e21c6-9e45-4e85-9301-7b430261f71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:11.181541 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f3e5e-7ec2-4983-96c2-eb2d471ee246 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:11.181834 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f3e5e-7ec2-4983-96c2-eb2d471ee246 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:11.182219 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e21c6-9e45-4e85-9301-7b430261f71d None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:11.182332 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f3e5e-7ec2-4983-96c2-eb2d471ee246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:11.182460 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e21c6-9e45-4e85-9301-7b430261f71d None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:11.182680 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e21c6-9e45-4e85-9301-7b430261f71d None admin] PATH_INFO: `/v3/services` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:11.183410 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e21c6-9e45-4e85-9301-7b430261f71d None admin] RBAC: Adding query filter params (name=image) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:11.183719 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e21c6-9e45-4e85-9301-7b430261f71d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:11.185265 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e21c6-9e45-4e85-9301-7b430261f71d None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:11.192204 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 515/1029] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:08:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:11.198511 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e21c6-9e45-4e85-9301-7b430261f71d None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:11.204846 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-b63f3e5e-7ec2-4983-96c2-eb2d471ee246 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:08:11.206187 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b63f3e5e-7ec2-4983-96c2-eb2d471ee246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:08:11.238836 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:11.288412 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 515/1030] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:08:11 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 12:08:11.317045 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e21c6-9e45-4e85-9301-7b430261f71d None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:11.354167 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763954b5-7592-435d-b135-740b698babde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:11.354824 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763954b5-7592-435d-b135-740b698babde None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:11.355708 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763954b5-7592-435d-b135-740b698babde None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:11.355708 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763954b5-7592-435d-b135-740b698babde None admin] PATH_INFO: `/v3/services` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:11.355983 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763954b5-7592-435d-b135-740b698babde None admin] RBAC: Adding query filter params (type=image) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:11.356274 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763954b5-7592-435d-b135-740b698babde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:11.357630 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763954b5-7592-435d-b135-740b698babde None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:11.363432 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 516/1031] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:08:11 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:08:11.369454 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f3e5e-7ec2-4983-96c2-eb2d471ee246 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:11.389064 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:11.479177 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f3e5e-7ec2-4983-96c2-eb2d471ee246 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:11.513420 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f0af6-5084-44e7-954c-e24600b3705a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:11.514098 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f0af6-5084-44e7-954c-e24600b3705a None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:11.514322 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f0af6-5084-44e7-954c-e24600b3705a None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:11.514601 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f0af6-5084-44e7-954c-e24600b3705a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:11.515294 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2f0af6-5084-44e7-954c-e24600b3705a None admin] RBAC: Adding query filter params (interface=public, service_id=16482e0b852148799b33175eafd6c0f0, region_id=RegionOne) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:11.515599 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2f0af6-5084-44e7-954c-e24600b3705a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:11.516957 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2f0af6-5084-44e7-954c-e24600b3705a None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:11.523475 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 516/1032] 10.222.0.60 () {56 vars in 1251 bytes} [Wed Sep 21 12:08:11 2022] GET /identity/v3/endpoints?service_id=16482e0b852148799b33175eafd6c0f0&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:11.528888 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763954b5-7592-435d-b135-740b698babde None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:11.564316 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f0af6-5084-44e7-954c-e24600b3705a None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:11.639134 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:11.643093 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763954b5-7592-435d-b135-740b698babde None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:11.653675 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:11.676433 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f0af6-5084-44e7-954c-e24600b3705a None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:11.681090 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daddf74-2138-4208-a59e-09464ddedd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:11.681707 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daddf74-2138-4208-a59e-09464ddedd60 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:11.681982 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daddf74-2138-4208-a59e-09464ddedd60 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:11.682250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daddf74-2138-4208-a59e-09464ddedd60 None admin] PATH_INFO: `/v3/services` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:11.682877 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daddf74-2138-4208-a59e-09464ddedd60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:11.684231 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daddf74-2138-4208-a59e-09464ddedd60 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:11.691865 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 517/1033] 10.222.0.60 () {56 vars in 1087 bytes} [Wed Sep 21 12:08:11 2022] GET /identity/v3/services => generated 1957 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:08:11.714580 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee17a55-8ccf-4814-bbf3-1591b41add46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:11.715237 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee17a55-8ccf-4814-bbf3-1591b41add46 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:11.715519 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee17a55-8ccf-4814-bbf3-1591b41add46 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:11.715792 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee17a55-8ccf-4814-bbf3-1591b41add46 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:11.728243 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee17a55-8ccf-4814-bbf3-1591b41add46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:08:11.733722 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-eee17a55-8ccf-4814-bbf3-1591b41add46 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 12:08:11.733722 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:11.733722 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:08:11.733722 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:08:11.733722 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:08:11.733722 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:08:11.733722 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:08:11.733722 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:08:11.733722 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:08:11.733722 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:08:11.733722 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:08:11.733722 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:08:11.733722 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:08:11.733722 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:08:11.733722 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:08:11.733722 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:08:11.735042 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:08:11.735042 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:08:11.735042 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:08:11.735042 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:08:11.735042 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:08:11.735042 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:08:11.735042 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:08:11.735042 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:08:11.735042 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:08:11.735042 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:08:11.735042 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:08:11.735042 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:08:11.735042 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:08:11.735042 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:08:11.735042 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:08:11.735042 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:08:11.736291 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:08:11.736291 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:08:11.736291 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:08:11.736291 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:08:11.736291 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:08:11.736291 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:08:11.736291 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:08:11.736291 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:08:11.736291 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:08:11.736291 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:08:11.736291 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 12:08:11.736291 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:08:11.738865 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 517/1034] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Sep 21 12:08:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 12:08:11.740993 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daddf74-2138-4208-a59e-09464ddedd60 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:11.856509 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daddf74-2138-4208-a59e-09464ddedd60 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:11.897249 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ee8f0-989b-4317-a65d-9f96d47ab9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:11.897854 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ee8f0-989b-4317-a65d-9f96d47ab9db None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:11.898133 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ee8f0-989b-4317-a65d-9f96d47ab9db None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:11.898449 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ee8f0-989b-4317-a65d-9f96d47ab9db None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:11.899119 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ee8f0-989b-4317-a65d-9f96d47ab9db None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:11.899415 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ee8f0-989b-4317-a65d-9f96d47ab9db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:11.900772 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ee8f0-989b-4317-a65d-9f96d47ab9db None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:11.909777 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 518/1035] 10.222.0.60 () {56 vars in 1115 bytes} [Wed Sep 21 12:08:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:11.915725 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee17a55-8ccf-4814-bbf3-1591b41add46 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:12.018937 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee17a55-8ccf-4814-bbf3-1591b41add46 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:12.053474 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f466cf1-e146-4f4d-86e4-38f1645e1a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:12.054104 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f466cf1-e146-4f4d-86e4-38f1645e1a68 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:12.054403 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f466cf1-e146-4f4d-86e4-38f1645e1a68 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:12.054685 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f466cf1-e146-4f4d-86e4-38f1645e1a68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:12.063658 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:12.066766 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f466cf1-e146-4f4d-86e4-38f1645e1a68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:12.068878 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f466cf1-e146-4f4d-86e4-38f1645e1a68 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:12.084018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-1f466cf1-e146-4f4d-86e4-38f1645e1a68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:08:12.084018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:12.084018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:08:12.084018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:08:12.084018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:08:12.084018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:08:12.084018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:08:12.084018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:08:12.084018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:08:12.084018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:08:12.084018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:08:12.084018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:08:12.084018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:08:12.084018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:08:12.084018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:08:12.084018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:08:12.085026 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:08:12.085026 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:08:12.085026 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:08:12.085026 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:08:12.085026 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:08:12.085026 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:08:12.085026 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:08:12.085026 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:08:12.085026 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:08:12.085026 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:08:12.085026 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:08:12.085026 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:08:12.085026 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:08:12.085026 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:08:12.085026 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:08:12.085026 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:08:12.085026 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:08:12.086540 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:08:12.086540 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:08:12.086540 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:08:12.086540 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 518/1036] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:08:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:08:12.091176 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ee8f0-989b-4317-a65d-9f96d47ab9db None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:12.125539 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:12.204574 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ee8f0-989b-4317-a65d-9f96d47ab9db None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:12.245960 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f62c6-fd59-4fe8-9117-d68bca636b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:12.246594 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f62c6-fd59-4fe8-9117-d68bca636b0b None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:12.246873 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f62c6-fd59-4fe8-9117-d68bca636b0b None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:12.247144 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f62c6-fd59-4fe8-9117-d68bca636b0b None admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:12.247784 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f62c6-fd59-4fe8-9117-d68bca636b0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:12.248086 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f62c6-fd59-4fe8-9117-d68bca636b0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:12.249452 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f62c6-fd59-4fe8-9117-d68bca636b0b None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:12.266225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 519/1037] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:08:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:12.267722 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f466cf1-e146-4f4d-86e4-38f1645e1a68 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:12.370368 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f466cf1-e146-4f4d-86e4-38f1645e1a68 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:12.405518 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0592dfd6-79ae-483a-8e10-1f47cb529910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:12.406065 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592dfd6-79ae-483a-8e10-1f47cb529910 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:12.406347 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592dfd6-79ae-483a-8e10-1f47cb529910 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:12.406642 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592dfd6-79ae-483a-8e10-1f47cb529910 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:12.415878 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0592dfd6-79ae-483a-8e10-1f47cb529910 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:12.417276 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0592dfd6-79ae-483a-8e10-1f47cb529910 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:12.429697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-0592dfd6-79ae-483a-8e10-1f47cb529910 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 21 12:08:12.429697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:12.429697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:08:12.429697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:08:12.429697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:08:12.429697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:08:12.429697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:08:12.429697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:08:12.429697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:08:12.429697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:08:12.429697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:08:12.429697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:08:12.429697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 12:08:12.429697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 12:08:12.429697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 12:08:12.429697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 12:08:12.430946 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:08:12.430946 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:08:12.430946 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 12:08:12.430946 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:08:12.430946 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 12:08:12.430946 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:08:12.430946 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:08:12.430946 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:08:12.430946 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:08:12.430946 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:08:12.430946 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:08:12.430946 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:08:12.430946 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:08:12.430946 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:08:12.430946 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:08:12.430946 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:08:12.430946 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:08:12.430946 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:08:12.431896 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:08:12.431896 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:08:12.431896 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 12:08:12.431896 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 12:08:12.431896 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 12:08:12.431896 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 12:08:12.431896 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 12:08:12.431896 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 12:08:12.431896 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 21 12:08:12.431896 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:08:12.431896 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 519/1038] 10.222.0.60 () {56 vars in 1093 bytes} [Wed Sep 21 12:08:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 12:08:12.438653 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f62c6-fd59-4fe8-9117-d68bca636b0b None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:12.529649 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:12.548170 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f62c6-fd59-4fe8-9117-d68bca636b0b None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:12.588075 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744e690-861f-40a0-9512-f99643929e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:12.588684 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744e690-861f-40a0-9512-f99643929e4c None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:12.588960 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744e690-861f-40a0-9512-f99643929e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:12.589230 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744e690-861f-40a0-9512-f99643929e4c None admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:12.589943 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8744e690-861f-40a0-9512-f99643929e4c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:12.590242 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8744e690-861f-40a0-9512-f99643929e4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:12.591703 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8744e690-861f-40a0-9512-f99643929e4c None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:12.610057 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 520/1039] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Sep 21 12:08:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:12.615777 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0592dfd6-79ae-483a-8e10-1f47cb529910 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:12.673125 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:12.720681 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0592dfd6-79ae-483a-8e10-1f47cb529910 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:12.761158 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b61aa-b615-4c1d-8ea2-f1999204c6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:12.761746 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b61aa-b615-4c1d-8ea2-f1999204c6bb None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:12.762023 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b61aa-b615-4c1d-8ea2-f1999204c6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:12.762575 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b61aa-b615-4c1d-8ea2-f1999204c6bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:12.830475 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b61aa-b615-4c1d-8ea2-f1999204c6bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:12.831922 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b61aa-b615-4c1d-8ea2-f1999204c6bb None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:12.891866 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:12.943752 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 520/1040] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:08:12 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 12:08:12.949223 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744e690-861f-40a0-9512-f99643929e4c None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:13.057925 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744e690-861f-40a0-9512-f99643929e4c None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:13.095927 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a66cc-720c-4dff-b071-7ab8c881d339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:13.096553 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a66cc-720c-4dff-b071-7ab8c881d339 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:13.096831 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a66cc-720c-4dff-b071-7ab8c881d339 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:13.097102 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a66cc-720c-4dff-b071-7ab8c881d339 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:13.107723 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a66cc-720c-4dff-b071-7ab8c881d339 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:13.109148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a66cc-720c-4dff-b071-7ab8c881d339 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:13.111659 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:13.125743 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-621a66cc-720c-4dff-b071-7ab8c881d339 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:08:13.125743 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:13.125743 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:08:13.125743 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:08:13.125743 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:08:13.125743 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:08:13.125743 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:08:13.125743 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:08:13.125743 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:08:13.125743 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:08:13.125743 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:08:13.125743 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:08:13.125743 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:08:13.125743 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:08:13.125743 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:08:13.125743 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:08:13.126843 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:08:13.126843 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:08:13.126843 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:08:13.126843 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:08:13.126843 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:08:13.126843 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:08:13.126843 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:08:13.126843 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:08:13.126843 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:08:13.126843 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:08:13.126843 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:08:13.126843 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:08:13.126843 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:08:13.126843 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:08:13.126843 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:08:13.126843 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:08:13.126843 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:08:13.127818 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:08:13.127818 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:08:13.127818 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:08:13.127818 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 521/1041] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:08:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:08:13.134908 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b61aa-b615-4c1d-8ea2-f1999204c6bb None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:13.236835 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b61aa-b615-4c1d-8ea2-f1999204c6bb None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:13.271685 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89565a72-5818-4c1a-aeb5-75ad8ad4d23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:13.272292 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89565a72-5818-4c1a-aeb5-75ad8ad4d23b None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:13.272621 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89565a72-5818-4c1a-aeb5-75ad8ad4d23b None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:13.272905 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89565a72-5818-4c1a-aeb5-75ad8ad4d23b None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:13.273543 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89565a72-5818-4c1a-aeb5-75ad8ad4d23b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:13.273843 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89565a72-5818-4c1a-aeb5-75ad8ad4d23b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:13.275311 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89565a72-5818-4c1a-aeb5-75ad8ad4d23b None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:13.292356 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 521/1042] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:13.297151 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a66cc-720c-4dff-b071-7ab8c881d339 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:13.405741 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a66cc-720c-4dff-b071-7ab8c881d339 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:13.418702 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a15aa-3264-4f48-bcc7-52633708094e None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:13.419226 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a15aa-3264-4f48-bcc7-52633708094e None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:13.419226 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a15aa-3264-4f48-bcc7-52633708094e None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:13.420574 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 522/1043] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:08:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:08:13.425893 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689e2f4-10b3-47ca-916c-31a982a6f834 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:13.426179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689e2f4-10b3-47ca-916c-31a982a6f834 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:13.427189 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689e2f4-10b3-47ca-916c-31a982a6f834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:13.446911 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-2689e2f4-10b3-47ca-916c-31a982a6f834 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:08:13.447116 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41c54e-c6f3-4ae3-9cd2-760984c315d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:13.447581 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41c54e-c6f3-4ae3-9cd2-760984c315d6 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:13.447859 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41c54e-c6f3-4ae3-9cd2-760984c315d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:13.448120 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2689e2f4-10b3-47ca-916c-31a982a6f834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:08:13.448225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41c54e-c6f3-4ae3-9cd2-760984c315d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:13.455290 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41c54e-c6f3-4ae3-9cd2-760984c315d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:13.456741 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41c54e-c6f3-4ae3-9cd2-760984c315d6 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:13.456994 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:13.468171 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-5b41c54e-c6f3-4ae3-9cd2-760984c315d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:08:13.468171 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:13.468171 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:08:13.468171 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:08:13.468171 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:08:13.468171 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:08:13.468171 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:08:13.468171 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:08:13.468171 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:08:13.468171 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:08:13.468171 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:08:13.468171 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:08:13.468171 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 12:08:13.468171 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 12:08:13.468171 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 12:08:13.469155 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 12:08:13.469155 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:08:13.469155 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:08:13.469155 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:08:13.469155 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:08:13.469155 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:08:13.469155 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:08:13.469155 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:08:13.469155 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:08:13.469155 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:08:13.469155 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:08:13.469155 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:08:13.469155 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:08:13.469155 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:08:13.469155 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:08:13.469155 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:08:13.469155 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:08:13.475120 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 12:08:13.475120 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 12:08:13.475120 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 12:08:13.475120 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 12:08:13.475120 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 12:08:13.475120 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 12:08:13.475120 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:08:13.475120 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:08:13.475120 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 522/1044] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:08:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:08:13.475815 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41c54e-c6f3-4ae3-9cd2-760984c315d6 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:13.533496 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 523/1045] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:08:13 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 12:08:13.540776 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:13.595201 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41c54e-c6f3-4ae3-9cd2-760984c315d6 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:13.631003 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e046f-b8d1-447d-a2da-3011c9f883d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:13.631601 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e046f-b8d1-447d-a2da-3011c9f883d8 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:13.631886 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e046f-b8d1-447d-a2da-3011c9f883d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:13.632154 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e046f-b8d1-447d-a2da-3011c9f883d8 None admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:13.632830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602e046f-b8d1-447d-a2da-3011c9f883d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:13.633130 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602e046f-b8d1-447d-a2da-3011c9f883d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:13.634568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602e046f-b8d1-447d-a2da-3011c9f883d8 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:13.647506 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 523/1046] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Sep 21 12:08:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:13.653362 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689e2f4-10b3-47ca-916c-31a982a6f834 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:13.753637 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689e2f4-10b3-47ca-916c-31a982a6f834 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:13.788256 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6d3d5-c13f-4064-a14b-82b990781717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:13.788780 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6d3d5-c13f-4064-a14b-82b990781717 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:13.789059 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6d3d5-c13f-4064-a14b-82b990781717 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:13.789327 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6d3d5-c13f-4064-a14b-82b990781717 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:13.790041 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a6d3d5-c13f-4064-a14b-82b990781717 None admin] RBAC: Adding query filter params (role.id=a0f76a5a7b9c4af794c33ce6078ca7be, scope.project.id=b0abcc6f2ce14825bfc26e6210889c21, user.id=6cb4001f94b8439180ca2a93d3b279b1) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:13.790343 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a6d3d5-c13f-4064-a14b-82b990781717 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:13.791824 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a6d3d5-c13f-4064-a14b-82b990781717 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:13.797490 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 524/1047] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:08:13 2022] GET /identity/v3/role_assignments?user.id=6cb4001f94b8439180ca2a93d3b279b1&scope.project.id=b0abcc6f2ce14825bfc26e6210889c21&role.id=a0f76a5a7b9c4af794c33ce6078ca7be => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:13.803159 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e046f-b8d1-447d-a2da-3011c9f883d8 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:13.919219 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e046f-b8d1-447d-a2da-3011c9f883d8 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:13.938162 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e67771-11e4-405c-84ac-22a6f0640b10 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:13.938722 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e67771-11e4-405c-84ac-22a6f0640b10 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:13.938722 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e67771-11e4-405c-84ac-22a6f0640b10 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:13.940323 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 525/1048] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:08:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:08:13.940575 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:13.946694 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbe547-af85-45a9-bc3c-8eb3579d4548 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:13.947077 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbe547-af85-45a9-bc3c-8eb3579d4548 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:13.947283 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbe547-af85-45a9-bc3c-8eb3579d4548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:13.961302 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:13.962025 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed15ac-c44c-4257-96ed-2c8bb424701d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:13.963690 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed15ac-c44c-4257-96ed-2c8bb424701d None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:13.963690 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed15ac-c44c-4257-96ed-2c8bb424701d None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:13.965063 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed15ac-c44c-4257-96ed-2c8bb424701d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:13.967668 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-10dbe547-af85-45a9-bc3c-8eb3579d4548 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:08:13.971230 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-10dbe547-af85-45a9-bc3c-8eb3579d4548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:08:13.977565 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed15ac-c44c-4257-96ed-2c8bb424701d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:08:13.982404 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-53ed15ac-c44c-4257-96ed-2c8bb424701d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:08:13.982404 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:13.982404 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:08:13.982404 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:08:13.982404 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:08:13.982404 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:08:13.982404 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:08:13.982404 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:08:13.982404 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:08:13.982404 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:08:13.982404 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:08:13.982404 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:08:13.982404 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:08:13.982404 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:08:13.982404 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:08:13.982404 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:08:13.983383 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:08:13.983383 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:08:13.983383 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:08:13.983383 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:08:13.983383 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:08:13.983383 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:08:13.983383 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:08:13.983383 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:08:13.983383 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:08:13.983383 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:08:13.983383 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:08:13.983383 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:08:13.983383 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:08:13.983383 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:08:13.983383 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:08:13.983383 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:08:13.984240 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:08:13.984240 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:08:13.984240 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:08:13.984240 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:08:13.984240 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:08:13.984240 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:08:13.984240 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:08:13.984240 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:08:13.984240 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:08:13.984240 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:08:13.984240 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:08:13.984240 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:08:13.984240 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 524/1049] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Sep 21 12:08:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:08:13.990221 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed15ac-c44c-4257-96ed-2c8bb424701d None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:14.048362 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 526/1050] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:08:13 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 12:08:14.099550 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed15ac-c44c-4257-96ed-2c8bb424701d None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:14.133257 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef9be3-1459-48fb-8a20-eff127df8168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:14.133859 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef9be3-1459-48fb-8a20-eff127df8168 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:14.134134 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef9be3-1459-48fb-8a20-eff127df8168 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:14.134424 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef9be3-1459-48fb-8a20-eff127df8168 None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:14.135078 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef9be3-1459-48fb-8a20-eff127df8168 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:14.135373 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef9be3-1459-48fb-8a20-eff127df8168 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:14.136725 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef9be3-1459-48fb-8a20-eff127df8168 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:14.146171 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 525/1051] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:08:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:08:14.152018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbe547-af85-45a9-bc3c-8eb3579d4548 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:14.251770 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbe547-af85-45a9-bc3c-8eb3579d4548 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:14.285690 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9115c-2d82-4e1e-980c-0af8186336d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:14.287107 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9115c-2d82-4e1e-980c-0af8186336d2 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:14.287418 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9115c-2d82-4e1e-980c-0af8186336d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:14.287695 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9115c-2d82-4e1e-980c-0af8186336d2 None admin] PATH_INFO: `/v3/users/14ed3eae23104a36be0d0d5578359dd3` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:14.290567 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:14.302755 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9115c-2d82-4e1e-980c-0af8186336d2 None admin] RBAC: Authorizing `identity:get_user(user_id=14ed3eae23104a36be0d0d5578359dd3)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:14.304133 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9115c-2d82-4e1e-980c-0af8186336d2 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:14.310347 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 527/1052] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:08:14 2022] GET /identity/v3/users/14ed3eae23104a36be0d0d5578359dd3 => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:14.311823 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef9be3-1459-48fb-8a20-eff127df8168 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:14.319214 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9115c-2d82-4e1e-980c-0af8186336d2 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:14.360128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:14.426736 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef9be3-1459-48fb-8a20-eff127df8168 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:14.428950 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9115c-2d82-4e1e-980c-0af8186336d2 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:14.464350 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d5644-cc59-48dd-a9f8-82f2f814cd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:14.464964 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d5644-cc59-48dd-a9f8-82f2f814cd43 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:14.465251 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d5644-cc59-48dd-a9f8-82f2f814cd43 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:14.465530 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d5644-cc59-48dd-a9f8-82f2f814cd43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:14.467211 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5e872-5913-47cb-a617-f5cea9a5671d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:14.468203 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5e872-5913-47cb-a617-f5cea9a5671d None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:14.468634 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5e872-5913-47cb-a617-f5cea9a5671d None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:14.469870 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5e872-5913-47cb-a617-f5cea9a5671d None admin] PATH_INFO: `/v3/services/image` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:14.470687 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5e872-5913-47cb-a617-f5cea9a5671d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:14.472244 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5e872-5913-47cb-a617-f5cea9a5671d None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:14.485117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-85d5e872-5913-47cb-a617-f5cea9a5671d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 21 12:08:14.485117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:14.485117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 12:08:14.485117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 12:08:14.485117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 12:08:14.485117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 12:08:14.485117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 12:08:14.485117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:08:14.485117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 21 12:08:14.485117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:08:14.485117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 12:08:14.485117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:08:14.485117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:14.485117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:08:14.485117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:08:14.485117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:08:14.485117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:08:14.486430 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:08:14.486430 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:08:14.486430 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:08:14.486430 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:08:14.486430 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:08:14.486430 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:08:14.486430 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 12:08:14.486430 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 12:08:14.486430 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 12:08:14.486430 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 12:08:14.486430 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:08:14.486430 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:08:14.486430 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:08:14.486430 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:08:14.486430 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:08:14.486430 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:08:14.487518 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:08:14.487518 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:08:14.487518 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:08:14.487518 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:08:14.487518 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:08:14.487518 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:08:14.487518 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:08:14.487518 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:08:14.487518 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:08:14.487518 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:08:14.487518 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 12:08:14.487518 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:08:14.487518 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 21 12:08:14.487518 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:08:14.490939 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 528/1053] 10.222.0.60 () {56 vars in 1105 bytes} [Wed Sep 21 12:08:14 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 12:08:14.496926 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5e872-5913-47cb-a617-f5cea9a5671d None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:14.545208 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d5644-cc59-48dd-a9f8-82f2f814cd43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:14.546713 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d5644-cc59-48dd-a9f8-82f2f814cd43 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:14.579198 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:14.594333 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:14.637910 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5e872-5913-47cb-a617-f5cea9a5671d None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:14.664809 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 526/1054] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:08:14 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 12:08:14.671491 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d5644-cc59-48dd-a9f8-82f2f814cd43 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:14.677999 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425cea1a-2e23-4a88-b1a4-f36de1ba397d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:14.678663 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cea1a-2e23-4a88-b1a4-f36de1ba397d None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:14.678946 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cea1a-2e23-4a88-b1a4-f36de1ba397d None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:14.679222 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cea1a-2e23-4a88-b1a4-f36de1ba397d None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:14.679866 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425cea1a-2e23-4a88-b1a4-f36de1ba397d None admin] RBAC: Adding query filter params (name=image) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:14.680171 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425cea1a-2e23-4a88-b1a4-f36de1ba397d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:14.681652 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425cea1a-2e23-4a88-b1a4-f36de1ba397d None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:14.688607 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 529/1055] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:08:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:08:14.694434 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425cea1a-2e23-4a88-b1a4-f36de1ba397d None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:14.778567 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d5644-cc59-48dd-a9f8-82f2f814cd43 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:14.811662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425cea1a-2e23-4a88-b1a4-f36de1ba397d None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:14.812816 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291a6b0-d3a0-430e-8772-ef6dc586a496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:14.813441 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291a6b0-d3a0-430e-8772-ef6dc586a496 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:14.813720 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291a6b0-d3a0-430e-8772-ef6dc586a496 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:14.814002 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291a6b0-d3a0-430e-8772-ef6dc586a496 None admin] PATH_INFO: `/v3/projects/0451cc4397f44c08986d42fe017f8aa3` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:14.815139 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291a6b0-d3a0-430e-8772-ef6dc586a496 None admin] RBAC: Authorizing `identity:get_project(project_id=0451cc4397f44c08986d42fe017f8aa3)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:14.816869 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291a6b0-d3a0-430e-8772-ef6dc586a496 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:14.818583 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 527/1056] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:08:14 2022] GET /identity/v3/projects/0451cc4397f44c08986d42fe017f8aa3 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:08:14.825262 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291a6b0-d3a0-430e-8772-ef6dc586a496 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:14.834264 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:14.841333 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:14.856644 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56411d1-a5d5-4d67-bda2-c35ab29333a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:14.857245 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56411d1-a5d5-4d67-bda2-c35ab29333a7 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:14.857522 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56411d1-a5d5-4d67-bda2-c35ab29333a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:14.857790 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56411d1-a5d5-4d67-bda2-c35ab29333a7 None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:14.858450 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56411d1-a5d5-4d67-bda2-c35ab29333a7 None admin] RBAC: Adding query filter params (type=image) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:14.858986 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56411d1-a5d5-4d67-bda2-c35ab29333a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:14.860660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56411d1-a5d5-4d67-bda2-c35ab29333a7 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:14.865658 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 530/1057] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:08:14 2022] GET /identity/v3/services?type=image => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:08:14.871065 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56411d1-a5d5-4d67-bda2-c35ab29333a7 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:14.939995 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291a6b0-d3a0-430e-8772-ef6dc586a496 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:14.983798 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ec82d-6860-4abc-af4b-f9e86167ff02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:14.984405 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ec82d-6860-4abc-af4b-f9e86167ff02 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:14.984683 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ec82d-6860-4abc-af4b-f9e86167ff02 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:14.984955 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ec82d-6860-4abc-af4b-f9e86167ff02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:14.985682 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ec82d-6860-4abc-af4b-f9e86167ff02 None admin] RBAC: Adding query filter params (role.id=72c80b472acb462ebadd86463efe91f7, scope.project.id=0451cc4397f44c08986d42fe017f8aa3, user.id=14ed3eae23104a36be0d0d5578359dd3) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:14.985988 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ec82d-6860-4abc-af4b-f9e86167ff02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:14.987448 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ec82d-6860-4abc-af4b-f9e86167ff02 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:14.993182 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 528/1058] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:08:14 2022] GET /identity/v3/role_assignments?user.id=14ed3eae23104a36be0d0d5578359dd3&scope.project.id=0451cc4397f44c08986d42fe017f8aa3&role.id=72c80b472acb462ebadd86463efe91f7 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:08:14.999513 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56411d1-a5d5-4d67-bda2-c35ab29333a7 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:15.043078 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b9dc0-4860-4009-b699-b49823be50fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:15.043737 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b9dc0-4860-4009-b699-b49823be50fd None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:15.044068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b9dc0-4860-4009-b699-b49823be50fd None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:15.044347 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b9dc0-4860-4009-b699-b49823be50fd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:15.045028 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b9dc0-4860-4009-b699-b49823be50fd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:15.046442 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b9dc0-4860-4009-b699-b49823be50fd None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:15.071020 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 531/1059] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:08:14 2022] POST /identity/v3/endpoints => generated 327 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:08:15.999063 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df272f45-5e5a-4d35-b17f-835a2a39e837 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:15.999593 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df272f45-5e5a-4d35-b17f-835a2a39e837 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:15.999593 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df272f45-5e5a-4d35-b17f-835a2a39e837 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:16.002527 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 529/1060] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:08:16.007185 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fef95f-7f89-47ab-9c48-14d54351a647 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:16.007689 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fef95f-7f89-47ab-9c48-14d54351a647 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:16.007783 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fef95f-7f89-47ab-9c48-14d54351a647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:16.027458 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-16fef95f-7f89-47ab-9c48-14d54351a647 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:08:16.029239 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-16fef95f-7f89-47ab-9c48-14d54351a647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:08:16.072283 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:16.117716 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 532/1061] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:08:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:08:16.388078 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df272f45-5e5a-4d35-b17f-835a2a39e837 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:16.464079 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:16.497607 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df272f45-5e5a-4d35-b17f-835a2a39e837 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:16.531311 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564fe47-34ca-401c-8c6b-f67a09fe4fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:16.531940 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564fe47-34ca-401c-8c6b-f67a09fe4fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:16.532216 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564fe47-34ca-401c-8c6b-f67a09fe4fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:16.532484 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564fe47-34ca-401c-8c6b-f67a09fe4fe3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:16.543781 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3564fe47-34ca-401c-8c6b-f67a09fe4fe3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:08:16.548553 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-3564fe47-34ca-401c-8c6b-f67a09fe4fe3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 12:08:16.548553 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:16.548553 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:08:16.548553 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:08:16.548553 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:08:16.548553 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:08:16.548553 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:08:16.548553 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:08:16.548553 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:08:16.548553 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:08:16.548553 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:08:16.548553 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:08:16.548553 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:08:16.548553 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:08:16.548553 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:08:16.548553 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:08:16.549496 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:08:16.549496 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:08:16.549496 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:08:16.549496 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:08:16.549496 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:08:16.549496 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:08:16.549496 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:08:16.549496 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:08:16.549496 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:08:16.549496 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:08:16.549496 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:08:16.549496 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:08:16.549496 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:08:16.549496 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:08:16.549496 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:08:16.549496 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:08:16.551329 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:08:16.551329 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:08:16.551329 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:08:16.551329 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:08:16.551329 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:08:16.551329 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:08:16.551329 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:08:16.551329 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:08:16.551329 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:08:16.551329 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:08:16.551329 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 12:08:16.551329 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:08:16.551329 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 530/1062] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Sep 21 12:08:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:08:16.560573 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fef95f-7f89-47ab-9c48-14d54351a647 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:16.669991 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fef95f-7f89-47ab-9c48-14d54351a647 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:16.704723 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65372c-6258-4a89-951c-8978f9cffa68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:16.705334 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65372c-6258-4a89-951c-8978f9cffa68 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:16.705615 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65372c-6258-4a89-951c-8978f9cffa68 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:16.705886 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65372c-6258-4a89-951c-8978f9cffa68 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:16.706575 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e65372c-6258-4a89-951c-8978f9cffa68 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:16.706879 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e65372c-6258-4a89-951c-8978f9cffa68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:16.708822 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e65372c-6258-4a89-951c-8978f9cffa68 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:16.721759 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 533/1063] 10.222.0.60 () {56 vars in 1115 bytes} [Wed Sep 21 12:08:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:16.723418 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564fe47-34ca-401c-8c6b-f67a09fe4fe3 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:16.825693 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564fe47-34ca-401c-8c6b-f67a09fe4fe3 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:16.854911 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:16.862440 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83f82f-49b9-4f45-bdfe-628e919edbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:16.863095 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83f82f-49b9-4f45-bdfe-628e919edbb1 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:16.863374 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83f82f-49b9-4f45-bdfe-628e919edbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:16.863642 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83f82f-49b9-4f45-bdfe-628e919edbb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:16.881912 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83f82f-49b9-4f45-bdfe-628e919edbb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:16.883412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83f82f-49b9-4f45-bdfe-628e919edbb1 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:16.899776 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-1e83f82f-49b9-4f45-bdfe-628e919edbb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:08:16.899776 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:16.899776 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:08:16.899776 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:08:16.899776 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:08:16.899776 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:08:16.899776 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:08:16.899776 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:08:16.899776 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:08:16.899776 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:08:16.899776 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:08:16.899776 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:08:16.899776 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:08:16.899776 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:08:16.899776 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:08:16.899776 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:08:16.905526 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:08:16.905526 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:08:16.905526 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:08:16.905526 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:08:16.905526 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:08:16.905526 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:08:16.905526 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:08:16.905526 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:08:16.905526 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:08:16.905526 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:08:16.905526 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:08:16.905526 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:08:16.905526 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:08:16.905526 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:08:16.905526 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:08:16.905526 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:08:16.905526 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:08:16.906531 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:08:16.906531 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:08:16.906531 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:08:16.906531 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 531/1064] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:08:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 12:08:16.908316 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65372c-6258-4a89-951c-8978f9cffa68 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:16.944609 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:17.016170 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65372c-6258-4a89-951c-8978f9cffa68 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:17.054763 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41cc635-bd2b-49b0-83f1-93647427d8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:17.055617 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41cc635-bd2b-49b0-83f1-93647427d8fc None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:17.056027 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41cc635-bd2b-49b0-83f1-93647427d8fc None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:17.056469 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41cc635-bd2b-49b0-83f1-93647427d8fc None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:17.057349 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41cc635-bd2b-49b0-83f1-93647427d8fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:17.057789 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41cc635-bd2b-49b0-83f1-93647427d8fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:17.059422 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41cc635-bd2b-49b0-83f1-93647427d8fc None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:17.075148 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 534/1065] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:17.080705 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83f82f-49b9-4f45-bdfe-628e919edbb1 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:17.171904 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e92b72-24c1-4255-927c-1c40aad8202c None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:17.172269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e92b72-24c1-4255-927c-1c40aad8202c None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:17.172463 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e92b72-24c1-4255-927c-1c40aad8202c None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:17.174002 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 535/1066] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:08:17.180957 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e1b36-4711-49f2-bcd6-11e544481707 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:17.181381 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e1b36-4711-49f2-bcd6-11e544481707 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:17.181659 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e1b36-4711-49f2-bcd6-11e544481707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:17.189186 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83f82f-49b9-4f45-bdfe-628e919edbb1 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:17.206019 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-993e1b36-4711-49f2-bcd6-11e544481707 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:08:17.206776 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-993e1b36-4711-49f2-bcd6-11e544481707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:08:17.237424 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d5218-2b43-4376-aa88-759936a64299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:17.238050 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d5218-2b43-4376-aa88-759936a64299 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:17.238326 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d5218-2b43-4376-aa88-759936a64299 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:17.238620 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d5218-2b43-4376-aa88-759936a64299 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:17.247251 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d5218-2b43-4376-aa88-759936a64299 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:17.248618 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d5218-2b43-4376-aa88-759936a64299 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:17.260331 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-339d5218-2b43-4376-aa88-759936a64299 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 21 12:08:17.260331 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:17.260331 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:08:17.260331 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:08:17.260331 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:08:17.260331 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:08:17.260331 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:08:17.260331 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:08:17.260331 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:08:17.260331 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:08:17.260331 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:08:17.260331 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:08:17.260331 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 12:08:17.260331 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 12:08:17.260331 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 12:08:17.260331 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 12:08:17.261304 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:08:17.261304 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:08:17.261304 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 12:08:17.261304 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:08:17.261304 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 12:08:17.261304 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:08:17.261304 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:08:17.261304 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:08:17.261304 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:08:17.261304 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:08:17.261304 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:08:17.261304 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:08:17.261304 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:08:17.261304 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:08:17.261304 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:08:17.261304 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:08:17.261304 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:08:17.261304 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:08:17.262587 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:08:17.262587 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:08:17.262587 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 12:08:17.262587 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 12:08:17.262587 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 12:08:17.262587 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 12:08:17.262587 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 12:08:17.262587 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 12:08:17.262587 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 21 12:08:17.262587 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:08:17.262587 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 532/1067] 10.222.0.60 () {56 vars in 1093 bytes} [Wed Sep 21 12:08:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:08:17.267719 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d5218-2b43-4376-aa88-759936a64299 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:17.290515 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 536/1068] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:08:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:08:17.307732 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c45ac4-9364-4d0d-9190-c86a27a54801 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:17.308017 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c45ac4-9364-4d0d-9190-c86a27a54801 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:17.308292 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c45ac4-9364-4d0d-9190-c86a27a54801 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:17.309754 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 537/1069] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:08:17.314618 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564150c-b48c-479a-b37c-16a1bf412ed5 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:17.314901 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564150c-b48c-479a-b37c-16a1bf412ed5 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:17.315178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564150c-b48c-479a-b37c-16a1bf412ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:17.315393 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:17.334422 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-f564150c-b48c-479a-b37c-16a1bf412ed5 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:08:17.335618 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f564150c-b48c-479a-b37c-16a1bf412ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:08:17.351502 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:17.375251 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d5218-2b43-4376-aa88-759936a64299 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:17.407847 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 538/1070] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:08:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 12:08:17.413077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5f004-cea5-483f-80ce-0d26ef21c329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:17.413680 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5f004-cea5-483f-80ce-0d26ef21c329 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:17.413962 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5f004-cea5-483f-80ce-0d26ef21c329 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:17.414236 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5f004-cea5-483f-80ce-0d26ef21c329 None admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:17.415179 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad5f004-cea5-483f-80ce-0d26ef21c329 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:17.415491 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad5f004-cea5-483f-80ce-0d26ef21c329 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:17.416947 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad5f004-cea5-483f-80ce-0d26ef21c329 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:17.436603 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 533/1071] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Sep 21 12:08:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:08:17.442460 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564150c-b48c-479a-b37c-16a1bf412ed5 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:17.551178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564150c-b48c-479a-b37c-16a1bf412ed5 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:17.554783 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5f004-cea5-483f-80ce-0d26ef21c329 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:17.594967 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e58a1e-4305-4026-b10e-4cf60903836a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:17.595590 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e58a1e-4305-4026-b10e-4cf60903836a None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:17.595875 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e58a1e-4305-4026-b10e-4cf60903836a None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:17.596146 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e58a1e-4305-4026-b10e-4cf60903836a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:17.607074 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e58a1e-4305-4026-b10e-4cf60903836a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:17.608515 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e58a1e-4305-4026-b10e-4cf60903836a None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:17.624399 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-b0e58a1e-4305-4026-b10e-4cf60903836a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:08:17.624399 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:17.624399 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:08:17.624399 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:08:17.624399 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:08:17.624399 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:08:17.624399 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:08:17.624399 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:08:17.624399 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:08:17.624399 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:08:17.624399 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:08:17.624399 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:08:17.624399 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:08:17.624399 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:08:17.624399 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:08:17.624399 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:08:17.625353 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:08:17.625353 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:08:17.625353 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:08:17.625353 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:08:17.625353 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:08:17.625353 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:08:17.625353 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:08:17.625353 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:08:17.625353 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:08:17.625353 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:08:17.625353 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:08:17.625353 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:08:17.625353 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:08:17.625353 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:08:17.625353 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:08:17.625353 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:08:17.625353 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:08:17.626397 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:08:17.626397 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:08:17.626397 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:08:17.626397 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 539/1072] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:08:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:08:17.631117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e58a1e-4305-4026-b10e-4cf60903836a None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:17.633966 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:17.666839 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:17.671374 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5f004-cea5-483f-80ce-0d26ef21c329 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:17.710737 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682ec54-19f2-48db-94a3-1c06c59a6dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:17.711380 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682ec54-19f2-48db-94a3-1c06c59a6dc0 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:17.711742 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682ec54-19f2-48db-94a3-1c06c59a6dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:17.711936 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682ec54-19f2-48db-94a3-1c06c59a6dc0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:17.722142 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9682ec54-19f2-48db-94a3-1c06c59a6dc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:08:17.727017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-9682ec54-19f2-48db-94a3-1c06c59a6dc0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:08:17.727017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:17.727017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:08:17.727017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:08:17.727017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:08:17.727017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:08:17.727017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:08:17.727017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:08:17.727017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:08:17.727017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:08:17.727017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:08:17.727017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:08:17.727017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:08:17.727017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:08:17.727017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:08:17.727017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:08:17.728118 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:08:17.728118 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:08:17.728118 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:08:17.728118 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:08:17.728118 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:08:17.728118 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:08:17.728118 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:08:17.728118 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:08:17.728118 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:08:17.728118 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:08:17.728118 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:08:17.728118 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:08:17.728118 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:08:17.728118 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:08:17.728118 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:08:17.728118 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:08:17.729111 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:08:17.729111 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:08:17.729111 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:08:17.729111 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:08:17.729111 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:08:17.729111 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:08:17.729111 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:08:17.729111 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:08:17.729111 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:08:17.729111 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:08:17.729111 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:08:17.729111 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:08:17.729111 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 534/1073] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Sep 21 12:08:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 12:08:17.729111 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682ec54-19f2-48db-94a3-1c06c59a6dc0 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:17.739691 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e58a1e-4305-4026-b10e-4cf60903836a None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:17.774514 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf4468-9506-45d2-966e-56e237915684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:17.775106 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf4468-9506-45d2-966e-56e237915684 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:17.775379 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf4468-9506-45d2-966e-56e237915684 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:17.775646 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf4468-9506-45d2-966e-56e237915684 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:17.776308 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf4468-9506-45d2-966e-56e237915684 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:17.776598 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf4468-9506-45d2-966e-56e237915684 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:17.777949 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf4468-9506-45d2-966e-56e237915684 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:17.789626 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 540/1074] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:08:17.790387 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf4468-9506-45d2-966e-56e237915684 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:17.834318 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682ec54-19f2-48db-94a3-1c06c59a6dc0 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:17.850175 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:17.868124 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7ddae-59cc-45fb-a075-645fc9617a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:17.868727 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7ddae-59cc-45fb-a075-645fc9617a7e None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:17.869008 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7ddae-59cc-45fb-a075-645fc9617a7e None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:17.869277 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7ddae-59cc-45fb-a075-645fc9617a7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:17.889892 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf4468-9506-45d2-966e-56e237915684 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:17.897960 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:17.924332 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e201a4-1268-4401-98b3-3d625a170d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:17.924941 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e201a4-1268-4401-98b3-3d625a170d6a None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:17.925214 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e201a4-1268-4401-98b3-3d625a170d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:17.925481 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e201a4-1268-4401-98b3-3d625a170d6a None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:17.926142 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e201a4-1268-4401-98b3-3d625a170d6a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:17.926992 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e201a4-1268-4401-98b3-3d625a170d6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:17.928367 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e201a4-1268-4401-98b3-3d625a170d6a None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:17.936918 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 541/1075] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:08:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:17.937699 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e201a4-1268-4401-98b3-3d625a170d6a None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:17.940544 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7ddae-59cc-45fb-a075-645fc9617a7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:17.941983 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7ddae-59cc-45fb-a075-645fc9617a7e None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:18.042386 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e201a4-1268-4401-98b3-3d625a170d6a None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:18.049264 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 535/1076] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:08:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 12:08:18.050234 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7ddae-59cc-45fb-a075-645fc9617a7e None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:18.066664 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:18.077767 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac3831-78c9-4189-af50-3f21fe1963b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:18.078403 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac3831-78c9-4189-af50-3f21fe1963b1 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:18.078689 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac3831-78c9-4189-af50-3f21fe1963b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:18.078963 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac3831-78c9-4189-af50-3f21fe1963b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:18.085748 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac3831-78c9-4189-af50-3f21fe1963b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:18.087161 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac3831-78c9-4189-af50-3f21fe1963b1 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:18.098138 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-81ac3831-78c9-4189-af50-3f21fe1963b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:08:18.098138 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:18.098138 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:08:18.098138 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:08:18.098138 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:08:18.098138 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:08:18.098138 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:08:18.098138 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:08:18.098138 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:08:18.098138 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:08:18.098138 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:08:18.098138 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:08:18.098138 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 12:08:18.098138 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 12:08:18.098138 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 12:08:18.104598 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 12:08:18.104598 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:08:18.104598 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:08:18.104598 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:08:18.104598 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:08:18.104598 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:08:18.104598 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:08:18.104598 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:08:18.104598 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:08:18.104598 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:08:18.104598 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:08:18.104598 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:08:18.104598 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:08:18.104598 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:08:18.104598 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:08:18.104598 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:08:18.104598 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:08:18.105682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 12:08:18.105682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 12:08:18.105682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 12:08:18.105682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 12:08:18.105682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 12:08:18.105682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 12:08:18.105682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:08:18.105682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:08:18.105682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 542/1077] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:08:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:08:18.105682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac3831-78c9-4189-af50-3f21fe1963b1 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:18.108913 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:18.151154 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7ddae-59cc-45fb-a075-645fc9617a7e None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:18.185639 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff33cd-a414-47f4-bac8-32ff1c40dd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:18.186261 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff33cd-a414-47f4-bac8-32ff1c40dd1c None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:18.186568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff33cd-a414-47f4-bac8-32ff1c40dd1c None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:18.186841 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff33cd-a414-47f4-bac8-32ff1c40dd1c None admin] PATH_INFO: `/v3/users/14ed3eae23104a36be0d0d5578359dd3` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:18.188063 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff33cd-a414-47f4-bac8-32ff1c40dd1c None admin] RBAC: Authorizing `identity:get_user(user_id=14ed3eae23104a36be0d0d5578359dd3)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:18.189639 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff33cd-a414-47f4-bac8-32ff1c40dd1c None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:18.191246 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 536/1078] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:08:18 2022] GET /identity/v3/users/14ed3eae23104a36be0d0d5578359dd3 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:18.191997 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff33cd-a414-47f4-bac8-32ff1c40dd1c None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:18.208495 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac3831-78c9-4189-af50-3f21fe1963b1 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:18.242375 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b47f2-121e-4844-8c7d-abcce4935768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:18.243009 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b47f2-121e-4844-8c7d-abcce4935768 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:18.243289 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b47f2-121e-4844-8c7d-abcce4935768 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:18.243562 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b47f2-121e-4844-8c7d-abcce4935768 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:18.254505 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b47f2-121e-4844-8c7d-abcce4935768 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:18.255962 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b47f2-121e-4844-8c7d-abcce4935768 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:18.270100 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-1e2b47f2-121e-4844-8c7d-abcce4935768 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:08:18.270100 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:18.270100 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:08:18.270100 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:08:18.270100 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:08:18.270100 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:08:18.270100 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:08:18.270100 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:08:18.270100 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:08:18.270100 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:08:18.270100 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:08:18.270100 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:08:18.270100 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:08:18.270100 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:08:18.270100 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:08:18.270100 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:08:18.271238 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:08:18.271238 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:08:18.271238 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:08:18.271238 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:08:18.271238 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:08:18.271238 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:08:18.271238 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:08:18.271238 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:08:18.271238 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:08:18.271238 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:08:18.271238 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:08:18.271238 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:08:18.271238 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:08:18.271238 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:08:18.271238 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:08:18.271238 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:08:18.271238 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:08:18.272147 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:08:18.272147 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:08:18.272147 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:08:18.272147 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 543/1079] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:08:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:08:18.272378 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b47f2-121e-4844-8c7d-abcce4935768 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:18.291222 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff33cd-a414-47f4-bac8-32ff1c40dd1c None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:18.310047 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:18.319126 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:18.327430 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef50ef-54bd-4bc7-be7d-5bdf0b4f4b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:18.328034 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef50ef-54bd-4bc7-be7d-5bdf0b4f4b76 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:18.328311 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef50ef-54bd-4bc7-be7d-5bdf0b4f4b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:18.328580 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef50ef-54bd-4bc7-be7d-5bdf0b4f4b76 None admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:18.329263 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ef50ef-54bd-4bc7-be7d-5bdf0b4f4b76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:18.329563 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ef50ef-54bd-4bc7-be7d-5bdf0b4f4b76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:18.331016 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ef50ef-54bd-4bc7-be7d-5bdf0b4f4b76 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:18.342436 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 537/1080] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Sep 21 12:08:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:18.343161 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef50ef-54bd-4bc7-be7d-5bdf0b4f4b76 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:18.391654 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b47f2-121e-4844-8c7d-abcce4935768 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:18.428981 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44628d38-8cce-48be-9481-1a9f103e6f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:18.429608 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44628d38-8cce-48be-9481-1a9f103e6f84 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:18.429888 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44628d38-8cce-48be-9481-1a9f103e6f84 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:18.430217 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44628d38-8cce-48be-9481-1a9f103e6f84 None admin] PATH_INFO: `/v3/projects/0451cc4397f44c08986d42fe017f8aa3` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:18.431314 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44628d38-8cce-48be-9481-1a9f103e6f84 None admin] RBAC: Authorizing `identity:get_project(project_id=0451cc4397f44c08986d42fe017f8aa3)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:18.432749 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44628d38-8cce-48be-9481-1a9f103e6f84 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:18.434440 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 544/1081] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:08:18 2022] GET /identity/v3/projects/0451cc4397f44c08986d42fe017f8aa3 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:18.435351 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44628d38-8cce-48be-9481-1a9f103e6f84 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:18.444940 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef50ef-54bd-4bc7-be7d-5bdf0b4f4b76 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:18.479106 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a3f78d-a742-42d6-8bc0-bfad54fc29e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:18.479713 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3f78d-a742-42d6-8bc0-bfad54fc29e6 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:18.479995 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3f78d-a742-42d6-8bc0-bfad54fc29e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:18.480270 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a3f78d-a742-42d6-8bc0-bfad54fc29e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:18.480902 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a3f78d-a742-42d6-8bc0-bfad54fc29e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:18.481212 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a3f78d-a742-42d6-8bc0-bfad54fc29e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:18.482587 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a3f78d-a742-42d6-8bc0-bfad54fc29e6 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:18.494856 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 538/1082] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:08:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:18.495624 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a3f78d-a742-42d6-8bc0-bfad54fc29e6 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:18.548669 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44628d38-8cce-48be-9481-1a9f103e6f84 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:18.552610 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:18.569872 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:18.592242 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05257c9-038e-4b2e-877a-0eb5847d8c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:18.593006 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05257c9-038e-4b2e-877a-0eb5847d8c01 None admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:18.593217 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05257c9-038e-4b2e-877a-0eb5847d8c01 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:18.593493 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05257c9-038e-4b2e-877a-0eb5847d8c01 None admin] PATH_INFO: `/v3/projects/b0abcc6f2ce14825bfc26e6210889c21/users/6cb4001f94b8439180ca2a93d3b279b1/roles/a0f76a5a7b9c4af794c33ce6078ca7be` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:18.596126 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05257c9-038e-4b2e-877a-0eb5847d8c01 None admin] RBAC: Authorizing `identity:create_grant(project_id=b0abcc6f2ce14825bfc26e6210889c21, user_id=6cb4001f94b8439180ca2a93d3b279b1, role_id=a0f76a5a7b9c4af794c33ce6078ca7be)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:18.598131 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05257c9-038e-4b2e-877a-0eb5847d8c01 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:18.615161 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 545/1083] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Sep 21 12:08:18 2022] PUT /identity/v3/projects/b0abcc6f2ce14825bfc26e6210889c21/users/6cb4001f94b8439180ca2a93d3b279b1/roles/a0f76a5a7b9c4af794c33ce6078ca7be => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:08:18.640508 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a3f78d-a742-42d6-8bc0-bfad54fc29e6 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:18.682776 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94794cbf-b80d-416b-ad49-7b0079bde779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:18.683465 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94794cbf-b80d-416b-ad49-7b0079bde779 None admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:18.683746 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94794cbf-b80d-416b-ad49-7b0079bde779 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:18.684020 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94794cbf-b80d-416b-ad49-7b0079bde779 None admin] PATH_INFO: `/v3/projects/0451cc4397f44c08986d42fe017f8aa3/users/14ed3eae23104a36be0d0d5578359dd3/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:18.686008 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94794cbf-b80d-416b-ad49-7b0079bde779 None admin] RBAC: Authorizing `identity:create_grant(project_id=0451cc4397f44c08986d42fe017f8aa3, user_id=14ed3eae23104a36be0d0d5578359dd3, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:18.687570 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94794cbf-b80d-416b-ad49-7b0079bde779 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:18.704379 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 539/1084] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Sep 21 12:08:18 2022] PUT /identity/v3/projects/0451cc4397f44c08986d42fe017f8aa3/users/14ed3eae23104a36be0d0d5578359dd3/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:08:20.819659 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec14ac-1d7d-40d8-bcee-033b118c1047 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:20.820266 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec14ac-1d7d-40d8-bcee-033b118c1047 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:20.820266 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec14ac-1d7d-40d8-bcee-033b118c1047 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:20.821551 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 546/1085] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:08:20.827073 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021abdab-8826-4bb8-a6c5-86f322646895 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:20.827546 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021abdab-8826-4bb8-a6c5-86f322646895 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:20.827546 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021abdab-8826-4bb8-a6c5-86f322646895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:20.846282 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-021abdab-8826-4bb8-a6c5-86f322646895 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:08:20.847499 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-021abdab-8826-4bb8-a6c5-86f322646895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:08:20.903088 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb8650-ebb9-46b3-be36-20dc5b5e683b None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:20.903409 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb8650-ebb9-46b3-be36-20dc5b5e683b None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:20.903683 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb8650-ebb9-46b3-be36-20dc5b5e683b None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:20.905027 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 547/1086] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:08:20.910295 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77efd315-f0fc-4705-b194-969a079351fc None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:20.910713 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77efd315-f0fc-4705-b194-969a079351fc None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:20.910943 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77efd315-f0fc-4705-b194-969a079351fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:20.919904 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 540/1087] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:08:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:08:20.929829 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-77efd315-f0fc-4705-b194-969a079351fc None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:08:20.931058 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-77efd315-f0fc-4705-b194-969a079351fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:08:21.007653 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 548/1088] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:08:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 12:08:21.205172 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021abdab-8826-4bb8-a6c5-86f322646895 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:21.245512 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:21.284309 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77efd315-f0fc-4705-b194-969a079351fc None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:21.307031 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021abdab-8826-4bb8-a6c5-86f322646895 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:21.347305 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a859b-2212-481e-8c60-ab38185164f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:21.348057 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a859b-2212-481e-8c60-ab38185164f5 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:21.348432 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a859b-2212-481e-8c60-ab38185164f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:21.348711 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a859b-2212-481e-8c60-ab38185164f5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:21.359533 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a859b-2212-481e-8c60-ab38185164f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:08:21.364378 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-419a859b-2212-481e-8c60-ab38185164f5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 12:08:21.364378 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:21.364378 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:08:21.364378 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:08:21.364378 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:08:21.364378 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:08:21.364378 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:08:21.364378 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:08:21.364378 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:08:21.364378 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:08:21.364378 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:08:21.364378 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:08:21.364378 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:08:21.364378 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:08:21.364378 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:08:21.364378 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:08:21.365466 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:08:21.365466 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:08:21.365466 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:08:21.365466 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:08:21.365466 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:08:21.365466 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:08:21.365466 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:08:21.365466 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:08:21.365466 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:08:21.365466 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:08:21.365466 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:08:21.365466 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:08:21.365466 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:08:21.365466 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:08:21.365466 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:08:21.365466 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:08:21.366396 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:08:21.366396 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:08:21.366396 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:08:21.366396 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:08:21.366396 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:08:21.366396 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:08:21.366396 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:08:21.366396 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:08:21.366396 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:08:21.366396 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:08:21.366396 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 21 12:08:21.366396 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:08:21.366396 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 541/1089] 10.222.0.60 () {56 vars in 1120 bytes} [Wed Sep 21 12:08:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:08:21.371529 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a859b-2212-481e-8c60-ab38185164f5 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:21.384980 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:21.393562 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77efd315-f0fc-4705-b194-969a079351fc None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:21.431699 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a62c0b-f401-47d6-82ac-ce27d025c552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:21.432249 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a62c0b-f401-47d6-82ac-ce27d025c552 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:21.432521 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a62c0b-f401-47d6-82ac-ce27d025c552 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:21.432799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a62c0b-f401-47d6-82ac-ce27d025c552 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:21.443610 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a62c0b-f401-47d6-82ac-ce27d025c552 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:08:21.448375 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-f2a62c0b-f401-47d6-82ac-ce27d025c552 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:08:21.448375 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:21.448375 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:08:21.448375 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:08:21.448375 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:08:21.448375 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:08:21.448375 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:08:21.448375 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:08:21.448375 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:08:21.448375 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:08:21.448375 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:08:21.448375 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:08:21.448375 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:08:21.448375 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:08:21.448375 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:08:21.448375 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:08:21.449406 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:08:21.449406 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:08:21.449406 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:08:21.449406 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:08:21.449406 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:08:21.449406 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:08:21.449406 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:08:21.449406 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:08:21.449406 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:08:21.449406 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:08:21.449406 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:08:21.449406 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:08:21.449406 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:08:21.449406 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:08:21.449406 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:08:21.449406 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:08:21.450261 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:08:21.450261 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:08:21.450261 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:08:21.450261 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:08:21.450261 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:08:21.450261 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:08:21.450261 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:08:21.450261 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:08:21.450261 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:08:21.450261 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:08:21.450261 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:08:21.450261 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:08:21.450261 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 549/1090] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Sep 21 12:08:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 12:08:21.455458 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a62c0b-f401-47d6-82ac-ce27d025c552 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:21.484349 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:21.488229 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a859b-2212-481e-8c60-ab38185164f5 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:21.524980 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1a9ca-bc87-466f-85b3-956bdc982670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:21.525587 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1a9ca-bc87-466f-85b3-956bdc982670 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:21.525867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1a9ca-bc87-466f-85b3-956bdc982670 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:21.526134 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1a9ca-bc87-466f-85b3-956bdc982670 None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:21.526814 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1a9ca-bc87-466f-85b3-956bdc982670 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:21.527114 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1a9ca-bc87-466f-85b3-956bdc982670 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:21.528477 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1a9ca-bc87-466f-85b3-956bdc982670 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:21.536591 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 542/1091] 10.222.0.60 () {56 vars in 1115 bytes} [Wed Sep 21 12:08:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:08:21.543841 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1a9ca-bc87-466f-85b3-956bdc982670 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:21.559805 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a62c0b-f401-47d6-82ac-ce27d025c552 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:21.595151 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3b6fd-4507-471e-8aec-fb92aa5c8ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:21.595747 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3b6fd-4507-471e-8aec-fb92aa5c8ea8 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:21.596023 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3b6fd-4507-471e-8aec-fb92aa5c8ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:21.596288 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3b6fd-4507-471e-8aec-fb92aa5c8ea8 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:21.596938 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c3b6fd-4507-471e-8aec-fb92aa5c8ea8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:21.597238 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c3b6fd-4507-471e-8aec-fb92aa5c8ea8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:21.599181 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c3b6fd-4507-471e-8aec-fb92aa5c8ea8 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:21.608224 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 550/1092] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:08:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:08:21.614154 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3b6fd-4507-471e-8aec-fb92aa5c8ea8 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:21.631927 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:21.645735 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1a9ca-bc87-466f-85b3-956bdc982670 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:21.680013 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658223cf-e427-4b6e-8645-22ca80c440ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:21.680634 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658223cf-e427-4b6e-8645-22ca80c440ef None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:21.680910 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658223cf-e427-4b6e-8645-22ca80c440ef None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:21.681179 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658223cf-e427-4b6e-8645-22ca80c440ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:21.691470 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658223cf-e427-4b6e-8645-22ca80c440ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:21.693298 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658223cf-e427-4b6e-8645-22ca80c440ef None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:21.708128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-658223cf-e427-4b6e-8645-22ca80c440ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:08:21.708128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:21.708128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:08:21.708128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:08:21.708128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:08:21.708128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:08:21.708128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:08:21.708128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:08:21.708128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:08:21.708128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:08:21.708128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:08:21.708128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:08:21.708128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:08:21.708128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:08:21.708128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:08:21.708128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:08:21.709263 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:08:21.709263 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:08:21.709263 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:08:21.709263 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:08:21.709263 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:08:21.709263 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:08:21.709263 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:08:21.709263 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:08:21.709263 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:08:21.709263 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:08:21.709263 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:08:21.709263 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:08:21.709263 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:08:21.709263 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:08:21.709263 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:08:21.709263 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:08:21.709263 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:08:21.710354 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:08:21.710354 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:08:21.710354 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:08:21.710354 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 543/1093] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:08:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:08:21.714826 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658223cf-e427-4b6e-8645-22ca80c440ef None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:21.717674 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3b6fd-4507-471e-8aec-fb92aa5c8ea8 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:21.730225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:21.751332 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d21e7-9774-4cb0-96ac-50be70dce0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:21.751954 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d21e7-9774-4cb0-96ac-50be70dce0b5 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:21.752229 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d21e7-9774-4cb0-96ac-50be70dce0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:21.752497 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d21e7-9774-4cb0-96ac-50be70dce0b5 None admin] PATH_INFO: `/v3/users/14ed3eae23104a36be0d0d5578359dd3` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:21.753614 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d21e7-9774-4cb0-96ac-50be70dce0b5 None admin] RBAC: Authorizing `identity:get_user(user_id=14ed3eae23104a36be0d0d5578359dd3)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:21.755093 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d21e7-9774-4cb0-96ac-50be70dce0b5 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:21.756641 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 551/1094] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:08:21 2022] GET /identity/v3/users/14ed3eae23104a36be0d0d5578359dd3 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:08:21.762573 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d21e7-9774-4cb0-96ac-50be70dce0b5 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:21.819379 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658223cf-e427-4b6e-8645-22ca80c440ef None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:21.844852 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:21.852743 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239eb580-7267-4a96-b7a6-e556b524b936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:21.853347 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239eb580-7267-4a96-b7a6-e556b524b936 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:21.853624 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239eb580-7267-4a96-b7a6-e556b524b936 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:21.853892 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239eb580-7267-4a96-b7a6-e556b524b936 None admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:21.854553 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239eb580-7267-4a96-b7a6-e556b524b936 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:21.854854 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239eb580-7267-4a96-b7a6-e556b524b936 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:21.856281 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239eb580-7267-4a96-b7a6-e556b524b936 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:21.862093 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d21e7-9774-4cb0-96ac-50be70dce0b5 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:21.867790 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 544/1095] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:08:21.873423 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239eb580-7267-4a96-b7a6-e556b524b936 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:21.897863 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae00b2-b679-4a0b-b57f-92e4aceaa3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:21.898513 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae00b2-b679-4a0b-b57f-92e4aceaa3d5 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:21.898795 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae00b2-b679-4a0b-b57f-92e4aceaa3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:21.899066 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae00b2-b679-4a0b-b57f-92e4aceaa3d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:21.944731 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:21.967954 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae00b2-b679-4a0b-b57f-92e4aceaa3d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:21.969325 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae00b2-b679-4a0b-b57f-92e4aceaa3d5 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:21.974578 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239eb580-7267-4a96-b7a6-e556b524b936 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:22.009055 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d02fc-545d-4888-ab32-142b503fd219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:22.009676 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d02fc-545d-4888-ab32-142b503fd219 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:22.009958 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d02fc-545d-4888-ab32-142b503fd219 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:22.010227 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d02fc-545d-4888-ab32-142b503fd219 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:22.017583 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d02fc-545d-4888-ab32-142b503fd219 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:22.019048 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d02fc-545d-4888-ab32-142b503fd219 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:22.031641 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-2c9d02fc-545d-4888-ab32-142b503fd219 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 21 12:08:22.031641 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:22.031641 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:08:22.031641 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:08:22.031641 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:08:22.031641 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:08:22.031641 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:08:22.031641 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:08:22.031641 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:08:22.031641 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:08:22.031641 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:08:22.031641 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:08:22.031641 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 12:08:22.031641 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 12:08:22.031641 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 12:08:22.031641 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 12:08:22.032707 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:08:22.032707 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:08:22.032707 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 12:08:22.032707 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:08:22.032707 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 12:08:22.032707 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:08:22.032707 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:08:22.032707 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:08:22.032707 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:08:22.032707 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:08:22.032707 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:08:22.032707 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:08:22.032707 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:08:22.032707 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:08:22.032707 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:08:22.032707 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:08:22.032707 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:08:22.032707 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:08:22.034111 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:08:22.034111 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:08:22.034111 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 12:08:22.034111 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 12:08:22.034111 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 12:08:22.034111 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 12:08:22.034111 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 12:08:22.034111 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 12:08:22.034111 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 21 12:08:22.034111 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:08:22.034111 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 545/1096] 10.222.0.60 () {56 vars in 1093 bytes} [Wed Sep 21 12:08:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 12:08:22.039867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d02fc-545d-4888-ab32-142b503fd219 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:22.054102 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:22.070978 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 552/1097] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:08:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 21 12:08:22.076822 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae00b2-b679-4a0b-b57f-92e4aceaa3d5 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:22.142102 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d02fc-545d-4888-ab32-142b503fd219 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:22.172258 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:22.177948 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc952231-9cbc-4d37-a936-6f59c74e44b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:22.178590 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc952231-9cbc-4d37-a936-6f59c74e44b6 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:22.178862 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc952231-9cbc-4d37-a936-6f59c74e44b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:22.179127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc952231-9cbc-4d37-a936-6f59c74e44b6 None admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:22.179921 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc952231-9cbc-4d37-a936-6f59c74e44b6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:22.180226 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc952231-9cbc-4d37-a936-6f59c74e44b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:22.181639 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc952231-9cbc-4d37-a936-6f59c74e44b6 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:22.184308 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae00b2-b679-4a0b-b57f-92e4aceaa3d5 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:22.200373 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 546/1098] 10.222.0.60 () {56 vars in 1133 bytes} [Wed Sep 21 12:08:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:08:22.206308 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc952231-9cbc-4d37-a936-6f59c74e44b6 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:22.219351 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec57a7-4acd-45ca-ba30-f2b0b7106aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:22.219919 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec57a7-4acd-45ca-ba30-f2b0b7106aa9 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:22.220204 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec57a7-4acd-45ca-ba30-f2b0b7106aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:22.220478 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec57a7-4acd-45ca-ba30-f2b0b7106aa9 None admin] PATH_INFO: `/v3/projects/0451cc4397f44c08986d42fe017f8aa3` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:22.221596 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec57a7-4acd-45ca-ba30-f2b0b7106aa9 None admin] RBAC: Authorizing `identity:get_project(project_id=0451cc4397f44c08986d42fe017f8aa3)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:22.223057 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec57a7-4acd-45ca-ba30-f2b0b7106aa9 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:22.224735 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 553/1099] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:08:22 2022] GET /identity/v3/projects/0451cc4397f44c08986d42fe017f8aa3 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:08:22.230803 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec57a7-4acd-45ca-ba30-f2b0b7106aa9 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:22.283155 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:22.305345 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc952231-9cbc-4d37-a936-6f59c74e44b6 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:22.330535 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec57a7-4acd-45ca-ba30-f2b0b7106aa9 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:22.343261 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80ceb3-0a3d-4edd-b5d4-a00767c371ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:22.343500 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80ceb3-0a3d-4edd-b5d4-a00767c371ce None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:22.343608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80ceb3-0a3d-4edd-b5d4-a00767c371ce None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:22.343844 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80ceb3-0a3d-4edd-b5d4-a00767c371ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:22.367892 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783aa95-8e72-4c23-bb10-f8f5f38cd927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:22.368489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783aa95-8e72-4c23-bb10-f8f5f38cd927 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:22.368778 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783aa95-8e72-4c23-bb10-f8f5f38cd927 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:22.369049 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783aa95-8e72-4c23-bb10-f8f5f38cd927 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:22.369768 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783aa95-8e72-4c23-bb10-f8f5f38cd927 None admin] RBAC: Adding query filter params (role.id=72c80b472acb462ebadd86463efe91f7, scope.project.id=0451cc4397f44c08986d42fe017f8aa3, user.id=14ed3eae23104a36be0d0d5578359dd3) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:22.370077 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783aa95-8e72-4c23-bb10-f8f5f38cd927 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:22.371550 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783aa95-8e72-4c23-bb10-f8f5f38cd927 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:22.390408 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 554/1100] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:08:22 2022] GET /identity/v3/role_assignments?user.id=14ed3eae23104a36be0d0d5578359dd3&scope.project.id=0451cc4397f44c08986d42fe017f8aa3&role.id=72c80b472acb462ebadd86463efe91f7 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:08:22.406932 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:22.418776 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b80ceb3-0a3d-4edd-b5d4-a00767c371ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:22.420251 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b80ceb3-0a3d-4edd-b5d4-a00767c371ce None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:22.526099 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 547/1101] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:08:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 21 12:08:22.532032 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783aa95-8e72-4c23-bb10-f8f5f38cd927 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:22.636212 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783aa95-8e72-4c23-bb10-f8f5f38cd927 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:22.652285 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:22.671428 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07f24e-533b-4f2a-922b-6bbad1b5c86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:22.672056 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07f24e-533b-4f2a-922b-6bbad1b5c86b None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:22.672337 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07f24e-533b-4f2a-922b-6bbad1b5c86b None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:22.672613 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07f24e-533b-4f2a-922b-6bbad1b5c86b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:22.684248 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a07f24e-533b-4f2a-922b-6bbad1b5c86b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:22.685729 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a07f24e-533b-4f2a-922b-6bbad1b5c86b None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:22.702268 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-1a07f24e-533b-4f2a-922b-6bbad1b5c86b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:08:22.702268 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:22.702268 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:08:22.702268 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:08:22.702268 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:08:22.702268 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:08:22.702268 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:08:22.702268 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:08:22.702268 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:08:22.702268 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:08:22.702268 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:08:22.702268 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:08:22.702268 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:08:22.702268 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:08:22.702268 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:08:22.702268 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:08:22.703781 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:08:22.703781 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:08:22.703781 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:08:22.703781 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:08:22.703781 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:08:22.703781 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:08:22.703781 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:08:22.703781 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:08:22.703781 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:08:22.703781 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:08:22.703781 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:08:22.703781 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:08:22.703781 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:08:22.703781 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:08:22.703781 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:08:22.703781 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:08:22.703781 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:08:22.705629 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:08:22.705629 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:08:22.705629 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:08:22.705629 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 555/1102] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:08:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:08:22.710710 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80ceb3-0a3d-4edd-b5d4-a00767c371ce None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:22.804736 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:22.814491 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80ceb3-0a3d-4edd-b5d4-a00767c371ce None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:22.847436 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd0d42-221c-4308-96b3-999dde4654f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:22.848033 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd0d42-221c-4308-96b3-999dde4654f6 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:22.848829 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd0d42-221c-4308-96b3-999dde4654f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:22.849097 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd0d42-221c-4308-96b3-999dde4654f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:22.849725 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd0d42-221c-4308-96b3-999dde4654f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:22.850061 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd0d42-221c-4308-96b3-999dde4654f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:22.851407 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd0d42-221c-4308-96b3-999dde4654f6 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:22.862500 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 548/1103] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:08:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:22.868838 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07f24e-533b-4f2a-922b-6bbad1b5c86b None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:22.969435 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07f24e-533b-4f2a-922b-6bbad1b5c86b None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:23.002794 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b324644-9306-4d27-97f5-7d331a36c56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:23.003412 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b324644-9306-4d27-97f5-7d331a36c56b None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:23.003685 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b324644-9306-4d27-97f5-7d331a36c56b None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:23.003951 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b324644-9306-4d27-97f5-7d331a36c56b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:23.013232 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b324644-9306-4d27-97f5-7d331a36c56b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:23.015486 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b324644-9306-4d27-97f5-7d331a36c56b None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:23.031032 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-6b324644-9306-4d27-97f5-7d331a36c56b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:08:23.031032 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:23.031032 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:08:23.031032 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:08:23.031032 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:08:23.031032 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:08:23.031032 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:08:23.031032 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:08:23.031032 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:08:23.031032 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:08:23.031032 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:08:23.031032 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:08:23.031032 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 12:08:23.031032 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 12:08:23.031032 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 12:08:23.032228 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 12:08:23.032228 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:08:23.032228 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:08:23.032228 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:08:23.032228 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:08:23.032228 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:08:23.032228 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:08:23.032228 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:08:23.032228 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:08:23.032228 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:08:23.032228 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:08:23.032228 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:08:23.032228 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:08:23.032228 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:08:23.032228 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:08:23.032228 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:08:23.032228 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:08:23.033240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 12:08:23.033240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 12:08:23.033240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 12:08:23.033240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 12:08:23.033240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 12:08:23.033240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 12:08:23.033240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:08:23.033240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:08:23.034517 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 556/1104] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:08:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 12:08:23.039749 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd0d42-221c-4308-96b3-999dde4654f6 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:23.144808 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd0d42-221c-4308-96b3-999dde4654f6 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:23.179209 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19483d28-62ce-4933-b5d1-40bccfbabcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:23.179816 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19483d28-62ce-4933-b5d1-40bccfbabcd5 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:23.180095 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19483d28-62ce-4933-b5d1-40bccfbabcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:23.180369 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19483d28-62ce-4933-b5d1-40bccfbabcd5 None admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:23.181058 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19483d28-62ce-4933-b5d1-40bccfbabcd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:23.181366 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19483d28-62ce-4933-b5d1-40bccfbabcd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:23.182827 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19483d28-62ce-4933-b5d1-40bccfbabcd5 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:23.194837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 549/1105] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Sep 21 12:08:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:08:23.200912 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b324644-9306-4d27-97f5-7d331a36c56b None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:23.229831 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:23.301861 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b324644-9306-4d27-97f5-7d331a36c56b None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:23.336475 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab8c9b8-bd75-4f43-9ae7-39bbeab2ef50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:23.337074 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8c9b8-bd75-4f43-9ae7-39bbeab2ef50 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:23.337345 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8c9b8-bd75-4f43-9ae7-39bbeab2ef50 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:23.337608 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8c9b8-bd75-4f43-9ae7-39bbeab2ef50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:23.338316 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab8c9b8-bd75-4f43-9ae7-39bbeab2ef50 None admin] RBAC: Adding query filter params (role.id=a0f76a5a7b9c4af794c33ce6078ca7be, scope.project.id=b0abcc6f2ce14825bfc26e6210889c21, user.id=6cb4001f94b8439180ca2a93d3b279b1) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:23.338645 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab8c9b8-bd75-4f43-9ae7-39bbeab2ef50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:23.340048 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab8c9b8-bd75-4f43-9ae7-39bbeab2ef50 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:23.345635 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 557/1106] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:08:23 2022] GET /identity/v3/role_assignments?user.id=6cb4001f94b8439180ca2a93d3b279b1&scope.project.id=b0abcc6f2ce14825bfc26e6210889c21&role.id=a0f76a5a7b9c4af794c33ce6078ca7be => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:08:24.577249 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefebe7-6c0d-4594-9c57-33b66f7c99df None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:24.577729 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefebe7-6c0d-4594-9c57-33b66f7c99df None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:24.577818 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefebe7-6c0d-4594-9c57-33b66f7c99df None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:24.579187 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 550/1107] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:08:24.584959 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1b674-b369-47c3-8347-9a0b4c2c1d77 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:24.585383 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1b674-b369-47c3-8347-9a0b4c2c1d77 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:24.585519 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1b674-b369-47c3-8347-9a0b4c2c1d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:24.603889 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-7cd1b674-b369-47c3-8347-9a0b4c2c1d77 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:08:24.605077 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7cd1b674-b369-47c3-8347-9a0b4c2c1d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:08:24.669726 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 558/1108] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:08:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:08:24.937702 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceefebe7-6c0d-4594-9c57-33b66f7c99df None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:24.950502 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:25.038999 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceefebe7-6c0d-4594-9c57-33b66f7c99df None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:25.078005 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd493d1-aba3-4354-8936-a77581606092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:25.078663 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd493d1-aba3-4354-8936-a77581606092 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:25.078942 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd493d1-aba3-4354-8936-a77581606092 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:25.079213 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd493d1-aba3-4354-8936-a77581606092 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:25.080308 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd493d1-aba3-4354-8936-a77581606092 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:25.081732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd493d1-aba3-4354-8936-a77581606092 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:25.084049 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 551/1109] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:08:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:25.089931 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1b674-b369-47c3-8347-9a0b4c2c1d77 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:25.113033 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:25.188263 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1b674-b369-47c3-8347-9a0b4c2c1d77 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:25.221568 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b16e5-7c11-491c-a8db-0ca04d0ec74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:25.222160 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b16e5-7c11-491c-a8db-0ca04d0ec74b None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:25.222466 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b16e5-7c11-491c-a8db-0ca04d0ec74b None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:25.222740 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b16e5-7c11-491c-a8db-0ca04d0ec74b None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:25.223407 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b16e5-7c11-491c-a8db-0ca04d0ec74b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:25.224874 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b16e5-7c11-491c-a8db-0ca04d0ec74b None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:25.245151 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 559/1110] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Sep 21 12:08:25 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:08:27.419313 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b552112-311a-45de-89c1-7eee8776b10a None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:27.419856 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b552112-311a-45de-89c1-7eee8776b10a None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:27.420310 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b552112-311a-45de-89c1-7eee8776b10a None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:27.422501 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 552/1111] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:08:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:08:27.427891 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bda6cf-2dea-4a2e-991f-32f999e77004 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:27.428342 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bda6cf-2dea-4a2e-991f-32f999e77004 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:27.428433 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bda6cf-2dea-4a2e-991f-32f999e77004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:27.447132 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-15bda6cf-2dea-4a2e-991f-32f999e77004 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:08:27.448331 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-15bda6cf-2dea-4a2e-991f-32f999e77004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:08:27.513158 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 560/1112] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:08:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 12:08:27.792402 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b552112-311a-45de-89c1-7eee8776b10a None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:27.871891 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:27.895222 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b552112-311a-45de-89c1-7eee8776b10a None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:27.929921 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066658ca-8579-4d30-96a5-9f7f7a426a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:27.930571 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066658ca-8579-4d30-96a5-9f7f7a426a40 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:27.930854 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066658ca-8579-4d30-96a5-9f7f7a426a40 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:27.931126 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066658ca-8579-4d30-96a5-9f7f7a426a40 None admin] PATH_INFO: `/v3/roles/173d0e93641b4882934b75f256b38534` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:27.932524 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066658ca-8579-4d30-96a5-9f7f7a426a40 None admin] RBAC: Authorizing `identity:get_role(role_id=173d0e93641b4882934b75f256b38534)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:27.933877 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066658ca-8579-4d30-96a5-9f7f7a426a40 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:27.935245 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 553/1113] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:08:27 2022] GET /identity/v3/roles/173d0e93641b4882934b75f256b38534 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:27.941113 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bda6cf-2dea-4a2e-991f-32f999e77004 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:27.951437 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:28.041193 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bda6cf-2dea-4a2e-991f-32f999e77004 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:28.076528 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d10a1-ed0b-47cf-97b3-79d756fe01ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:28.077076 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d10a1-ed0b-47cf-97b3-79d756fe01ae None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:28.077353 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d10a1-ed0b-47cf-97b3-79d756fe01ae None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:28.077628 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d10a1-ed0b-47cf-97b3-79d756fe01ae None admin] PATH_INFO: `/v3/users/201ccac21cee4516b195bc5bd21e5f20` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:28.091138 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d10a1-ed0b-47cf-97b3-79d756fe01ae None admin] RBAC: Authorizing `identity:get_user(user_id=201ccac21cee4516b195bc5bd21e5f20)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:28.092580 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d10a1-ed0b-47cf-97b3-79d756fe01ae None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:28.094217 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 561/1114] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:08:27 2022] GET /identity/v3/users/201ccac21cee4516b195bc5bd21e5f20 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:28.100604 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066658ca-8579-4d30-96a5-9f7f7a426a40 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:28.202825 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066658ca-8579-4d30-96a5-9f7f7a426a40 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:28.236999 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ac51d-1f29-4c0e-b608-12b44dd2523a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:28.237598 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ac51d-1f29-4c0e-b608-12b44dd2523a None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:28.237879 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ac51d-1f29-4c0e-b608-12b44dd2523a None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:28.238153 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ac51d-1f29-4c0e-b608-12b44dd2523a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:28.253936 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:28.311312 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ac51d-1f29-4c0e-b608-12b44dd2523a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:28.312800 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ac51d-1f29-4c0e-b608-12b44dd2523a None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:28.417027 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 554/1115] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:08:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 12:08:28.422964 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d10a1-ed0b-47cf-97b3-79d756fe01ae None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:28.486948 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:28.522740 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d10a1-ed0b-47cf-97b3-79d756fe01ae None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:28.561862 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf453822-1ac9-42fe-b1bc-9f2764c8c028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:28.562524 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf453822-1ac9-42fe-b1bc-9f2764c8c028 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:28.562805 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf453822-1ac9-42fe-b1bc-9f2764c8c028 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:28.563077 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf453822-1ac9-42fe-b1bc-9f2764c8c028 None admin] PATH_INFO: `/v3/projects/0451cc4397f44c08986d42fe017f8aa3` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:28.564204 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf453822-1ac9-42fe-b1bc-9f2764c8c028 None admin] RBAC: Authorizing `identity:get_project(project_id=0451cc4397f44c08986d42fe017f8aa3)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:28.565634 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf453822-1ac9-42fe-b1bc-9f2764c8c028 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:28.567981 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 562/1116] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:08:28 2022] GET /identity/v3/projects/0451cc4397f44c08986d42fe017f8aa3 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:28.574332 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ac51d-1f29-4c0e-b608-12b44dd2523a None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:28.620833 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:28.674188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ac51d-1f29-4c0e-b608-12b44dd2523a None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:28.708053 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834142d-033a-490e-a19c-c7f33d7e9148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:28.708655 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834142d-033a-490e-a19c-c7f33d7e9148 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:28.708933 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834142d-033a-490e-a19c-c7f33d7e9148 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:28.709203 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834142d-033a-490e-a19c-c7f33d7e9148 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:28.709915 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7834142d-033a-490e-a19c-c7f33d7e9148 None admin] RBAC: Adding query filter params (role.id=173d0e93641b4882934b75f256b38534, scope.project.id=0451cc4397f44c08986d42fe017f8aa3, user.id=201ccac21cee4516b195bc5bd21e5f20) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:28.710219 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7834142d-033a-490e-a19c-c7f33d7e9148 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:28.711678 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7834142d-033a-490e-a19c-c7f33d7e9148 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:28.717051 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 555/1117] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:08:28 2022] GET /identity/v3/role_assignments?user.id=201ccac21cee4516b195bc5bd21e5f20&scope.project.id=0451cc4397f44c08986d42fe017f8aa3&role.id=173d0e93641b4882934b75f256b38534 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:30.938916 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53347ea1-65fd-4006-81e8-59373bd35a6d None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:30.939443 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53347ea1-65fd-4006-81e8-59373bd35a6d None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:30.939443 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53347ea1-65fd-4006-81e8-59373bd35a6d None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:30.940677 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 563/1118] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:08:30.946542 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe54ef-32ec-4a9a-8b1a-37a04130e258 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:30.946974 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe54ef-32ec-4a9a-8b1a-37a04130e258 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:30.947096 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe54ef-32ec-4a9a-8b1a-37a04130e258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:30.966045 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-ecbe54ef-32ec-4a9a-8b1a-37a04130e258 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:08:30.967291 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-ecbe54ef-32ec-4a9a-8b1a-37a04130e258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:08:31.033708 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 556/1119] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:08:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:08:31.306111 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53347ea1-65fd-4006-81e8-59373bd35a6d None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:31.410205 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53347ea1-65fd-4006-81e8-59373bd35a6d None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:31.452912 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed62925-5e03-4d10-a9ab-7dbb8df98b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:31.453585 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed62925-5e03-4d10-a9ab-7dbb8df98b73 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:31.453865 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed62925-5e03-4d10-a9ab-7dbb8df98b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:31.454144 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed62925-5e03-4d10-a9ab-7dbb8df98b73 None admin] PATH_INFO: `/v3/roles/173d0e93641b4882934b75f256b38534` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:31.455828 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed62925-5e03-4d10-a9ab-7dbb8df98b73 None admin] RBAC: Authorizing `identity:get_role(role_id=173d0e93641b4882934b75f256b38534)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:31.457282 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed62925-5e03-4d10-a9ab-7dbb8df98b73 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:31.458790 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 564/1120] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:08:31 2022] GET /identity/v3/roles/173d0e93641b4882934b75f256b38534 => generated 223 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:31.465426 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe54ef-32ec-4a9a-8b1a-37a04130e258 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:31.515340 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:31.587415 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe54ef-32ec-4a9a-8b1a-37a04130e258 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:31.630982 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221c345-a415-4b18-b3da-962fc7f53822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:31.631656 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221c345-a415-4b18-b3da-962fc7f53822 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:31.631933 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221c345-a415-4b18-b3da-962fc7f53822 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:31.632207 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221c345-a415-4b18-b3da-962fc7f53822 None admin] PATH_INFO: `/v3/users/201ccac21cee4516b195bc5bd21e5f20` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:31.633635 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221c345-a415-4b18-b3da-962fc7f53822 None admin] RBAC: Authorizing `identity:get_user(user_id=201ccac21cee4516b195bc5bd21e5f20)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:31.635182 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221c345-a415-4b18-b3da-962fc7f53822 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:31.636969 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 557/1121] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:08:31 2022] GET /identity/v3/users/201ccac21cee4516b195bc5bd21e5f20 => generated 286 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:31.643386 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed62925-5e03-4d10-a9ab-7dbb8df98b73 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:31.647057 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:31.764317 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed62925-5e03-4d10-a9ab-7dbb8df98b73 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:31.803830 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50fe815-5708-4c35-beb9-1c1024a9a293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:31.804477 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fe815-5708-4c35-beb9-1c1024a9a293 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:31.804757 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fe815-5708-4c35-beb9-1c1024a9a293 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:31.805037 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fe815-5708-4c35-beb9-1c1024a9a293 None admin] PATH_INFO: `/v3/projects/0451cc4397f44c08986d42fe017f8aa3` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:31.806282 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50fe815-5708-4c35-beb9-1c1024a9a293 None admin] RBAC: Authorizing `identity:get_project(project_id=0451cc4397f44c08986d42fe017f8aa3)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:31.807795 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50fe815-5708-4c35-beb9-1c1024a9a293 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:31.809562 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 565/1122] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:08:31 2022] GET /identity/v3/projects/0451cc4397f44c08986d42fe017f8aa3 => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:31.815882 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221c345-a415-4b18-b3da-962fc7f53822 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:31.933126 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221c345-a415-4b18-b3da-962fc7f53822 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:31.944896 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:31.969501 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a69828-0ad2-4b25-a173-a4ad97998173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:31.970154 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a69828-0ad2-4b25-a173-a4ad97998173 None admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:31.970465 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a69828-0ad2-4b25-a173-a4ad97998173 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:31.970744 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a69828-0ad2-4b25-a173-a4ad97998173 None admin] PATH_INFO: `/v3/projects/0451cc4397f44c08986d42fe017f8aa3/users/201ccac21cee4516b195bc5bd21e5f20/roles/173d0e93641b4882934b75f256b38534` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:31.973475 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a69828-0ad2-4b25-a173-a4ad97998173 None admin] RBAC: Authorizing `identity:create_grant(project_id=0451cc4397f44c08986d42fe017f8aa3, user_id=201ccac21cee4516b195bc5bd21e5f20, role_id=173d0e93641b4882934b75f256b38534)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:31.974946 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a69828-0ad2-4b25-a173-a4ad97998173 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:31.987444 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 558/1123] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Sep 21 12:08:31 2022] PUT /identity/v3/projects/0451cc4397f44c08986d42fe017f8aa3/users/201ccac21cee4516b195bc5bd21e5f20/roles/173d0e93641b4882934b75f256b38534 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:08:34.187944 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2ebf1-8e29-4ac7-bc41-b402bc11f556 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:34.188514 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2ebf1-8e29-4ac7-bc41-b402bc11f556 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:34.188514 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2ebf1-8e29-4ac7-bc41-b402bc11f556 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:34.189820 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 566/1124] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:08:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:08:34.196037 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0dce0-9b9f-4756-a93f-d715b581d831 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:34.196488 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0dce0-9b9f-4756-a93f-d715b581d831 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:34.196578 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0dce0-9b9f-4756-a93f-d715b581d831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:34.215924 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-fca0dce0-9b9f-4756-a93f-d715b581d831 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:08:34.217126 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-fca0dce0-9b9f-4756-a93f-d715b581d831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:08:34.286764 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 559/1125] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:08:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:08:34.553980 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2ebf1-8e29-4ac7-bc41-b402bc11f556 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:34.626004 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:34.674471 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2ebf1-8e29-4ac7-bc41-b402bc11f556 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:34.710716 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e100a58-75ff-4239-ab7d-0ea7003cd63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:34.711348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e100a58-75ff-4239-ab7d-0ea7003cd63e None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:34.711624 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e100a58-75ff-4239-ab7d-0ea7003cd63e None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:34.711894 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e100a58-75ff-4239-ab7d-0ea7003cd63e None admin] PATH_INFO: `/v3/roles/173d0e93641b4882934b75f256b38534` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:34.713315 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e100a58-75ff-4239-ab7d-0ea7003cd63e None admin] RBAC: Authorizing `identity:get_role(role_id=173d0e93641b4882934b75f256b38534)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:34.714726 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e100a58-75ff-4239-ab7d-0ea7003cd63e None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:34.716082 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 567/1126] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:08:34 2022] GET /identity/v3/roles/173d0e93641b4882934b75f256b38534 => generated 223 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:34.722191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0dce0-9b9f-4756-a93f-d715b581d831 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:34.838666 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:34.842641 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0dce0-9b9f-4756-a93f-d715b581d831 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:34.880753 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0004ded-2cd3-4887-8e5f-84a4c57169ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:34.881398 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0004ded-2cd3-4887-8e5f-84a4c57169ed None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:34.881677 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0004ded-2cd3-4887-8e5f-84a4c57169ed None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:34.881943 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0004ded-2cd3-4887-8e5f-84a4c57169ed None admin] PATH_INFO: `/v3/users/201ccac21cee4516b195bc5bd21e5f20` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:34.883112 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0004ded-2cd3-4887-8e5f-84a4c57169ed None admin] RBAC: Authorizing `identity:get_user(user_id=201ccac21cee4516b195bc5bd21e5f20)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:34.884549 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0004ded-2cd3-4887-8e5f-84a4c57169ed None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:34.886164 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 560/1127] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:08:34 2022] GET /identity/v3/users/201ccac21cee4516b195bc5bd21e5f20 => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:34.892513 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e100a58-75ff-4239-ab7d-0ea7003cd63e None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:34.996946 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e100a58-75ff-4239-ab7d-0ea7003cd63e None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:35.032509 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3a468-54a1-4dda-9491-fee27acdb8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:35.033110 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3a468-54a1-4dda-9491-fee27acdb8b1 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:35.033390 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3a468-54a1-4dda-9491-fee27acdb8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:35.033657 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3a468-54a1-4dda-9491-fee27acdb8b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:35.043097 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:35.109426 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a3a468-54a1-4dda-9491-fee27acdb8b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:35.110838 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a3a468-54a1-4dda-9491-fee27acdb8b1 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:35.222617 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 568/1128] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:08:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 12:08:35.229369 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0004ded-2cd3-4887-8e5f-84a4c57169ed None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:35.333825 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0004ded-2cd3-4887-8e5f-84a4c57169ed None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:35.368696 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c9836-2821-4cd7-a428-cdafa64062e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:35.369243 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c9836-2821-4cd7-a428-cdafa64062e8 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:35.369520 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c9836-2821-4cd7-a428-cdafa64062e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:35.369789 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c9836-2821-4cd7-a428-cdafa64062e8 None admin] PATH_INFO: `/v3/projects/0451cc4397f44c08986d42fe017f8aa3` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:35.371002 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c9836-2821-4cd7-a428-cdafa64062e8 None admin] RBAC: Authorizing `identity:get_project(project_id=0451cc4397f44c08986d42fe017f8aa3)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:35.372434 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c9836-2821-4cd7-a428-cdafa64062e8 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:35.374076 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 561/1129] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:08:35 2022] GET /identity/v3/projects/0451cc4397f44c08986d42fe017f8aa3 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:35.381808 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3a468-54a1-4dda-9491-fee27acdb8b1 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:35.425218 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:35.498727 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3a468-54a1-4dda-9491-fee27acdb8b1 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:35.540202 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5bc6ef-5d28-4377-8729-4b995c8476e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:35.540829 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5bc6ef-5d28-4377-8729-4b995c8476e9 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:35.541104 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5bc6ef-5d28-4377-8729-4b995c8476e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:35.541372 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5bc6ef-5d28-4377-8729-4b995c8476e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:35.542129 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5bc6ef-5d28-4377-8729-4b995c8476e9 None admin] RBAC: Adding query filter params (role.id=173d0e93641b4882934b75f256b38534, scope.project.id=0451cc4397f44c08986d42fe017f8aa3, user.id=201ccac21cee4516b195bc5bd21e5f20) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:35.542471 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5bc6ef-5d28-4377-8729-4b995c8476e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:35.543973 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5bc6ef-5d28-4377-8729-4b995c8476e9 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:35.550734 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 569/1130] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:08:35 2022] GET /identity/v3/role_assignments?user.id=201ccac21cee4516b195bc5bd21e5f20&scope.project.id=0451cc4397f44c08986d42fe017f8aa3&role.id=173d0e93641b4882934b75f256b38534 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:08:37.807901 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bdf777-f4b7-4dbd-92e7-2ca5ddf642a4 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:37.808430 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bdf777-f4b7-4dbd-92e7-2ca5ddf642a4 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:37.808430 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bdf777-f4b7-4dbd-92e7-2ca5ddf642a4 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:37.809783 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 562/1131] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:08:37.815768 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba977780-2444-4606-ade4-31af22c028c6 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:37.816234 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba977780-2444-4606-ade4-31af22c028c6 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:37.816863 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba977780-2444-4606-ade4-31af22c028c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:37.835755 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-ba977780-2444-4606-ade4-31af22c028c6 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:08:37.837799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ba977780-2444-4606-ade4-31af22c028c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:08:37.909935 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 570/1132] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:08:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:08:38.186644 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bdf777-f4b7-4dbd-92e7-2ca5ddf642a4 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:38.224021 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:38.297675 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bdf777-f4b7-4dbd-92e7-2ca5ddf642a4 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:38.332917 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf498b-1fed-4eb1-b1be-ce942f8596ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:38.333548 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf498b-1fed-4eb1-b1be-ce942f8596ca None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:38.333831 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf498b-1fed-4eb1-b1be-ce942f8596ca None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:38.334105 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf498b-1fed-4eb1-b1be-ce942f8596ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:38.335272 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf498b-1fed-4eb1-b1be-ce942f8596ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:38.336715 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf498b-1fed-4eb1-b1be-ce942f8596ca None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:38.338304 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 563/1133] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:08:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:38.344289 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba977780-2444-4606-ade4-31af22c028c6 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:38.375285 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:38.445123 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba977780-2444-4606-ade4-31af22c028c6 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:38.478918 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff0406-6faf-45f0-ba2f-5c0d943b6b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:38.479515 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff0406-6faf-45f0-ba2f-5c0d943b6b3f None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:38.479797 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff0406-6faf-45f0-ba2f-5c0d943b6b3f None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:38.480071 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff0406-6faf-45f0-ba2f-5c0d943b6b3f None admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:38.480731 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ff0406-6faf-45f0-ba2f-5c0d943b6b3f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:38.482156 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ff0406-6faf-45f0-ba2f-5c0d943b6b3f None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:38.509920 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 571/1134] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Sep 21 12:08:38 2022] POST /identity/v3/projects => generated 311 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:08:40.740438 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfce0fc-eb74-49d1-9c56-ce682aaa8e61 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:40.740969 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfce0fc-eb74-49d1-9c56-ce682aaa8e61 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:40.741062 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfce0fc-eb74-49d1-9c56-ce682aaa8e61 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:40.742397 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 564/1135] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:08:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:08:40.750327 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c24ed-85de-42c6-b6c0-f16ed3b19887 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:40.750906 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c24ed-85de-42c6-b6c0-f16ed3b19887 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:40.751003 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c24ed-85de-42c6-b6c0-f16ed3b19887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:40.773327 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-c76c24ed-85de-42c6-b6c0-f16ed3b19887 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:08:40.774726 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-c76c24ed-85de-42c6-b6c0-f16ed3b19887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:08:40.849385 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 572/1136] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:08:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:08:41.121915 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfce0fc-eb74-49d1-9c56-ce682aaa8e61 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:41.225532 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfce0fc-eb74-49d1-9c56-ce682aaa8e61 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:41.227159 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:41.262830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aff033-4c58-4c2f-805e-3b20c450d0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:41.263471 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aff033-4c58-4c2f-805e-3b20c450d0e5 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:41.263749 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aff033-4c58-4c2f-805e-3b20c450d0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:41.264018 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aff033-4c58-4c2f-805e-3b20c450d0e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:41.265141 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aff033-4c58-4c2f-805e-3b20c450d0e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:41.266620 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aff033-4c58-4c2f-805e-3b20c450d0e5 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:41.268220 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 565/1137] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:08:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:41.274140 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c24ed-85de-42c6-b6c0-f16ed3b19887 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:41.289413 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:41.374814 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c24ed-85de-42c6-b6c0-f16ed3b19887 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:41.409336 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b614d19-4fcb-4528-9a61-3dd3c8ecbc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:41.409944 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b614d19-4fcb-4528-9a61-3dd3c8ecbc5d None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:41.410761 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b614d19-4fcb-4528-9a61-3dd3c8ecbc5d None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:41.411034 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b614d19-4fcb-4528-9a61-3dd3c8ecbc5d None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:41.411696 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b614d19-4fcb-4528-9a61-3dd3c8ecbc5d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:41.413136 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b614d19-4fcb-4528-9a61-3dd3c8ecbc5d None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:41.435201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 573/1138] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Sep 21 12:08:41 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:08:43.730472 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d85a59-a7f4-4acd-9891-90073abb7b08 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:43.731035 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d85a59-a7f4-4acd-9891-90073abb7b08 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:43.731035 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d85a59-a7f4-4acd-9891-90073abb7b08 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:43.732441 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 566/1139] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:08:43.737769 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4da182-e1d2-430c-bd60-7676427ed924 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:43.738174 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4da182-e1d2-430c-bd60-7676427ed924 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:43.738314 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4da182-e1d2-430c-bd60-7676427ed924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:43.756816 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-bf4da182-e1d2-430c-bd60-7676427ed924 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:08:43.758010 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-bf4da182-e1d2-430c-bd60-7676427ed924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:08:43.822959 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:43.828481 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 574/1140] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:08:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:08:44.098897 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d85a59-a7f4-4acd-9891-90073abb7b08 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:44.199773 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d85a59-a7f4-4acd-9891-90073abb7b08 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:44.235401 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b321799-3365-45e2-883c-9a9d2d9cb1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:44.236023 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b321799-3365-45e2-883c-9a9d2d9cb1c9 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:44.236304 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b321799-3365-45e2-883c-9a9d2d9cb1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:44.236579 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b321799-3365-45e2-883c-9a9d2d9cb1c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:44.246618 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b321799-3365-45e2-883c-9a9d2d9cb1c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:08:44.251375 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-5b321799-3365-45e2-883c-9a9d2d9cb1c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:08:44.251375 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:44.251375 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:08:44.251375 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:08:44.251375 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:08:44.251375 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:08:44.251375 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:08:44.251375 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:08:44.251375 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:08:44.251375 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:08:44.251375 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:08:44.251375 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:08:44.251375 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:08:44.251375 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:08:44.251375 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:08:44.251375 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:08:44.254608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:08:44.254608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:08:44.254608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:08:44.254608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:08:44.254608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:08:44.254608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:08:44.254608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:08:44.254608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:08:44.254608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:08:44.254608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:08:44.254608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:08:44.254608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:08:44.254608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:08:44.254608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:08:44.254608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:08:44.254608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:08:44.255778 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:08:44.255778 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:08:44.255778 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:08:44.255778 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:08:44.255778 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:08:44.255778 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:08:44.255778 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:08:44.255778 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:08:44.255778 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:08:44.255778 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:08:44.255778 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:08:44.255778 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:08:44.255778 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 567/1141] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Sep 21 12:08:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:08:44.258526 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4da182-e1d2-430c-bd60-7676427ed924 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:44.361762 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4da182-e1d2-430c-bd60-7676427ed924 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:44.397220 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f054fe0c-59b1-44bb-8cef-aab06f727092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:44.397827 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054fe0c-59b1-44bb-8cef-aab06f727092 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:44.398103 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054fe0c-59b1-44bb-8cef-aab06f727092 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:44.398402 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054fe0c-59b1-44bb-8cef-aab06f727092 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:44.399067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f054fe0c-59b1-44bb-8cef-aab06f727092 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:44.399370 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f054fe0c-59b1-44bb-8cef-aab06f727092 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:44.400733 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f054fe0c-59b1-44bb-8cef-aab06f727092 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:44.409305 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 575/1142] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:08:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:44.415594 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b321799-3365-45e2-883c-9a9d2d9cb1c9 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:44.447689 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:44.524629 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b321799-3365-45e2-883c-9a9d2d9cb1c9 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:44.560532 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86496234-050e-4c3a-bbe1-d9cd092ff4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:44.561184 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86496234-050e-4c3a-bbe1-d9cd092ff4f8 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:44.561462 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86496234-050e-4c3a-bbe1-d9cd092ff4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:44.561735 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86496234-050e-4c3a-bbe1-d9cd092ff4f8 None admin] PATH_INFO: `/v3/users/257ed1ac5caa4bb7a25eb096166739f2` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:44.579811 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86496234-050e-4c3a-bbe1-d9cd092ff4f8 None admin] RBAC: Authorizing `identity:get_user(user_id=257ed1ac5caa4bb7a25eb096166739f2)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:44.581282 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86496234-050e-4c3a-bbe1-d9cd092ff4f8 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:44.583053 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 568/1143] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:08:44 2022] GET /identity/v3/users/257ed1ac5caa4bb7a25eb096166739f2 => generated 286 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:44.597881 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f054fe0c-59b1-44bb-8cef-aab06f727092 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:44.666133 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:44.706559 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f054fe0c-59b1-44bb-8cef-aab06f727092 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:44.740055 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f7d20-d80b-49ca-86a5-1d12de506589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:44.740736 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f7d20-d80b-49ca-86a5-1d12de506589 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:44.740911 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f7d20-d80b-49ca-86a5-1d12de506589 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:44.741181 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f7d20-d80b-49ca-86a5-1d12de506589 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:44.806071 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f7d20-d80b-49ca-86a5-1d12de506589 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:44.807547 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f7d20-d80b-49ca-86a5-1d12de506589 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:44.864549 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:44.903126 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 576/1144] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:08:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 12:08:44.909231 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86496234-050e-4c3a-bbe1-d9cd092ff4f8 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:44.999338 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:45.011903 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86496234-050e-4c3a-bbe1-d9cd092ff4f8 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:45.046133 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19748c-fefb-47b4-a28b-bf826951f9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:45.046784 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19748c-fefb-47b4-a28b-bf826951f9d5 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:45.047066 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19748c-fefb-47b4-a28b-bf826951f9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:45.047340 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19748c-fefb-47b4-a28b-bf826951f9d5 None admin] PATH_INFO: `/v3/projects/5a8c4cf5a82d4cdfadb477362c9b9afc` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:45.048450 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19748c-fefb-47b4-a28b-bf826951f9d5 None admin] RBAC: Authorizing `identity:get_project(project_id=5a8c4cf5a82d4cdfadb477362c9b9afc)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:45.049876 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19748c-fefb-47b4-a28b-bf826951f9d5 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:45.051582 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 569/1145] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:08:44 2022] GET /identity/v3/projects/5a8c4cf5a82d4cdfadb477362c9b9afc => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:45.057867 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f7d20-d80b-49ca-86a5-1d12de506589 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:45.154247 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f7d20-d80b-49ca-86a5-1d12de506589 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:45.186651 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eaa40b-8e9e-41d0-a6d9-799c764e43d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:45.187242 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eaa40b-8e9e-41d0-a6d9-799c764e43d1 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:45.187523 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eaa40b-8e9e-41d0-a6d9-799c764e43d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:45.187795 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eaa40b-8e9e-41d0-a6d9-799c764e43d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:45.188509 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eaa40b-8e9e-41d0-a6d9-799c764e43d1 None admin] RBAC: Adding query filter params (role.id=72c80b472acb462ebadd86463efe91f7, scope.project.id=5a8c4cf5a82d4cdfadb477362c9b9afc, user.id=257ed1ac5caa4bb7a25eb096166739f2) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:45.188814 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eaa40b-8e9e-41d0-a6d9-799c764e43d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:45.190230 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eaa40b-8e9e-41d0-a6d9-799c764e43d1 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:45.196125 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 577/1146] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:08:45 2022] GET /identity/v3/role_assignments?user.id=257ed1ac5caa4bb7a25eb096166739f2&scope.project.id=5a8c4cf5a82d4cdfadb477362c9b9afc&role.id=72c80b472acb462ebadd86463efe91f7 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:47.324841 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f559a-bee6-49fe-a317-fa487570f1a3 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:47.325398 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f559a-bee6-49fe-a317-fa487570f1a3 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:47.325398 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f559a-bee6-49fe-a317-fa487570f1a3 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:47.326734 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 570/1147] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:08:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:08:47.332375 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2cc72b-faa2-451b-a2e6-1e3cedebba88 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:47.332810 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2cc72b-faa2-451b-a2e6-1e3cedebba88 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:47.332913 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2cc72b-faa2-451b-a2e6-1e3cedebba88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:47.351475 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-bf2cc72b-faa2-451b-a2e6-1e3cedebba88 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:08:47.352662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-bf2cc72b-faa2-451b-a2e6-1e3cedebba88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:08:47.372265 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:47.418482 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 578/1148] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:08:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 12:08:47.686862 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f559a-bee6-49fe-a317-fa487570f1a3 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:47.789641 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f559a-bee6-49fe-a317-fa487570f1a3 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:47.823317 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f52269-5648-43ca-b77e-a4a63e16e77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:47.823934 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f52269-5648-43ca-b77e-a4a63e16e77c None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:47.824209 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f52269-5648-43ca-b77e-a4a63e16e77c None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:47.824475 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f52269-5648-43ca-b77e-a4a63e16e77c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:47.834216 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f52269-5648-43ca-b77e-a4a63e16e77c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:08:47.838920 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-61f52269-5648-43ca-b77e-a4a63e16e77c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:08:47.838920 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:47.838920 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:08:47.838920 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:08:47.838920 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:08:47.838920 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:08:47.838920 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:08:47.838920 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:08:47.838920 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:08:47.838920 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:08:47.838920 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:08:47.838920 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:08:47.838920 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:08:47.838920 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:08:47.838920 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:08:47.838920 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:08:47.840026 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:08:47.840026 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:08:47.840026 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:08:47.840026 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:08:47.840026 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:08:47.840026 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:08:47.840026 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:08:47.840026 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:08:47.840026 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:08:47.840026 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:08:47.840026 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:08:47.840026 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:08:47.840026 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:08:47.840026 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:08:47.840026 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:08:47.840026 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:08:47.841257 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:08:47.841257 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:08:47.841257 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:08:47.841257 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:08:47.841257 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:08:47.841257 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:08:47.841257 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:08:47.841257 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:08:47.841257 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:08:47.841257 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:08:47.841257 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:08:47.841257 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:08:47.841257 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 571/1149] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Sep 21 12:08:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:08:47.846068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2cc72b-faa2-451b-a2e6-1e3cedebba88 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:47.948785 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2cc72b-faa2-451b-a2e6-1e3cedebba88 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:47.981427 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b899f-2a3a-40bc-a6b0-5174ed170449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:47.982032 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b899f-2a3a-40bc-a6b0-5174ed170449 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:47.982311 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b899f-2a3a-40bc-a6b0-5174ed170449 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:47.982606 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b899f-2a3a-40bc-a6b0-5174ed170449 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:47.983276 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b899f-2a3a-40bc-a6b0-5174ed170449 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:47.983578 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b899f-2a3a-40bc-a6b0-5174ed170449 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:47.984945 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b899f-2a3a-40bc-a6b0-5174ed170449 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:47.993812 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 579/1150] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:08:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:48.001259 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f52269-5648-43ca-b77e-a4a63e16e77c None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:48.022160 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:48.102388 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f52269-5648-43ca-b77e-a4a63e16e77c None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:48.135491 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8dd64-44e1-49ba-b3c1-77c5449b36a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:48.136108 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8dd64-44e1-49ba-b3c1-77c5449b36a8 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:48.136379 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8dd64-44e1-49ba-b3c1-77c5449b36a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:48.136650 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8dd64-44e1-49ba-b3c1-77c5449b36a8 None admin] PATH_INFO: `/v3/users/257ed1ac5caa4bb7a25eb096166739f2` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:48.137996 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc8dd64-44e1-49ba-b3c1-77c5449b36a8 None admin] RBAC: Authorizing `identity:get_user(user_id=257ed1ac5caa4bb7a25eb096166739f2)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:48.139442 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc8dd64-44e1-49ba-b3c1-77c5449b36a8 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:48.140999 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 572/1151] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:08:47 2022] GET /identity/v3/users/257ed1ac5caa4bb7a25eb096166739f2 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:48.147056 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b899f-2a3a-40bc-a6b0-5174ed170449 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:48.166464 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:48.253913 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b899f-2a3a-40bc-a6b0-5174ed170449 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:48.287357 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2126a60-812c-41b1-88c1-7b22687a46de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:48.287971 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2126a60-812c-41b1-88c1-7b22687a46de None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:48.288251 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2126a60-812c-41b1-88c1-7b22687a46de None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:48.288528 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2126a60-812c-41b1-88c1-7b22687a46de None admin] PATH_INFO: `/v3/projects/5a8c4cf5a82d4cdfadb477362c9b9afc` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:48.289635 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2126a60-812c-41b1-88c1-7b22687a46de None admin] RBAC: Authorizing `identity:get_project(project_id=5a8c4cf5a82d4cdfadb477362c9b9afc)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:48.291086 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2126a60-812c-41b1-88c1-7b22687a46de None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:48.292695 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 580/1152] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:08:48 2022] GET /identity/v3/projects/5a8c4cf5a82d4cdfadb477362c9b9afc => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:48.298751 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8dd64-44e1-49ba-b3c1-77c5449b36a8 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:48.382683 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:48.401178 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8dd64-44e1-49ba-b3c1-77c5449b36a8 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:48.436115 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d12f2-677c-4607-8892-06c9dd4fce6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:48.436780 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d12f2-677c-4607-8892-06c9dd4fce6f None admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:48.437063 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d12f2-677c-4607-8892-06c9dd4fce6f None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:48.437339 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d12f2-677c-4607-8892-06c9dd4fce6f None admin] PATH_INFO: `/v3/projects/5a8c4cf5a82d4cdfadb477362c9b9afc/users/257ed1ac5caa4bb7a25eb096166739f2/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:48.439289 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d12f2-677c-4607-8892-06c9dd4fce6f None admin] RBAC: Authorizing `identity:create_grant(project_id=5a8c4cf5a82d4cdfadb477362c9b9afc, user_id=257ed1ac5caa4bb7a25eb096166739f2, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:48.440869 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d12f2-677c-4607-8892-06c9dd4fce6f None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:48.454692 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 573/1153] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Sep 21 12:08:48 2022] PUT /identity/v3/projects/5a8c4cf5a82d4cdfadb477362c9b9afc/users/257ed1ac5caa4bb7a25eb096166739f2/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:08:50.637024 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12765d-1992-446c-933b-5094a6210773 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:50.637838 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12765d-1992-446c-933b-5094a6210773 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:50.637838 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12765d-1992-446c-933b-5094a6210773 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:50.639163 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 581/1154] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:08:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:08:50.644764 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4aa42-a545-49e9-8cf6-96d2e1dfc278 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:50.645249 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4aa42-a545-49e9-8cf6-96d2e1dfc278 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:50.645343 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4aa42-a545-49e9-8cf6-96d2e1dfc278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:50.665349 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-21a4aa42-a545-49e9-8cf6-96d2e1dfc278 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:08:50.666709 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-21a4aa42-a545-49e9-8cf6-96d2e1dfc278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:08:50.735406 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 574/1155] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:08:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:08:51.005281 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12765d-1992-446c-933b-5094a6210773 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:51.097014 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:51.113189 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12765d-1992-446c-933b-5094a6210773 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:51.146794 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff90db-c474-4c5d-ab9f-684a6ba9fce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:51.147407 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff90db-c474-4c5d-ab9f-684a6ba9fce7 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:51.147686 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff90db-c474-4c5d-ab9f-684a6ba9fce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:51.147955 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff90db-c474-4c5d-ab9f-684a6ba9fce7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:51.157650 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff90db-c474-4c5d-ab9f-684a6ba9fce7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:08:51.162402 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-61ff90db-c474-4c5d-ab9f-684a6ba9fce7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:08:51.162402 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:51.162402 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:08:51.162402 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:08:51.162402 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:08:51.162402 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:08:51.162402 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:08:51.162402 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:08:51.162402 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:08:51.162402 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:08:51.162402 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:08:51.162402 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:08:51.162402 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:08:51.162402 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:08:51.162402 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:08:51.162402 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:08:51.163505 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:08:51.163505 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:08:51.163505 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:08:51.163505 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:08:51.163505 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:08:51.163505 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:08:51.163505 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:08:51.163505 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:08:51.163505 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:08:51.163505 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:08:51.163505 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:08:51.163505 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:08:51.163505 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:08:51.163505 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:08:51.163505 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:08:51.163505 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:08:51.164594 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:08:51.164594 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:08:51.164594 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:08:51.164594 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:08:51.164594 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:08:51.164594 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:08:51.164594 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:08:51.164594 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:08:51.164594 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:08:51.164594 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:08:51.164594 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:08:51.164594 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:08:51.164594 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 582/1156] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Sep 21 12:08:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:08:51.169610 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4aa42-a545-49e9-8cf6-96d2e1dfc278 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:51.243468 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:51.270509 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4aa42-a545-49e9-8cf6-96d2e1dfc278 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:51.303877 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bacd03e-ed0e-4427-b0ae-e3eeaccd9a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:51.304483 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bacd03e-ed0e-4427-b0ae-e3eeaccd9a6b None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:51.304765 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bacd03e-ed0e-4427-b0ae-e3eeaccd9a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:51.305041 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bacd03e-ed0e-4427-b0ae-e3eeaccd9a6b None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:51.305702 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bacd03e-ed0e-4427-b0ae-e3eeaccd9a6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:51.306008 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bacd03e-ed0e-4427-b0ae-e3eeaccd9a6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:51.307413 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bacd03e-ed0e-4427-b0ae-e3eeaccd9a6b None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:51.315674 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 575/1157] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:08:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:51.322187 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff90db-c474-4c5d-ab9f-684a6ba9fce7 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:51.420489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff90db-c474-4c5d-ab9f-684a6ba9fce7 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:51.454289 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07f826-2990-4202-9644-c1f5cd95cc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:51.454946 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07f826-2990-4202-9644-c1f5cd95cc2f None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:51.455226 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07f826-2990-4202-9644-c1f5cd95cc2f None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:51.455502 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07f826-2990-4202-9644-c1f5cd95cc2f None admin] PATH_INFO: `/v3/users/257ed1ac5caa4bb7a25eb096166739f2` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:51.456741 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07f826-2990-4202-9644-c1f5cd95cc2f None admin] RBAC: Authorizing `identity:get_user(user_id=257ed1ac5caa4bb7a25eb096166739f2)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:51.458693 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07f826-2990-4202-9644-c1f5cd95cc2f None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:51.460272 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 583/1158] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:08:51 2022] GET /identity/v3/users/257ed1ac5caa4bb7a25eb096166739f2 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:51.466037 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bacd03e-ed0e-4427-b0ae-e3eeaccd9a6b None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:51.565193 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bacd03e-ed0e-4427-b0ae-e3eeaccd9a6b None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:51.600444 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08608c3b-e7b5-49c6-9dc4-71e0e106eeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:51.601047 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08608c3b-e7b5-49c6-9dc4-71e0e106eeaa None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:51.601323 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08608c3b-e7b5-49c6-9dc4-71e0e106eeaa None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:51.601590 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08608c3b-e7b5-49c6-9dc4-71e0e106eeaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:51.605038 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:51.670226 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08608c3b-e7b5-49c6-9dc4-71e0e106eeaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:51.671720 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08608c3b-e7b5-49c6-9dc4-71e0e106eeaa None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:51.770664 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 576/1159] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:08:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 12:08:51.778853 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07f826-2990-4202-9644-c1f5cd95cc2f None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:51.795903 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:51.878070 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07f826-2990-4202-9644-c1f5cd95cc2f None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:51.912134 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ec141-dae1-4b02-875c-c7338657464d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:51.912750 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ec141-dae1-4b02-875c-c7338657464d None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:51.913026 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ec141-dae1-4b02-875c-c7338657464d None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:51.913296 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ec141-dae1-4b02-875c-c7338657464d None admin] PATH_INFO: `/v3/projects/5a8c4cf5a82d4cdfadb477362c9b9afc` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:51.914447 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96ec141-dae1-4b02-875c-c7338657464d None admin] RBAC: Authorizing `identity:get_project(project_id=5a8c4cf5a82d4cdfadb477362c9b9afc)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:51.915994 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96ec141-dae1-4b02-875c-c7338657464d None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:51.917614 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 584/1160] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:08:51 2022] GET /identity/v3/projects/5a8c4cf5a82d4cdfadb477362c9b9afc => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:51.923801 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08608c3b-e7b5-49c6-9dc4-71e0e106eeaa None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:51.958214 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:52.027257 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08608c3b-e7b5-49c6-9dc4-71e0e106eeaa None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:52.061318 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abc7871-13f3-4109-936a-ca375e66ab5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:52.061843 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc7871-13f3-4109-936a-ca375e66ab5e None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:52.062123 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc7871-13f3-4109-936a-ca375e66ab5e None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:52.062417 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abc7871-13f3-4109-936a-ca375e66ab5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:52.063138 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc7871-13f3-4109-936a-ca375e66ab5e None admin] RBAC: Adding query filter params (role.id=72c80b472acb462ebadd86463efe91f7, scope.project.id=5a8c4cf5a82d4cdfadb477362c9b9afc, user.id=257ed1ac5caa4bb7a25eb096166739f2) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:52.063446 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc7871-13f3-4109-936a-ca375e66ab5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:52.064877 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abc7871-13f3-4109-936a-ca375e66ab5e None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:52.071228 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 577/1161] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:08:51 2022] GET /identity/v3/role_assignments?user.id=257ed1ac5caa4bb7a25eb096166739f2&scope.project.id=5a8c4cf5a82d4cdfadb477362c9b9afc&role.id=72c80b472acb462ebadd86463efe91f7 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:54.254923 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554d476-b79a-4e3a-b4f6-b9a51a351f49 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:54.255461 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554d476-b79a-4e3a-b4f6-b9a51a351f49 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:54.255461 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554d476-b79a-4e3a-b4f6-b9a51a351f49 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:54.256891 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 585/1162] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:08:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:08:54.262608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadb22e-4396-444d-8350-b003fd729331 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:54.263028 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadb22e-4396-444d-8350-b003fd729331 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:54.263182 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadb22e-4396-444d-8350-b003fd729331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:54.280836 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-aeadb22e-4396-444d-8350-b003fd729331 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:08:54.282014 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-aeadb22e-4396-444d-8350-b003fd729331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:08:54.345460 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 578/1163] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:08:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:08:54.615909 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f554d476-b79a-4e3a-b4f6-b9a51a351f49 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:54.700577 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:54.720389 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f554d476-b79a-4e3a-b4f6-b9a51a351f49 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:54.753590 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba01c24-b298-471b-8263-c6be53caed00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:54.754186 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba01c24-b298-471b-8263-c6be53caed00 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:54.754499 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba01c24-b298-471b-8263-c6be53caed00 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:54.754773 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba01c24-b298-471b-8263-c6be53caed00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:54.819905 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba01c24-b298-471b-8263-c6be53caed00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:54.821355 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba01c24-b298-471b-8263-c6be53caed00 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:54.900193 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:54.919719 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 586/1164] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:08:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 12:08:54.925738 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeadb22e-4396-444d-8350-b003fd729331 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:54.955847 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:55.031449 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeadb22e-4396-444d-8350-b003fd729331 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:55.064988 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a2e0a-872f-430a-b654-3ef5f2bdb0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:55.065614 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a2e0a-872f-430a-b654-3ef5f2bdb0a7 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:55.066447 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a2e0a-872f-430a-b654-3ef5f2bdb0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:55.066720 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a2e0a-872f-430a-b654-3ef5f2bdb0a7 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:55.073320 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a2e0a-872f-430a-b654-3ef5f2bdb0a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:55.074794 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a2e0a-872f-430a-b654-3ef5f2bdb0a7 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:55.086565 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-e80a2e0a-872f-430a-b654-3ef5f2bdb0a7 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 21 12:08:55.086565 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:55.086565 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 21 12:08:55.086565 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 21 12:08:55.086565 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 12:08:55.086565 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 12:08:55.086565 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 12:08:55.086565 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 12:08:55.086565 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 21 12:08:55.086565 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:08:55.086565 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 12:08:55.086565 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:08:55.086565 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:08:55.086565 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:08:55.086565 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:08:55.086565 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:08:55.086565 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:08:55.087613 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:08:55.087613 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:08:55.087613 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:08:55.087613 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:08:55.087613 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:08:55.087613 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:08:55.087613 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:08:55.087613 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:08:55.087613 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:08:55.087613 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:08:55.087613 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:08:55.087613 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:08:55.087613 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:08:55.087613 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:08:55.087613 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:08:55.087613 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:08:55.088541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:08:55.088541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:08:55.088541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:08:55.088541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:08:55.088541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:08:55.088541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:08:55.088541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:08:55.088541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:08:55.088541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:08:55.088541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:08:55.088541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 21 12:08:55.088541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:08:55.088541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 21 12:08:55.088541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:08:55.088541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 579/1165] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Sep 21 12:08:54 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:08:55.093826 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba01c24-b298-471b-8263-c6be53caed00 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:55.191668 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba01c24-b298-471b-8263-c6be53caed00 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:55.225990 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c2dcc-9040-4f05-8993-72db47d054b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:55.227052 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c2dcc-9040-4f05-8993-72db47d054b8 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:55.227474 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c2dcc-9040-4f05-8993-72db47d054b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:55.228029 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c2dcc-9040-4f05-8993-72db47d054b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:55.228768 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c2dcc-9040-4f05-8993-72db47d054b8 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:08:55.229075 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c2dcc-9040-4f05-8993-72db47d054b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:55.230914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86c2dcc-9040-4f05-8993-72db47d054b8 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:55.239424 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 587/1166] 10.222.0.60 () {56 vars in 1115 bytes} [Wed Sep 21 12:08:55 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:08:57.380132 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28228c45-f767-45e8-97ed-e68cc76ea9b0 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:57.380662 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28228c45-f767-45e8-97ed-e68cc76ea9b0 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:57.380662 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28228c45-f767-45e8-97ed-e68cc76ea9b0 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:57.381999 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 580/1167] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:08:57.387527 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408cd07-c89e-48cf-b79e-1941e9b08e82 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:57.387973 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408cd07-c89e-48cf-b79e-1941e9b08e82 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:57.388076 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408cd07-c89e-48cf-b79e-1941e9b08e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:57.405861 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-b408cd07-c89e-48cf-b79e-1941e9b08e82 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:08:57.407098 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b408cd07-c89e-48cf-b79e-1941e9b08e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:08:57.448464 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:57.472937 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 588/1168] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:08:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 12:08:57.739373 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28228c45-f767-45e8-97ed-e68cc76ea9b0 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:08:57.834442 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:08:57.844936 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28228c45-f767-45e8-97ed-e68cc76ea9b0 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:08:57.879807 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a57f4b4-85ec-4e18-8b06-28d32dca8efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:08:57.880404 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57f4b4-85ec-4e18-8b06-28d32dca8efe None admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:08:57.880686 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57f4b4-85ec-4e18-8b06-28d32dca8efe None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:08:57.880961 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57f4b4-85ec-4e18-8b06-28d32dca8efe None admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:08:57.881621 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a57f4b4-85ec-4e18-8b06-28d32dca8efe None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:08:57.883025 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a57f4b4-85ec-4e18-8b06-28d32dca8efe None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:08:57.899769 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 581/1169] 10.222.0.60 () {60 vars in 1138 bytes} [Wed Sep 21 12:08:57 2022] POST /identity/v3/domains => generated 267 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:09:00.146752 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80772f4-5200-4820-a060-b8a60b6d876a None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:09:00.147311 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80772f4-5200-4820-a060-b8a60b6d876a None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:09:00.147311 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80772f4-5200-4820-a060-b8a60b6d876a None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:09:00.148633 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 589/1170] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:09:00.154112 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a2d64-44b4-4dc6-bc75-3c80248328c8 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:09:00.154529 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a2d64-44b4-4dc6-bc75-3c80248328c8 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:09:00.154700 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a2d64-44b4-4dc6-bc75-3c80248328c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:09:00.172972 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-491a2d64-44b4-4dc6-bc75-3c80248328c8 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:09:00.174172 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-491a2d64-44b4-4dc6-bc75-3c80248328c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:09:00.248049 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 582/1171] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:09:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:09:00.512834 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80772f4-5200-4820-a060-b8a60b6d876a None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:09:00.612761 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80772f4-5200-4820-a060-b8a60b6d876a None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:09:00.645953 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852260a-217a-4c20-8d7e-5077634d5a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:09:00.646595 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852260a-217a-4c20-8d7e-5077634d5a33 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:09:00.646880 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852260a-217a-4c20-8d7e-5077634d5a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:09:00.647154 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852260a-217a-4c20-8d7e-5077634d5a33 None admin] PATH_INFO: `/v3/domains/11a216eea8dc403899e5d82bc6924b68` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:09:00.657626 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852260a-217a-4c20-8d7e-5077634d5a33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=11a216eea8dc403899e5d82bc6924b68)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:09:00.659107 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852260a-217a-4c20-8d7e-5077634d5a33 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:09:00.661312 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 590/1172] 10.222.0.60 () {56 vars in 1183 bytes} [Wed Sep 21 12:09:00 2022] GET /identity/v3/domains/11a216eea8dc403899e5d82bc6924b68 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:09:00.667214 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a2d64-44b4-4dc6-bc75-3c80248328c8 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:09:00.745732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:09:00.765481 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a2d64-44b4-4dc6-bc75-3c80248328c8 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:09:00.799698 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616e65f-9540-4ccc-8c35-3c3582cb835c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:09:00.800352 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616e65f-9540-4ccc-8c35-3c3582cb835c None admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:09:00.800632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616e65f-9540-4ccc-8c35-3c3582cb835c None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:09:00.800904 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616e65f-9540-4ccc-8c35-3c3582cb835c None admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:09:00.801560 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616e65f-9540-4ccc-8c35-3c3582cb835c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:09:00.803024 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616e65f-9540-4ccc-8c35-3c3582cb835c None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:09:00.829725 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 583/1173] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Sep 21 12:09:00 2022] POST /identity/v3/projects => generated 361 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:09:03.039388 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43812e2e-6f4b-4124-ae7b-e384ed6d227a None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:09:03.039939 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43812e2e-6f4b-4124-ae7b-e384ed6d227a None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:09:03.039939 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43812e2e-6f4b-4124-ae7b-e384ed6d227a None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:09:03.041263 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 591/1174] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:09:03.046615 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff692b-806a-4a83-9528-b788834597fa None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:09:03.047061 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff692b-806a-4a83-9528-b788834597fa None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:09:03.047153 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff692b-806a-4a83-9528-b788834597fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:09:03.065185 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-b3ff692b-806a-4a83-9528-b788834597fa None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:09:03.066414 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-b3ff692b-806a-4a83-9528-b788834597fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:09:03.133254 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 584/1175] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:09:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:09:03.407168 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43812e2e-6f4b-4124-ae7b-e384ed6d227a None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:09:03.451794 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:09:03.522986 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43812e2e-6f4b-4124-ae7b-e384ed6d227a None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:09:03.556745 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39123f4d-dedd-4295-aafa-678c6af4d48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:09:03.557389 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39123f4d-dedd-4295-aafa-678c6af4d48f None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:09:03.557665 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39123f4d-dedd-4295-aafa-678c6af4d48f None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:09:03.557938 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39123f4d-dedd-4295-aafa-678c6af4d48f None admin] PATH_INFO: `/v3/domains/11a216eea8dc403899e5d82bc6924b68` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:09:03.559153 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39123f4d-dedd-4295-aafa-678c6af4d48f None admin] RBAC: Authorizing `identity:get_domain(domain_id=11a216eea8dc403899e5d82bc6924b68)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:09:03.560585 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39123f4d-dedd-4295-aafa-678c6af4d48f None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:09:03.562204 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 592/1176] 10.222.0.60 () {56 vars in 1183 bytes} [Wed Sep 21 12:09:03 2022] GET /identity/v3/domains/11a216eea8dc403899e5d82bc6924b68 => generated 267 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:09:03.568166 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff692b-806a-4a83-9528-b788834597fa None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:09:03.629426 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:09:03.669786 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff692b-806a-4a83-9528-b788834597fa None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:09:03.703341 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed287e-63d8-41d8-b198-cb676dcc961f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:09:03.703945 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed287e-63d8-41d8-b198-cb676dcc961f None admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:09:03.704225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed287e-63d8-41d8-b198-cb676dcc961f None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:09:03.704496 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed287e-63d8-41d8-b198-cb676dcc961f None admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:09:03.705138 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ed287e-63d8-41d8-b198-cb676dcc961f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:09:03.707219 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ed287e-63d8-41d8-b198-cb676dcc961f None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:09:03.729766 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 585/1177] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Sep 21 12:09:03 2022] POST /identity/v3/users => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:09:05.935039 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de225b-88a5-4e48-862e-fc9c13409215 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:09:05.935616 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de225b-88a5-4e48-862e-fc9c13409215 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:09:05.935616 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de225b-88a5-4e48-862e-fc9c13409215 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:09:05.936848 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 593/1178] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:09:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:09:05.943234 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49977df-3aeb-4e36-ac18-3905f646ed60 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:09:05.943729 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49977df-3aeb-4e36-ac18-3905f646ed60 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:09:05.943821 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49977df-3aeb-4e36-ac18-3905f646ed60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:09:05.962475 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-f49977df-3aeb-4e36-ac18-3905f646ed60 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:09:05.963773 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-f49977df-3aeb-4e36-ac18-3905f646ed60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:09:06.034633 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 586/1179] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:09:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:09:06.331951 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de225b-88a5-4e48-862e-fc9c13409215 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:09:06.469879 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de225b-88a5-4e48-862e-fc9c13409215 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:09:06.474078 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:09:06.507534 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7ea74-1625-48d5-a45d-5cf4d054d531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:09:06.508158 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7ea74-1625-48d5-a45d-5cf4d054d531 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:09:06.508436 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7ea74-1625-48d5-a45d-5cf4d054d531 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:09:06.508736 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7ea74-1625-48d5-a45d-5cf4d054d531 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:09:06.520050 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7ea74-1625-48d5-a45d-5cf4d054d531 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:09:06.524811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-23e7ea74-1625-48d5-a45d-5cf4d054d531 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:09:06.524811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:09:06.524811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:09:06.524811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:09:06.524811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:09:06.524811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:09:06.524811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:09:06.524811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:09:06.524811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:09:06.524811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:09:06.524811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:09:06.524811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:09:06.524811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:09:06.524811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:09:06.524811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:09:06.524811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:09:06.525778 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:09:06.525778 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:09:06.525778 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:09:06.525778 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:09:06.525778 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:09:06.525778 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:09:06.525778 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:09:06.525778 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:09:06.525778 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:09:06.525778 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:09:06.525778 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:09:06.525778 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:09:06.525778 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:09:06.525778 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:09:06.525778 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:09:06.525778 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:09:06.526759 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:09:06.526759 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:09:06.526759 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:09:06.526759 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:09:06.526759 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:09:06.526759 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:09:06.526759 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:09:06.526759 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:09:06.526759 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:09:06.526759 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:09:06.526759 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:09:06.526759 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:09:06.526759 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 594/1180] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Sep 21 12:09:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 12:09:06.532042 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49977df-3aeb-4e36-ac18-3905f646ed60 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:09:06.584230 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:09:06.637863 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49977df-3aeb-4e36-ac18-3905f646ed60 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:09:06.671822 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d48c4-1f50-4b91-852e-09fce5d660f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:09:06.672428 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d48c4-1f50-4b91-852e-09fce5d660f7 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:09:06.672707 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d48c4-1f50-4b91-852e-09fce5d660f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:09:06.672976 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d48c4-1f50-4b91-852e-09fce5d660f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:09:06.673645 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d48c4-1f50-4b91-852e-09fce5d660f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:09:06.673957 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d48c4-1f50-4b91-852e-09fce5d660f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:09:06.675870 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d48c4-1f50-4b91-852e-09fce5d660f7 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:09:06.684031 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 587/1181] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:09:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:09:06.690105 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7ea74-1625-48d5-a45d-5cf4d054d531 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:09:06.788904 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7ea74-1625-48d5-a45d-5cf4d054d531 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:09:06.823158 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629215b-7689-4931-9b4a-c5ee58839016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:09:06.823778 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629215b-7689-4931-9b4a-c5ee58839016 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:09:06.824059 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629215b-7689-4931-9b4a-c5ee58839016 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:09:06.824349 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629215b-7689-4931-9b4a-c5ee58839016 None admin] PATH_INFO: `/v3/users/bde2b4f1ed1242ceb7d2e6dd2f153f60` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:09:06.837415 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629215b-7689-4931-9b4a-c5ee58839016 None admin] RBAC: Authorizing `identity:get_user(user_id=bde2b4f1ed1242ceb7d2e6dd2f153f60)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:09:06.838828 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629215b-7689-4931-9b4a-c5ee58839016 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:09:06.840445 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 595/1182] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:09:06 2022] GET /identity/v3/users/bde2b4f1ed1242ceb7d2e6dd2f153f60 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:09:06.846351 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d48c4-1f50-4b91-852e-09fce5d660f7 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:09:06.971123 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d48c4-1f50-4b91-852e-09fce5d660f7 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:09:06.982254 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:09:07.006272 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98cf08-38b3-4801-8aa0-5e0436fd6903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:09:07.006908 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98cf08-38b3-4801-8aa0-5e0436fd6903 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:09:07.007184 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98cf08-38b3-4801-8aa0-5e0436fd6903 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:09:07.007450 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98cf08-38b3-4801-8aa0-5e0436fd6903 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:09:07.075525 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98cf08-38b3-4801-8aa0-5e0436fd6903 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:09:07.077486 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98cf08-38b3-4801-8aa0-5e0436fd6903 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:09:07.176998 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 588/1183] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:09:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 12:09:07.183091 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629215b-7689-4931-9b4a-c5ee58839016 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:09:07.208864 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:09:07.285403 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629215b-7689-4931-9b4a-c5ee58839016 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:09:07.319988 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994f409-9db1-40f3-84d7-3db1d44f3f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:09:07.320611 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994f409-9db1-40f3-84d7-3db1d44f3f45 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:09:07.320885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994f409-9db1-40f3-84d7-3db1d44f3f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:09:07.321198 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994f409-9db1-40f3-84d7-3db1d44f3f45 None admin] PATH_INFO: `/v3/projects/0be85cfb334e44a6bacaa2ec357a0ca1` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:09:07.322642 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9994f409-9db1-40f3-84d7-3db1d44f3f45 None admin] RBAC: Authorizing `identity:get_project(project_id=0be85cfb334e44a6bacaa2ec357a0ca1)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:09:07.324164 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9994f409-9db1-40f3-84d7-3db1d44f3f45 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:09:07.325777 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 596/1184] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:09:07 2022] GET /identity/v3/projects/0be85cfb334e44a6bacaa2ec357a0ca1 => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:09:07.332084 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98cf08-38b3-4801-8aa0-5e0436fd6903 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:09:07.344242 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:09:07.436156 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98cf08-38b3-4801-8aa0-5e0436fd6903 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:09:07.471900 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51de66-539d-4d4f-a25b-de3610be36e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:09:07.472503 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51de66-539d-4d4f-a25b-de3610be36e2 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:09:07.472785 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51de66-539d-4d4f-a25b-de3610be36e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:09:07.473063 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51de66-539d-4d4f-a25b-de3610be36e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:09:07.473776 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a51de66-539d-4d4f-a25b-de3610be36e2 None admin] RBAC: Adding query filter params (role.id=72c80b472acb462ebadd86463efe91f7, scope.project.id=0be85cfb334e44a6bacaa2ec357a0ca1, user.id=bde2b4f1ed1242ceb7d2e6dd2f153f60) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:09:07.474084 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a51de66-539d-4d4f-a25b-de3610be36e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:09:07.475553 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a51de66-539d-4d4f-a25b-de3610be36e2 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:09:07.481227 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 589/1185] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:09:07 2022] GET /identity/v3/role_assignments?user.id=bde2b4f1ed1242ceb7d2e6dd2f153f60&scope.project.id=0be85cfb334e44a6bacaa2ec357a0ca1&role.id=72c80b472acb462ebadd86463efe91f7 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:09:09.710693 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6d875-b7ea-43cb-b390-9ac201fe6591 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:09:09.711225 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6d875-b7ea-43cb-b390-9ac201fe6591 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:09:09.711225 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6d875-b7ea-43cb-b390-9ac201fe6591 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:09:09.712580 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 597/1186] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:09:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:09:09.717920 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974dd97f-d3f8-4013-bbb7-115bea23e1cc None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:09:09.718344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974dd97f-d3f8-4013-bbb7-115bea23e1cc None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:09:09.718509 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974dd97f-d3f8-4013-bbb7-115bea23e1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:09:09.736622 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-974dd97f-d3f8-4013-bbb7-115bea23e1cc None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:09:09.738353 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-974dd97f-d3f8-4013-bbb7-115bea23e1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:09:09.805615 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 590/1187] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:09:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:09:10.074951 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6d875-b7ea-43cb-b390-9ac201fe6591 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:09:10.168181 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:09:10.179959 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6d875-b7ea-43cb-b390-9ac201fe6591 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:09:10.215902 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643dca3-12fc-40a5-8d03-1f1b00221742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:09:10.216527 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643dca3-12fc-40a5-8d03-1f1b00221742 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:09:10.216803 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643dca3-12fc-40a5-8d03-1f1b00221742 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:09:10.217069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c643dca3-12fc-40a5-8d03-1f1b00221742 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:09:10.226973 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c643dca3-12fc-40a5-8d03-1f1b00221742 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:09:10.231697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-c643dca3-12fc-40a5-8d03-1f1b00221742 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:09:10.231697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:09:10.231697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:09:10.231697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:09:10.231697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:09:10.231697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:09:10.231697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:09:10.231697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:09:10.231697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:09:10.231697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:09:10.231697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:09:10.231697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:09:10.231697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:09:10.231697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:09:10.231697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:09:10.231697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:09:10.232803 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:09:10.232803 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:09:10.232803 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:09:10.232803 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:09:10.232803 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:09:10.232803 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:09:10.232803 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:09:10.232803 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:09:10.232803 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:09:10.232803 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:09:10.232803 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:09:10.232803 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:09:10.232803 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:09:10.232803 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:09:10.232803 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:09:10.232803 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:09:10.233696 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:09:10.233696 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:09:10.233696 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:09:10.233696 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:09:10.233696 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:09:10.233696 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:09:10.233696 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:09:10.233696 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:09:10.233696 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:09:10.233696 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:09:10.233696 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:09:10.233696 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:09:10.233696 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 598/1188] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Sep 21 12:09:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:09:10.238971 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974dd97f-d3f8-4013-bbb7-115bea23e1cc None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:09:10.242038 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:09:10.336438 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974dd97f-d3f8-4013-bbb7-115bea23e1cc None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:09:10.370038 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e08b39-54f0-4c43-881d-b5ba0ee5843b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:09:10.370662 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e08b39-54f0-4c43-881d-b5ba0ee5843b None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:09:10.370941 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e08b39-54f0-4c43-881d-b5ba0ee5843b None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:09:10.371212 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e08b39-54f0-4c43-881d-b5ba0ee5843b None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:09:10.371870 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e08b39-54f0-4c43-881d-b5ba0ee5843b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:09:10.372173 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e08b39-54f0-4c43-881d-b5ba0ee5843b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:09:10.373554 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e08b39-54f0-4c43-881d-b5ba0ee5843b None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:09:10.384417 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 591/1189] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:09:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:09:10.390964 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643dca3-12fc-40a5-8d03-1f1b00221742 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:09:10.498962 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c643dca3-12fc-40a5-8d03-1f1b00221742 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:09:10.534408 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53bc2b-756f-4dd0-8a7a-625fb68b7a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:09:10.535032 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53bc2b-756f-4dd0-8a7a-625fb68b7a2f None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:09:10.535313 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53bc2b-756f-4dd0-8a7a-625fb68b7a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:09:10.535586 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53bc2b-756f-4dd0-8a7a-625fb68b7a2f None admin] PATH_INFO: `/v3/users/bde2b4f1ed1242ceb7d2e6dd2f153f60` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:09:10.536703 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa53bc2b-756f-4dd0-8a7a-625fb68b7a2f None admin] RBAC: Authorizing `identity:get_user(user_id=bde2b4f1ed1242ceb7d2e6dd2f153f60)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:09:10.538124 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa53bc2b-756f-4dd0-8a7a-625fb68b7a2f None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:09:10.539728 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 599/1190] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:09:10 2022] GET /identity/v3/users/bde2b4f1ed1242ceb7d2e6dd2f153f60 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:09:10.545579 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e08b39-54f0-4c43-881d-b5ba0ee5843b None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:09:10.612285 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:09:10.647546 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e08b39-54f0-4c43-881d-b5ba0ee5843b None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:09:10.682718 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e764e-ca57-4bcf-b18a-1021e06d5801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:09:10.683342 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e764e-ca57-4bcf-b18a-1021e06d5801 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:09:10.683678 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e764e-ca57-4bcf-b18a-1021e06d5801 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:09:10.683956 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e764e-ca57-4bcf-b18a-1021e06d5801 None admin] PATH_INFO: `/v3/projects/0be85cfb334e44a6bacaa2ec357a0ca1` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:09:10.685138 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e764e-ca57-4bcf-b18a-1021e06d5801 None admin] RBAC: Authorizing `identity:get_project(project_id=0be85cfb334e44a6bacaa2ec357a0ca1)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:09:10.686598 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e764e-ca57-4bcf-b18a-1021e06d5801 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:09:10.688236 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 592/1191] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:09:10 2022] GET /identity/v3/projects/0be85cfb334e44a6bacaa2ec357a0ca1 => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:09:10.694754 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53bc2b-756f-4dd0-8a7a-625fb68b7a2f None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:09:10.715041 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:09:10.794225 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53bc2b-756f-4dd0-8a7a-625fb68b7a2f None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:09:10.826590 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee716fa-82e0-4eda-942b-c5b5e316450f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:09:10.827232 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee716fa-82e0-4eda-942b-c5b5e316450f None admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:09:10.827510 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee716fa-82e0-4eda-942b-c5b5e316450f None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:09:10.827783 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee716fa-82e0-4eda-942b-c5b5e316450f None admin] PATH_INFO: `/v3/projects/0be85cfb334e44a6bacaa2ec357a0ca1/users/bde2b4f1ed1242ceb7d2e6dd2f153f60/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:09:10.829656 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee716fa-82e0-4eda-942b-c5b5e316450f None admin] RBAC: Authorizing `identity:create_grant(project_id=0be85cfb334e44a6bacaa2ec357a0ca1, user_id=bde2b4f1ed1242ceb7d2e6dd2f153f60, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:09:10.831685 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee716fa-82e0-4eda-942b-c5b5e316450f None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:09:10.843911 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 600/1192] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Sep 21 12:09:10 2022] PUT /identity/v3/projects/0be85cfb334e44a6bacaa2ec357a0ca1/users/bde2b4f1ed1242ceb7d2e6dd2f153f60/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:09:13.004002 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569897d-729a-4b9e-9349-63388e2c446f None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:09:13.004550 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569897d-729a-4b9e-9349-63388e2c446f None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:09:13.004550 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569897d-729a-4b9e-9349-63388e2c446f None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:09:13.005830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 593/1193] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:09:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:09:13.012322 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16814b0c-8835-44ad-9dd7-d9b3187ab51a None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:09:13.013089 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16814b0c-8835-44ad-9dd7-d9b3187ab51a None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:09:13.013089 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16814b0c-8835-44ad-9dd7-d9b3187ab51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:09:13.033445 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-16814b0c-8835-44ad-9dd7-d9b3187ab51a None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:09:13.035212 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-16814b0c-8835-44ad-9dd7-d9b3187ab51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:09:13.114816 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 601/1194] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:09:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 12:09:13.397350 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569897d-729a-4b9e-9349-63388e2c446f None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:09:13.507111 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569897d-729a-4b9e-9349-63388e2c446f None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:09:13.543445 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a980b-065b-45c0-8f9b-c4b90c6f51c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:09:13.544132 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a980b-065b-45c0-8f9b-c4b90c6f51c4 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:09:13.544459 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a980b-065b-45c0-8f9b-c4b90c6f51c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:09:13.544781 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a980b-065b-45c0-8f9b-c4b90c6f51c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:09:13.546882 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:09:13.560444 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a980b-065b-45c0-8f9b-c4b90c6f51c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:09:13.566127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-067a980b-065b-45c0-8f9b-c4b90c6f51c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:09:13.566127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:09:13.566127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:09:13.566127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:09:13.566127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:09:13.566127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:09:13.566127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:09:13.566127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:09:13.566127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:09:13.566127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:09:13.566127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:09:13.566127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:09:13.566127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:09:13.566127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:09:13.566127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:09:13.566127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:09:13.567755 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:09:13.567755 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:09:13.567755 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:09:13.567755 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:09:13.567755 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:09:13.567755 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:09:13.567755 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:09:13.567755 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:09:13.567755 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:09:13.567755 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:09:13.567755 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:09:13.567755 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:09:13.567755 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:09:13.567755 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:09:13.567755 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:09:13.567755 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:09:13.568601 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:09:13.568601 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:09:13.568601 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:09:13.568601 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:09:13.568601 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:09:13.568601 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:09:13.568601 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:09:13.568601 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:09:13.568601 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:09:13.568601 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:09:13.568601 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:09:13.568601 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:09:13.568601 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 594/1195] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Sep 21 12:09:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 12:09:13.574756 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16814b0c-8835-44ad-9dd7-d9b3187ab51a None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:09:13.586458 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:09:13.692710 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16814b0c-8835-44ad-9dd7-d9b3187ab51a None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:09:13.731029 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148fe66f-62af-4bcf-b5f8-3c4f8ffde120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:09:13.731700 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fe66f-62af-4bcf-b5f8-3c4f8ffde120 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:09:13.732028 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fe66f-62af-4bcf-b5f8-3c4f8ffde120 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:09:13.732348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fe66f-62af-4bcf-b5f8-3c4f8ffde120 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:09:13.733056 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148fe66f-62af-4bcf-b5f8-3c4f8ffde120 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:09:13.733414 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148fe66f-62af-4bcf-b5f8-3c4f8ffde120 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:09:13.734890 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148fe66f-62af-4bcf-b5f8-3c4f8ffde120 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:09:13.744070 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 602/1196] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:09:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:09:13.753711 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a980b-065b-45c0-8f9b-c4b90c6f51c4 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:09:13.867881 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a980b-065b-45c0-8f9b-c4b90c6f51c4 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:09:13.911412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948340f-2354-4ae2-9d26-bf4afde82a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:09:13.912060 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948340f-2354-4ae2-9d26-bf4afde82a49 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:09:13.912345 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948340f-2354-4ae2-9d26-bf4afde82a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:09:13.912622 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948340f-2354-4ae2-9d26-bf4afde82a49 None admin] PATH_INFO: `/v3/users/bde2b4f1ed1242ceb7d2e6dd2f153f60` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:09:13.913817 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3948340f-2354-4ae2-9d26-bf4afde82a49 None admin] RBAC: Authorizing `identity:get_user(user_id=bde2b4f1ed1242ceb7d2e6dd2f153f60)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:09:13.915302 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3948340f-2354-4ae2-9d26-bf4afde82a49 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:09:13.916949 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 595/1197] 10.222.0.60 () {56 vars in 1177 bytes} [Wed Sep 21 12:09:13 2022] GET /identity/v3/users/bde2b4f1ed1242ceb7d2e6dd2f153f60 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:09:13.926008 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148fe66f-62af-4bcf-b5f8-3c4f8ffde120 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:09:14.000199 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:09:14.057740 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148fe66f-62af-4bcf-b5f8-3c4f8ffde120 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:09:14.116021 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d1b0f-b99f-477e-94ff-1163dc296fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:09:14.117022 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d1b0f-b99f-477e-94ff-1163dc296fe8 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:09:14.117508 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d1b0f-b99f-477e-94ff-1163dc296fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:09:14.117982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d1b0f-b99f-477e-94ff-1163dc296fe8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:09:14.237553 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d1b0f-b99f-477e-94ff-1163dc296fe8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:09:14.240263 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d1b0f-b99f-477e-94ff-1163dc296fe8 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:09:14.358040 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:09:14.414006 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 603/1198] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:09:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 21 12:09:14.420131 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948340f-2354-4ae2-9d26-bf4afde82a49 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:09:14.489469 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:09:14.532850 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948340f-2354-4ae2-9d26-bf4afde82a49 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:09:14.576724 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd71f26b-32ff-4e24-a302-4198f14f68ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:09:14.577592 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71f26b-32ff-4e24-a302-4198f14f68ec None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:09:14.577826 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71f26b-32ff-4e24-a302-4198f14f68ec None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:09:14.578140 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71f26b-32ff-4e24-a302-4198f14f68ec None admin] PATH_INFO: `/v3/projects/0be85cfb334e44a6bacaa2ec357a0ca1` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:09:14.579467 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd71f26b-32ff-4e24-a302-4198f14f68ec None admin] RBAC: Authorizing `identity:get_project(project_id=0be85cfb334e44a6bacaa2ec357a0ca1)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:09:14.581097 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd71f26b-32ff-4e24-a302-4198f14f68ec None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:09:14.582876 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 596/1199] 10.222.0.60 () {56 vars in 1186 bytes} [Wed Sep 21 12:09:14 2022] GET /identity/v3/projects/0be85cfb334e44a6bacaa2ec357a0ca1 => generated 361 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:09:14.589248 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d1b0f-b99f-477e-94ff-1163dc296fe8 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:09:14.699028 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d1b0f-b99f-477e-94ff-1163dc296fe8 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:09:14.735994 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a91ee5-5027-4118-b9ea-93a126da5e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:09:14.736592 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a91ee5-5027-4118-b9ea-93a126da5e36 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:09:14.736873 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a91ee5-5027-4118-b9ea-93a126da5e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:09:14.737795 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a91ee5-5027-4118-b9ea-93a126da5e36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:09:14.738556 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a91ee5-5027-4118-b9ea-93a126da5e36 None admin] RBAC: Adding query filter params (role.id=72c80b472acb462ebadd86463efe91f7, scope.project.id=0be85cfb334e44a6bacaa2ec357a0ca1, user.id=bde2b4f1ed1242ceb7d2e6dd2f153f60) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:09:14.738865 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a91ee5-5027-4118-b9ea-93a126da5e36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:09:14.740306 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a91ee5-5027-4118-b9ea-93a126da5e36 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:09:14.746508 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 604/1200] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:09:14 2022] GET /identity/v3/role_assignments?user.id=bde2b4f1ed1242ceb7d2e6dd2f153f60&scope.project.id=0be85cfb334e44a6bacaa2ec357a0ca1&role.id=72c80b472acb462ebadd86463efe91f7 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:09:24.570747 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=35 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:09:24.743869 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=83 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:17.857948 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7439c-19e5-400f-9820-b4235f20b8ce None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:17.858832 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7439c-19e5-400f-9820-b4235f20b8ce None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:17.858832 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7439c-19e5-400f-9820-b4235f20b8ce None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:17.860106 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 597/1201] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:10:17.866229 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20f28d-0746-4487-9b89-a02679f37d63 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:17.867075 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20f28d-0746-4487-9b89-a02679f37d63 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:17.867075 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20f28d-0746-4487-9b89-a02679f37d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:17.892294 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-2c20f28d-0746-4487-9b89-a02679f37d63 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:10:17.893609 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2c20f28d-0746-4487-9b89-a02679f37d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:10:18.035477 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 605/1202] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:10:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:10:18.408409 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7439c-19e5-400f-9820-b4235f20b8ce None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:18.652218 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7439c-19e5-400f-9820-b4235f20b8ce None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:18.721450 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e90e87-c9b8-458e-89c6-6098d1a25381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:18.722947 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e90e87-c9b8-458e-89c6-6098d1a25381 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:18.723687 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e90e87-c9b8-458e-89c6-6098d1a25381 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:18.724367 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e90e87-c9b8-458e-89c6-6098d1a25381 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:18.746599 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e90e87-c9b8-458e-89c6-6098d1a25381 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:18.749357 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e90e87-c9b8-458e-89c6-6098d1a25381 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:18.780065 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-52e90e87-c9b8-458e-89c6-6098d1a25381 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:10:18.780065 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:10:18.780065 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:10:18.780065 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:10:18.780065 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:10:18.780065 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:10:18.780065 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:10:18.780065 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:10:18.780065 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:10:18.780065 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:10:18.780065 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:10:18.780065 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:10:18.780065 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:10:18.780065 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:10:18.780065 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:10:18.780065 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:10:18.781870 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:10:18.781870 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:10:18.781870 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:10:18.781870 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:10:18.781870 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:10:18.781870 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:10:18.781870 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:10:18.781870 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:10:18.781870 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:10:18.781870 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:10:18.781870 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:10:18.781870 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:10:18.781870 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:10:18.781870 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:10:18.781870 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:10:18.781870 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:10:18.781870 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:10:18.783570 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:10:18.783570 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:10:18.783570 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:10:18.783570 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 598/1203] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:10:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:10:18.792893 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20f28d-0746-4487-9b89-a02679f37d63 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:19.021065 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20f28d-0746-4487-9b89-a02679f37d63 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:19.105012 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:19.116133 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e1a10-809d-4cc1-9e5a-cf21f0da4b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:19.116854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e1a10-809d-4cc1-9e5a-cf21f0da4b0c None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:19.117069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e1a10-809d-4cc1-9e5a-cf21f0da4b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:19.117341 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e1a10-809d-4cc1-9e5a-cf21f0da4b0c None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:19.118012 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e1a10-809d-4cc1-9e5a-cf21f0da4b0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:10:19.118392 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e1a10-809d-4cc1-9e5a-cf21f0da4b0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:19.120030 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e1a10-809d-4cc1-9e5a-cf21f0da4b0c None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:19.147429 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 606/1204] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:10:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:10:19.151093 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e90e87-c9b8-458e-89c6-6098d1a25381 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:19.282171 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:19.404629 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e90e87-c9b8-458e-89c6-6098d1a25381 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:19.495943 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca6eb4-8a06-4c95-9267-a28122ddd453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:19.497277 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca6eb4-8a06-4c95-9267-a28122ddd453 None admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:19.497831 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca6eb4-8a06-4c95-9267-a28122ddd453 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:19.498475 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca6eb4-8a06-4c95-9267-a28122ddd453 None admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:19.499884 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca6eb4-8a06-4c95-9267-a28122ddd453 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:19.504141 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca6eb4-8a06-4c95-9267-a28122ddd453 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:19.565912 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 599/1205] 10.222.0.60 () {60 vars in 1132 bytes} [Wed Sep 21 12:10:19 2022] POST /identity/v3/users => generated 251 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:10:22.492649 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fccb2-a8d9-4696-9065-b414a59b475c None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:22.493316 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fccb2-a8d9-4696-9065-b414a59b475c None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:22.493316 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fccb2-a8d9-4696-9065-b414a59b475c None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:22.494856 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 607/1206] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:10:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:10:22.501660 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf8503-1aa5-4b1c-baf5-f4c0627acd34 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:22.502529 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf8503-1aa5-4b1c-baf5-f4c0627acd34 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:22.502529 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf8503-1aa5-4b1c-baf5-f4c0627acd34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:22.527570 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-54bf8503-1aa5-4b1c-baf5-f4c0627acd34 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:10:22.528831 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-54bf8503-1aa5-4b1c-baf5-f4c0627acd34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:10:22.634061 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 600/1207] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:10:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 12:10:22.945016 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63fccb2-a8d9-4696-9065-b414a59b475c None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:23.110247 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63fccb2-a8d9-4696-9065-b414a59b475c None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:23.177165 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b243c-d570-4c44-8154-8f6dbe18a0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:23.178323 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b243c-d570-4c44-8154-8f6dbe18a0c3 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:23.178920 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b243c-d570-4c44-8154-8f6dbe18a0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:23.179349 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b243c-d570-4c44-8154-8f6dbe18a0c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:23.200945 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b243c-d570-4c44-8154-8f6dbe18a0c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:10:23.208365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-435b243c-d570-4c44-8154-8f6dbe18a0c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 12:10:23.208365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:10:23.208365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:10:23.208365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:10:23.208365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:10:23.208365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:10:23.208365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:10:23.208365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:10:23.208365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:10:23.208365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:10:23.208365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:10:23.208365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:10:23.208365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:10:23.208365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:10:23.208365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:10:23.208365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:10:23.210462 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:10:23.210462 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:10:23.210462 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:10:23.210462 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:10:23.210462 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:10:23.210462 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:10:23.210462 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:10:23.210462 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:10:23.210462 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:10:23.210462 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:10:23.210462 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:10:23.210462 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:10:23.210462 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:10:23.210462 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:10:23.210462 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:10:23.210462 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:10:23.211348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:10:23.211348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:10:23.211348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:10:23.211348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:10:23.211348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:10:23.211348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:10:23.211348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:10:23.211348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:10:23.211348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:10:23.211348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:10:23.211348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 12:10:23.211348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:10:23.211348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 608/1208] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Sep 21 12:10:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 12:10:23.221576 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf8503-1aa5-4b1c-baf5-f4c0627acd34 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:23.315876 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:23.457718 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf8503-1aa5-4b1c-baf5-f4c0627acd34 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:23.514333 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b158400-1577-4902-8efb-0bf1e8e7ad69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:23.515435 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b158400-1577-4902-8efb-0bf1e8e7ad69 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:23.515435 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b158400-1577-4902-8efb-0bf1e8e7ad69 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:23.515724 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b158400-1577-4902-8efb-0bf1e8e7ad69 None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:23.516390 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b158400-1577-4902-8efb-0bf1e8e7ad69 None admin] RBAC: Adding query filter params (name=service) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:10:23.516637 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b158400-1577-4902-8efb-0bf1e8e7ad69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:23.517902 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b158400-1577-4902-8efb-0bf1e8e7ad69 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:23.536422 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 601/1209] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Sep 21 12:10:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:10:23.538005 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b243c-d570-4c44-8154-8f6dbe18a0c3 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:23.625451 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:23.734883 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b243c-d570-4c44-8154-8f6dbe18a0c3 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:23.796319 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8835b8-af30-49d9-9ce6-630d658aec76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:23.797304 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8835b8-af30-49d9-9ce6-630d658aec76 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:23.798266 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8835b8-af30-49d9-9ce6-630d658aec76 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:23.798721 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8835b8-af30-49d9-9ce6-630d658aec76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:23.816801 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8835b8-af30-49d9-9ce6-630d658aec76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:23.819886 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8835b8-af30-49d9-9ce6-630d658aec76 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:23.850914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-8a8835b8-af30-49d9-9ce6-630d658aec76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:10:23.850914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:10:23.850914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:10:23.850914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:10:23.850914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:10:23.850914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:10:23.850914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:10:23.850914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:10:23.850914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:10:23.850914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:10:23.850914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:10:23.850914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:10:23.850914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:10:23.850914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:10:23.850914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:10:23.850914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:10:23.852222 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:10:23.852222 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:10:23.852222 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:10:23.852222 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:10:23.852222 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:10:23.852222 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:10:23.852222 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:10:23.852222 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:10:23.852222 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:10:23.852222 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:10:23.852222 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:10:23.852222 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:10:23.852222 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:10:23.852222 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:10:23.852222 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:10:23.852222 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:10:23.852222 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:10:23.853330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:10:23.853330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:10:23.853330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:10:23.853330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 609/1210] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:10:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 12:10:23.863368 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b158400-1577-4902-8efb-0bf1e8e7ad69 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:24.060822 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:24.066695 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b158400-1577-4902-8efb-0bf1e8e7ad69 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:24.133165 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82810819-21a0-4c4b-a1ea-ba8414ceead0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:24.134347 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82810819-21a0-4c4b-a1ea-ba8414ceead0 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:24.134832 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82810819-21a0-4c4b-a1ea-ba8414ceead0 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:24.135338 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82810819-21a0-4c4b-a1ea-ba8414ceead0 None admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:24.136249 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82810819-21a0-4c4b-a1ea-ba8414ceead0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:10:24.136678 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82810819-21a0-4c4b-a1ea-ba8414ceead0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:24.138634 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82810819-21a0-4c4b-a1ea-ba8414ceead0 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:24.166420 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 602/1211] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:10:24.171957 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8835b8-af30-49d9-9ce6-630d658aec76 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:24.374515 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8835b8-af30-49d9-9ce6-630d658aec76 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:24.377327 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:24.445117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574bfc5-4f68-4142-ad0a-c05238d03083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:24.445680 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574bfc5-4f68-4142-ad0a-c05238d03083 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:24.446208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574bfc5-4f68-4142-ad0a-c05238d03083 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:24.446766 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574bfc5-4f68-4142-ad0a-c05238d03083 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:24.458104 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6574bfc5-4f68-4142-ad0a-c05238d03083 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:24.460158 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6574bfc5-4f68-4142-ad0a-c05238d03083 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:24.480712 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-6574bfc5-4f68-4142-ad0a-c05238d03083 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 21 12:10:24.480712 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:10:24.480712 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:10:24.480712 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:10:24.480712 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:10:24.480712 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:10:24.480712 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:10:24.480712 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:10:24.480712 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:10:24.480712 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:10:24.480712 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:10:24.480712 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:10:24.480712 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 12:10:24.480712 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 12:10:24.480712 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 12:10:24.480712 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 12:10:24.486721 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:10:24.486721 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:10:24.486721 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 12:10:24.486721 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:10:24.486721 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 12:10:24.486721 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:10:24.486721 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:10:24.486721 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:10:24.486721 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:10:24.486721 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:10:24.486721 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:10:24.486721 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:10:24.486721 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:10:24.486721 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:10:24.486721 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:10:24.486721 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:10:24.486721 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:10:24.486721 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:10:24.488674 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:10:24.488674 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:10:24.488674 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 12:10:24.488674 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 12:10:24.488674 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 12:10:24.488674 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 12:10:24.488674 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 12:10:24.488674 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 12:10:24.488674 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 21 12:10:24.488674 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:10:24.488674 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 610/1212] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:10:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:10:24.492176 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82810819-21a0-4c4b-a1ea-ba8414ceead0 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:24.683304 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82810819-21a0-4c4b-a1ea-ba8414ceead0 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:24.752503 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1173f6-9049-462d-9f58-32e52a3e4767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:24.753184 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1173f6-9049-462d-9f58-32e52a3e4767 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:24.753457 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1173f6-9049-462d-9f58-32e52a3e4767 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:24.753764 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1173f6-9049-462d-9f58-32e52a3e4767 None admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:24.754639 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1173f6-9049-462d-9f58-32e52a3e4767 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:10:24.754963 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1173f6-9049-462d-9f58-32e52a3e4767 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:24.756594 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1173f6-9049-462d-9f58-32e52a3e4767 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:24.795475 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 603/1213] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Sep 21 12:10:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:10:24.805475 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574bfc5-4f68-4142-ad0a-c05238d03083 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:24.993053 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574bfc5-4f68-4142-ad0a-c05238d03083 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:25.052664 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afa89d-bccb-4f99-bba7-3b510285bf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:25.053619 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afa89d-bccb-4f99-bba7-3b510285bf64 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:25.054023 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afa89d-bccb-4f99-bba7-3b510285bf64 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:25.054276 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afa89d-bccb-4f99-bba7-3b510285bf64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:25.101320 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:25.162044 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06afa89d-bccb-4f99-bba7-3b510285bf64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:25.164921 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06afa89d-bccb-4f99-bba7-3b510285bf64 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:25.354791 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 611/1214] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:10:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 21 12:10:25.362511 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1173f6-9049-462d-9f58-32e52a3e4767 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:25.388918 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:25.512889 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1173f6-9049-462d-9f58-32e52a3e4767 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:25.559729 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e0886-9d83-4612-83b1-7ff51aaae15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:25.560395 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e0886-9d83-4612-83b1-7ff51aaae15f None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:25.560678 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e0886-9d83-4612-83b1-7ff51aaae15f None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:25.560957 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e0886-9d83-4612-83b1-7ff51aaae15f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:25.574818 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e0886-9d83-4612-83b1-7ff51aaae15f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:25.576372 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e0886-9d83-4612-83b1-7ff51aaae15f None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:25.599043 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-ee4e0886-9d83-4612-83b1-7ff51aaae15f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:10:25.599043 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:10:25.599043 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:10:25.599043 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:10:25.599043 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:10:25.599043 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:10:25.599043 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:10:25.599043 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:10:25.599043 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:10:25.599043 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:10:25.599043 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:10:25.599043 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:10:25.599043 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:10:25.599043 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:10:25.599043 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:10:25.599043 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:10:25.601099 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:10:25.601099 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:10:25.601099 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:10:25.601099 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:10:25.601099 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:10:25.601099 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:10:25.601099 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:10:25.601099 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:10:25.601099 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:10:25.601099 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:10:25.601099 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:10:25.601099 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:10:25.601099 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:10:25.601099 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:10:25.601099 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:10:25.601099 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:10:25.601099 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:10:25.602899 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:10:25.602899 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:10:25.602899 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:10:25.608209 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 604/1215] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:10:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:10:25.616801 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afa89d-bccb-4f99-bba7-3b510285bf64 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:25.712599 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:25.772788 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afa89d-bccb-4f99-bba7-3b510285bf64 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:25.832749 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0a6b9-5fce-4c88-bf19-9290bda3c329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:25.833944 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0a6b9-5fce-4c88-bf19-9290bda3c329 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:25.834286 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0a6b9-5fce-4c88-bf19-9290bda3c329 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:25.834708 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0a6b9-5fce-4c88-bf19-9290bda3c329 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:25.835747 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e0a6b9-5fce-4c88-bf19-9290bda3c329 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:10:25.836257 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e0a6b9-5fce-4c88-bf19-9290bda3c329 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:25.838419 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e0a6b9-5fce-4c88-bf19-9290bda3c329 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:25.856560 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 612/1216] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:10:25.864217 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e0886-9d83-4612-83b1-7ff51aaae15f None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:26.004778 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:26.075233 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e0886-9d83-4612-83b1-7ff51aaae15f None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:26.147096 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552a73d-9fcf-4000-a3d1-feedb8b8c4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:26.148072 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552a73d-9fcf-4000-a3d1-feedb8b8c4e9 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:26.148570 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552a73d-9fcf-4000-a3d1-feedb8b8c4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:26.149049 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552a73d-9fcf-4000-a3d1-feedb8b8c4e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:26.163847 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4552a73d-9fcf-4000-a3d1-feedb8b8c4e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:26.167182 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4552a73d-9fcf-4000-a3d1-feedb8b8c4e9 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:26.192325 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-4552a73d-9fcf-4000-a3d1-feedb8b8c4e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:10:26.192325 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:10:26.192325 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:10:26.192325 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:10:26.192325 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:10:26.192325 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:10:26.192325 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:10:26.192325 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:10:26.192325 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:10:26.192325 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:10:26.192325 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:10:26.192325 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:10:26.192325 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 12:10:26.192325 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 12:10:26.192325 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 12:10:26.194204 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 12:10:26.194204 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:10:26.194204 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:10:26.194204 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:10:26.194204 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:10:26.194204 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:10:26.194204 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:10:26.194204 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:10:26.194204 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:10:26.194204 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:10:26.194204 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:10:26.194204 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:10:26.194204 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:10:26.194204 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:10:26.194204 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:10:26.194204 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:10:26.194204 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:10:26.196032 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 12:10:26.196032 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 12:10:26.196032 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 12:10:26.196032 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 12:10:26.196032 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 12:10:26.196032 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 12:10:26.196032 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:10:26.196032 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:10:26.196032 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 605/1217] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:10:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:10:26.201196 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0a6b9-5fce-4c88-bf19-9290bda3c329 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:26.364902 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0a6b9-5fce-4c88-bf19-9290bda3c329 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:26.410578 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:26.430545 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b19ffeb-a76d-4b71-8e8b-118ff20e2899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:26.431463 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b19ffeb-a76d-4b71-8e8b-118ff20e2899 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:26.431941 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b19ffeb-a76d-4b71-8e8b-118ff20e2899 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:26.432201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b19ffeb-a76d-4b71-8e8b-118ff20e2899 None admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:26.433371 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b19ffeb-a76d-4b71-8e8b-118ff20e2899 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:10:26.433902 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b19ffeb-a76d-4b71-8e8b-118ff20e2899 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:26.436726 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b19ffeb-a76d-4b71-8e8b-118ff20e2899 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:26.471699 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 613/1218] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Sep 21 12:10:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:10:26.475667 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552a73d-9fcf-4000-a3d1-feedb8b8c4e9 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:26.677777 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552a73d-9fcf-4000-a3d1-feedb8b8c4e9 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:26.723829 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:26.731955 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6972b2b-3605-4560-aa7c-5c396d99a416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:26.734477 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6972b2b-3605-4560-aa7c-5c396d99a416 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:26.734477 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6972b2b-3605-4560-aa7c-5c396d99a416 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:26.734477 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6972b2b-3605-4560-aa7c-5c396d99a416 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:26.735092 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6972b2b-3605-4560-aa7c-5c396d99a416 None admin] RBAC: Adding query filter params (role.id=327398b6ec324647b6c4ea84a59a026b, scope.project.id=b0abcc6f2ce14825bfc26e6210889c21, user.id=74e866f134f64644bf33e3adecf207c4) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:10:26.735378 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6972b2b-3605-4560-aa7c-5c396d99a416 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:26.737150 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6972b2b-3605-4560-aa7c-5c396d99a416 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:26.743801 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 606/1219] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:10:26 2022] GET /identity/v3/role_assignments?user.id=74e866f134f64644bf33e3adecf207c4&scope.project.id=b0abcc6f2ce14825bfc26e6210889c21&role.id=327398b6ec324647b6c4ea84a59a026b => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:10:29.633866 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4d3c8-7fd5-47fa-8ace-5535a96aa336 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:29.635100 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4d3c8-7fd5-47fa-8ace-5535a96aa336 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:29.635100 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4d3c8-7fd5-47fa-8ace-5535a96aa336 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:29.636940 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 614/1220] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:10:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:10:29.644357 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613d271-edb5-47dc-ab70-3efa15ce017f None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:29.645065 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613d271-edb5-47dc-ab70-3efa15ce017f None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:29.645065 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613d271-edb5-47dc-ab70-3efa15ce017f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:29.669889 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-5613d271-edb5-47dc-ab70-3efa15ce017f None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:10:29.671269 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-5613d271-edb5-47dc-ab70-3efa15ce017f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:10:29.764111 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 607/1221] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:10:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:10:30.049108 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4d3c8-7fd5-47fa-8ace-5535a96aa336 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:30.243190 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4d3c8-7fd5-47fa-8ace-5535a96aa336 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:30.312772 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c40ad7-0d75-4b0d-881b-3c9b8e6c8208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:30.314143 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c40ad7-0d75-4b0d-881b-3c9b8e6c8208 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:30.314632 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c40ad7-0d75-4b0d-881b-3c9b8e6c8208 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:30.315035 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c40ad7-0d75-4b0d-881b-3c9b8e6c8208 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:30.331705 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c40ad7-0d75-4b0d-881b-3c9b8e6c8208 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:10:30.342209 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-37c40ad7-0d75-4b0d-881b-3c9b8e6c8208 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 12:10:30.342209 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:10:30.342209 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:10:30.342209 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:10:30.342209 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:10:30.342209 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:10:30.342209 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:10:30.342209 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:10:30.342209 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:10:30.342209 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:10:30.342209 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:10:30.342209 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:10:30.342209 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:10:30.342209 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:10:30.342209 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:10:30.342209 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:10:30.344235 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:10:30.344235 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:10:30.344235 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:10:30.344235 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:10:30.344235 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:10:30.344235 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:10:30.344235 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:10:30.344235 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:10:30.344235 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:10:30.344235 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:10:30.344235 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:10:30.344235 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:10:30.344235 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:10:30.344235 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:10:30.344235 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:10:30.344235 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:10:30.346682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:10:30.346682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:10:30.346682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:10:30.346682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:10:30.346682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:10:30.346682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:10:30.346682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:10:30.346682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:10:30.346682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:10:30.346682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:10:30.346682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 12:10:30.346682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:10:30.346682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 615/1222] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Sep 21 12:10:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 12:10:30.356724 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613d271-edb5-47dc-ab70-3efa15ce017f None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:30.532747 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613d271-edb5-47dc-ab70-3efa15ce017f None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:30.566786 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:30.588125 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea20c4-76df-4142-894f-435d107bfbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:30.588929 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea20c4-76df-4142-894f-435d107bfbcc None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:30.589260 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea20c4-76df-4142-894f-435d107bfbcc None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:30.589518 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea20c4-76df-4142-894f-435d107bfbcc None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:30.590354 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea20c4-76df-4142-894f-435d107bfbcc None admin] RBAC: Adding query filter params (name=service) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:10:30.590682 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea20c4-76df-4142-894f-435d107bfbcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:30.592422 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea20c4-76df-4142-894f-435d107bfbcc None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:30.604361 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 608/1223] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Sep 21 12:10:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:10:30.613453 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c40ad7-0d75-4b0d-881b-3c9b8e6c8208 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:30.683684 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:30.782522 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c40ad7-0d75-4b0d-881b-3c9b8e6c8208 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:30.836452 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530fb646-0a40-4313-aa2c-1f3f5e84c03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:30.837237 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530fb646-0a40-4313-aa2c-1f3f5e84c03f None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:30.837640 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530fb646-0a40-4313-aa2c-1f3f5e84c03f None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:30.838052 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530fb646-0a40-4313-aa2c-1f3f5e84c03f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:30.850892 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530fb646-0a40-4313-aa2c-1f3f5e84c03f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:30.852528 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530fb646-0a40-4313-aa2c-1f3f5e84c03f None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:30.871261 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-530fb646-0a40-4313-aa2c-1f3f5e84c03f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:10:30.871261 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:10:30.871261 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:10:30.871261 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:10:30.871261 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:10:30.871261 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:10:30.871261 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:10:30.871261 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:10:30.871261 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:10:30.871261 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:10:30.871261 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:10:30.871261 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:10:30.871261 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:10:30.871261 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:10:30.871261 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:10:30.871261 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:10:30.879361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:10:30.879361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:10:30.879361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:10:30.879361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:10:30.879361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:10:30.879361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:10:30.879361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:10:30.879361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:10:30.879361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:10:30.879361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:10:30.879361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:10:30.879361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:10:30.879361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:10:30.879361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:10:30.879361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:10:30.879361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:10:30.879361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:10:30.881381 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:10:30.881381 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:10:30.881381 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:10:30.881381 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 616/1224] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:10:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:10:30.881777 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea20c4-76df-4142-894f-435d107bfbcc None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:31.054152 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea20c4-76df-4142-894f-435d107bfbcc None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:31.111110 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8aab2a-20ad-47c8-800e-fc3e7e819138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:31.112007 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8aab2a-20ad-47c8-800e-fc3e7e819138 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:31.112458 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8aab2a-20ad-47c8-800e-fc3e7e819138 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:31.112920 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8aab2a-20ad-47c8-800e-fc3e7e819138 None admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:31.114063 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8aab2a-20ad-47c8-800e-fc3e7e819138 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:10:31.114611 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8aab2a-20ad-47c8-800e-fc3e7e819138 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:31.117114 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8aab2a-20ad-47c8-800e-fc3e7e819138 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:31.135340 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 609/1225] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:10:31.145178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530fb646-0a40-4313-aa2c-1f3f5e84c03f None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:31.287854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:31.297624 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530fb646-0a40-4313-aa2c-1f3f5e84c03f None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:31.339330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aaca72-84f7-446d-bfab-f7460b6eeb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:31.340139 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aaca72-84f7-446d-bfab-f7460b6eeb24 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:31.340469 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aaca72-84f7-446d-bfab-f7460b6eeb24 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:31.340763 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aaca72-84f7-446d-bfab-f7460b6eeb24 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:31.350889 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aaca72-84f7-446d-bfab-f7460b6eeb24 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:31.352491 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aaca72-84f7-446d-bfab-f7460b6eeb24 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:31.366388 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-50aaca72-84f7-446d-bfab-f7460b6eeb24 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 21 12:10:31.366388 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:10:31.366388 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:10:31.366388 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:10:31.366388 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:10:31.366388 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:10:31.366388 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:10:31.366388 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:10:31.366388 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:10:31.366388 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:10:31.366388 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:10:31.366388 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:10:31.366388 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 12:10:31.366388 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 12:10:31.366388 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 12:10:31.366388 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 12:10:31.368517 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:10:31.368517 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:10:31.368517 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 12:10:31.368517 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:10:31.368517 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 12:10:31.368517 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:10:31.368517 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:10:31.368517 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:10:31.368517 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:10:31.368517 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:10:31.368517 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:10:31.368517 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:10:31.368517 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:10:31.368517 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:10:31.368517 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:10:31.368517 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:10:31.368517 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:10:31.368517 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:10:31.370853 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:10:31.370853 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:10:31.370853 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 12:10:31.370853 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 12:10:31.370853 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 12:10:31.370853 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 12:10:31.370853 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 12:10:31.370853 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 12:10:31.370853 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 21 12:10:31.370853 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:10:31.370853 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 617/1226] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:10:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:10:31.373829 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8aab2a-20ad-47c8-800e-fc3e7e819138 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:31.452077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:31.548256 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8aab2a-20ad-47c8-800e-fc3e7e819138 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:31.596779 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2c2ab-836a-4726-bc08-f92fd33821c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:31.597413 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2c2ab-836a-4726-bc08-f92fd33821c2 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:31.597702 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2c2ab-836a-4726-bc08-f92fd33821c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:31.597961 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2c2ab-836a-4726-bc08-f92fd33821c2 None admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:31.598743 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2c2ab-836a-4726-bc08-f92fd33821c2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:10:31.599041 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2c2ab-836a-4726-bc08-f92fd33821c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:31.600508 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2c2ab-836a-4726-bc08-f92fd33821c2 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:31.629627 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 610/1227] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Sep 21 12:10:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:10:31.635817 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aaca72-84f7-446d-bfab-f7460b6eeb24 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:31.791290 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aaca72-84f7-446d-bfab-f7460b6eeb24 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:31.839921 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d9482-e99c-49f2-9e68-3e3608e78da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:31.840573 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d9482-e99c-49f2-9e68-3e3608e78da2 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:31.840852 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d9482-e99c-49f2-9e68-3e3608e78da2 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:31.841123 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d9482-e99c-49f2-9e68-3e3608e78da2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:31.855231 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d9482-e99c-49f2-9e68-3e3608e78da2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:31.856864 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d9482-e99c-49f2-9e68-3e3608e78da2 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:31.874499 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-0f6d9482-e99c-49f2-9e68-3e3608e78da2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:10:31.874499 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:10:31.874499 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:10:31.874499 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:10:31.874499 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:10:31.874499 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:10:31.874499 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:10:31.874499 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:10:31.874499 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:10:31.874499 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:10:31.874499 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:10:31.874499 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:10:31.874499 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:10:31.874499 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:10:31.874499 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:10:31.874499 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:10:31.876992 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:10:31.876992 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:10:31.876992 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:10:31.876992 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:10:31.876992 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:10:31.876992 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:10:31.876992 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:10:31.876992 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:10:31.876992 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:10:31.876992 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:10:31.876992 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:10:31.876992 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:10:31.876992 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:10:31.876992 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:10:31.876992 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:10:31.876992 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:10:31.876992 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:10:31.878927 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:10:31.878927 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:10:31.878927 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:10:31.878927 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 618/1228] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:10:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:10:31.886381 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2c2ab-836a-4726-bc08-f92fd33821c2 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:32.016250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2c2ab-836a-4726-bc08-f92fd33821c2 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:32.020887 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:32.072899 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f08ce0-a58c-45ba-b3fd-4dfacb10fa94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:32.074406 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f08ce0-a58c-45ba-b3fd-4dfacb10fa94 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:32.075090 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f08ce0-a58c-45ba-b3fd-4dfacb10fa94 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:32.075593 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f08ce0-a58c-45ba-b3fd-4dfacb10fa94 None admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:32.077408 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f08ce0-a58c-45ba-b3fd-4dfacb10fa94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:10:32.077984 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f08ce0-a58c-45ba-b3fd-4dfacb10fa94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:32.081278 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f08ce0-a58c-45ba-b3fd-4dfacb10fa94 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:32.102626 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 611/1229] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:10:32.112457 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d9482-e99c-49f2-9e68-3e3608e78da2 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:32.124348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:32.303760 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d9482-e99c-49f2-9e68-3e3608e78da2 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:32.347068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de720ec3-31ce-4aca-b449-762e02b86af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:32.347957 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de720ec3-31ce-4aca-b449-762e02b86af0 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:32.348482 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de720ec3-31ce-4aca-b449-762e02b86af0 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:32.348898 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de720ec3-31ce-4aca-b449-762e02b86af0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:32.361031 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de720ec3-31ce-4aca-b449-762e02b86af0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:32.362673 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de720ec3-31ce-4aca-b449-762e02b86af0 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:32.376996 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-de720ec3-31ce-4aca-b449-762e02b86af0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:10:32.376996 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:10:32.376996 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:10:32.376996 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:10:32.376996 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:10:32.376996 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:10:32.376996 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:10:32.376996 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:10:32.376996 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:10:32.376996 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:10:32.376996 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:10:32.376996 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:10:32.376996 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 12:10:32.376996 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 12:10:32.376996 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 12:10:32.378911 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 12:10:32.378911 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:10:32.378911 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:10:32.378911 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:10:32.378911 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:10:32.378911 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:10:32.378911 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:10:32.378911 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:10:32.378911 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:10:32.378911 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:10:32.378911 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:10:32.378911 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:10:32.378911 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:10:32.378911 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:10:32.378911 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:10:32.378911 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:10:32.378911 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:10:32.380737 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 12:10:32.380737 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 12:10:32.380737 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 12:10:32.380737 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 12:10:32.380737 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 12:10:32.380737 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 12:10:32.380737 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:10:32.380737 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:10:32.380737 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 619/1230] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:10:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 12:10:32.385195 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f08ce0-a58c-45ba-b3fd-4dfacb10fa94 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:32.530610 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f08ce0-a58c-45ba-b3fd-4dfacb10fa94 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:32.604661 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ef2a7-410f-4ce4-98ff-10f5252b83fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:32.605909 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ef2a7-410f-4ce4-98ff-10f5252b83fb None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:32.606524 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ef2a7-410f-4ce4-98ff-10f5252b83fb None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:32.607115 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ef2a7-410f-4ce4-98ff-10f5252b83fb None admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:32.608529 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ef2a7-410f-4ce4-98ff-10f5252b83fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:10:32.609077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ef2a7-410f-4ce4-98ff-10f5252b83fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:32.612530 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ef2a7-410f-4ce4-98ff-10f5252b83fb None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:32.633380 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 612/1231] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Sep 21 12:10:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:10:32.641422 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de720ec3-31ce-4aca-b449-762e02b86af0 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:32.741795 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:32.786744 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de720ec3-31ce-4aca-b449-762e02b86af0 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:32.832340 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4a027-5353-446a-8863-99e250759a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:32.833340 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4a027-5353-446a-8863-99e250759a3c None admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:32.833866 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4a027-5353-446a-8863-99e250759a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:32.834298 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4a027-5353-446a-8863-99e250759a3c None admin] PATH_INFO: `/v3/projects/b0abcc6f2ce14825bfc26e6210889c21/users/74e866f134f64644bf33e3adecf207c4/roles/327398b6ec324647b6c4ea84a59a026b` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:32.856938 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4a027-5353-446a-8863-99e250759a3c None admin] RBAC: Authorizing `identity:create_grant(project_id=b0abcc6f2ce14825bfc26e6210889c21, user_id=74e866f134f64644bf33e3adecf207c4, role_id=327398b6ec324647b6c4ea84a59a026b)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:32.858537 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4a027-5353-446a-8863-99e250759a3c None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:32.875156 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 620/1232] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Sep 21 12:10:32 2022] PUT /identity/v3/projects/b0abcc6f2ce14825bfc26e6210889c21/users/74e866f134f64644bf33e3adecf207c4/roles/327398b6ec324647b6c4ea84a59a026b => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:10:35.569720 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e35862-9788-44d6-96bc-d794bc303ea7 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:35.570298 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e35862-9788-44d6-96bc-d794bc303ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:35.570582 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e35862-9788-44d6-96bc-d794bc303ea7 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:35.572935 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 613/1233] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:10:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:10:35.580570 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77b164-564b-4f95-a494-3116dd8d2f10 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:35.581080 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77b164-564b-4f95-a494-3116dd8d2f10 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:35.581537 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77b164-564b-4f95-a494-3116dd8d2f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:35.616021 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-de77b164-564b-4f95-a494-3116dd8d2f10 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:10:35.618576 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-de77b164-564b-4f95-a494-3116dd8d2f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:10:35.733562 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 621/1234] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:10:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:10:36.030609 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e35862-9788-44d6-96bc-d794bc303ea7 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:36.063940 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:36.178300 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e35862-9788-44d6-96bc-d794bc303ea7 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:36.239039 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda3ea2-3954-4bd6-9373-d3084def1d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:36.240003 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda3ea2-3954-4bd6-9373-d3084def1d41 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:36.240382 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda3ea2-3954-4bd6-9373-d3084def1d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:36.240840 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda3ea2-3954-4bd6-9373-d3084def1d41 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:36.257357 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda3ea2-3954-4bd6-9373-d3084def1d41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:10:36.263704 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-edda3ea2-3954-4bd6-9373-d3084def1d41 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 21 12:10:36.263704 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:10:36.263704 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:10:36.263704 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:10:36.263704 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:10:36.263704 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:10:36.263704 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:10:36.263704 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:10:36.263704 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:10:36.263704 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:10:36.263704 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:10:36.263704 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:10:36.263704 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:10:36.263704 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:10:36.263704 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:10:36.263704 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:10:36.265437 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:10:36.265437 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:10:36.265437 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:10:36.265437 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:10:36.265437 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:10:36.265437 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:10:36.265437 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:10:36.265437 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:10:36.265437 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:10:36.265437 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:10:36.265437 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:10:36.265437 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:10:36.265437 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:10:36.265437 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:10:36.265437 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:10:36.265437 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:10:36.267149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:10:36.267149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:10:36.267149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:10:36.267149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:10:36.267149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:10:36.267149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:10:36.267149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:10:36.267149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:10:36.267149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:10:36.267149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:10:36.267149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 21 12:10:36.267149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:10:36.267149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 614/1235] 10.222.0.60 () {56 vars in 1102 bytes} [Wed Sep 21 12:10:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 12:10:36.272450 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de77b164-564b-4f95-a494-3116dd8d2f10 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:36.335008 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:36.405161 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de77b164-564b-4f95-a494-3116dd8d2f10 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:36.454930 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5d2f6-6cff-4c7b-a8e1-b0e52e67119e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:36.455950 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5d2f6-6cff-4c7b-a8e1-b0e52e67119e None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:36.456406 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5d2f6-6cff-4c7b-a8e1-b0e52e67119e None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:36.456875 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5d2f6-6cff-4c7b-a8e1-b0e52e67119e None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:36.458125 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c5d2f6-6cff-4c7b-a8e1-b0e52e67119e None admin] RBAC: Adding query filter params (name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:10:36.458666 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c5d2f6-6cff-4c7b-a8e1-b0e52e67119e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:36.461248 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c5d2f6-6cff-4c7b-a8e1-b0e52e67119e None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:36.476609 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 622/1236] 10.222.0.60 () {56 vars in 1103 bytes} [Wed Sep 21 12:10:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:10:36.483123 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda3ea2-3954-4bd6-9373-d3084def1d41 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:36.622638 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:36.650991 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda3ea2-3954-4bd6-9373-d3084def1d41 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:36.700112 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1cdda8-9d51-4dad-81d3-ceb36ed51bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:36.701177 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cdda8-9d51-4dad-81d3-ceb36ed51bca None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:36.701492 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cdda8-9d51-4dad-81d3-ceb36ed51bca None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:36.702071 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cdda8-9d51-4dad-81d3-ceb36ed51bca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:36.724411 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1cdda8-9d51-4dad-81d3-ceb36ed51bca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:36.727211 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1cdda8-9d51-4dad-81d3-ceb36ed51bca None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:36.754250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-ef1cdda8-9d51-4dad-81d3-ceb36ed51bca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:10:36.754250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:10:36.754250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:10:36.754250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:10:36.754250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:10:36.754250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:10:36.754250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:10:36.754250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:10:36.754250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:10:36.754250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:10:36.754250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:10:36.754250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:10:36.754250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:10:36.754250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:10:36.754250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:10:36.754250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:10:36.756662 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:10:36.756662 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:10:36.756662 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:10:36.756662 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:10:36.756662 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:10:36.756662 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:10:36.756662 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:10:36.756662 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:10:36.756662 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:10:36.756662 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:10:36.756662 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:10:36.756662 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:10:36.756662 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:10:36.756662 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:10:36.756662 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:10:36.756662 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:10:36.756662 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:10:36.758747 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:10:36.758747 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:10:36.758747 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:10:36.758747 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 615/1237] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:10:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:10:36.764596 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5d2f6-6cff-4c7b-a8e1-b0e52e67119e None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:36.954928 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5d2f6-6cff-4c7b-a8e1-b0e52e67119e None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:36.974287 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:37.016839 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16268a-b4b8-4129-bee8-3d662f8b792a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:37.017481 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16268a-b4b8-4129-bee8-3d662f8b792a None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:37.017773 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16268a-b4b8-4129-bee8-3d662f8b792a None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:37.018087 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16268a-b4b8-4129-bee8-3d662f8b792a None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:37.018914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16268a-b4b8-4129-bee8-3d662f8b792a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:10:37.019257 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16268a-b4b8-4129-bee8-3d662f8b792a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:37.020928 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16268a-b4b8-4129-bee8-3d662f8b792a None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:37.037387 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 623/1238] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:10:37.044313 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1cdda8-9d51-4dad-81d3-ceb36ed51bca None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:37.224788 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1cdda8-9d51-4dad-81d3-ceb36ed51bca None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:37.287415 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7be62-e970-4010-aa93-4ae1f078c7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:37.288496 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7be62-e970-4010-aa93-4ae1f078c7e9 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:37.288960 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7be62-e970-4010-aa93-4ae1f078c7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:37.289433 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7be62-e970-4010-aa93-4ae1f078c7e9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:37.295257 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:37.308103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c7be62-e970-4010-aa93-4ae1f078c7e9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:37.310986 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c7be62-e970-4010-aa93-4ae1f078c7e9 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:37.335672 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-50c7be62-e970-4010-aa93-4ae1f078c7e9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 21 12:10:37.335672 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:10:37.335672 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:10:37.335672 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:10:37.335672 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:10:37.335672 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:10:37.335672 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:10:37.335672 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:10:37.335672 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:10:37.335672 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:10:37.335672 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:10:37.335672 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:10:37.335672 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 12:10:37.335672 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 12:10:37.335672 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 12:10:37.335672 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 12:10:37.337128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:10:37.337128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:10:37.337128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 12:10:37.337128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:10:37.337128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 12:10:37.337128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:10:37.337128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:10:37.337128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:10:37.337128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:10:37.337128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:10:37.337128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:10:37.337128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:10:37.337128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:10:37.337128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:10:37.337128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:10:37.337128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:10:37.337128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:10:37.337128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:10:37.339383 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:10:37.339383 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:10:37.339383 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 12:10:37.339383 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 12:10:37.339383 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 12:10:37.339383 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 12:10:37.339383 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 12:10:37.339383 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 12:10:37.339383 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 21 12:10:37.339383 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:10:37.339383 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 616/1239] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:10:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:10:37.344012 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16268a-b4b8-4129-bee8-3d662f8b792a None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:37.507697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16268a-b4b8-4129-bee8-3d662f8b792a None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:37.556320 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836a0ba-523d-4d6a-92d3-557aa6e1bb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:37.556952 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836a0ba-523d-4d6a-92d3-557aa6e1bb61 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:37.561573 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836a0ba-523d-4d6a-92d3-557aa6e1bb61 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:37.561573 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836a0ba-523d-4d6a-92d3-557aa6e1bb61 None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:37.561573 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836a0ba-523d-4d6a-92d3-557aa6e1bb61 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:10:37.561573 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836a0ba-523d-4d6a-92d3-557aa6e1bb61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:37.561573 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836a0ba-523d-4d6a-92d3-557aa6e1bb61 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:37.592590 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 624/1240] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Sep 21 12:10:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:10:37.601478 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7be62-e970-4010-aa93-4ae1f078c7e9 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:37.779597 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7be62-e970-4010-aa93-4ae1f078c7e9 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:37.835647 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce39176-54b5-4a78-9a1e-68949f1d23a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:37.836292 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce39176-54b5-4a78-9a1e-68949f1d23a2 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:37.836556 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce39176-54b5-4a78-9a1e-68949f1d23a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:37.836825 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce39176-54b5-4a78-9a1e-68949f1d23a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:37.937653 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:37.950786 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce39176-54b5-4a78-9a1e-68949f1d23a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:37.954211 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce39176-54b5-4a78-9a1e-68949f1d23a2 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:38.146466 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 617/1241] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:10:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 12:10:38.153489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836a0ba-523d-4d6a-92d3-557aa6e1bb61 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:38.193399 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:38.326018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836a0ba-523d-4d6a-92d3-557aa6e1bb61 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:38.383025 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c710d4-61f6-4da8-8edc-da92bbb43922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:38.383675 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c710d4-61f6-4da8-8edc-da92bbb43922 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:38.384046 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c710d4-61f6-4da8-8edc-da92bbb43922 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:38.384327 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c710d4-61f6-4da8-8edc-da92bbb43922 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:38.396580 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c710d4-61f6-4da8-8edc-da92bbb43922 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:38.397979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c710d4-61f6-4da8-8edc-da92bbb43922 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:38.415068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-e6c710d4-61f6-4da8-8edc-da92bbb43922 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:10:38.415068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:10:38.415068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:10:38.415068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:10:38.415068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:10:38.415068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:10:38.415068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:10:38.415068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:10:38.415068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:10:38.415068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:10:38.415068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:10:38.415068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:10:38.415068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:10:38.415068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:10:38.415068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:10:38.415068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:10:38.422336 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:10:38.422336 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:10:38.422336 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:10:38.422336 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:10:38.422336 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:10:38.422336 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:10:38.422336 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:10:38.422336 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:10:38.422336 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:10:38.422336 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:10:38.422336 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:10:38.422336 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:10:38.422336 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:10:38.422336 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:10:38.422336 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:10:38.422336 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:10:38.422336 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:10:38.424232 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:10:38.424232 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:10:38.424232 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:10:38.424232 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 625/1242] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:10:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:10:38.424671 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce39176-54b5-4a78-9a1e-68949f1d23a2 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:38.561939 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:38.581191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce39176-54b5-4a78-9a1e-68949f1d23a2 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:38.659029 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba9caf-8c62-48f1-a27b-447953025040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:38.660004 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba9caf-8c62-48f1-a27b-447953025040 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:38.660503 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba9caf-8c62-48f1-a27b-447953025040 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:38.660974 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba9caf-8c62-48f1-a27b-447953025040 None admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:38.662139 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ba9caf-8c62-48f1-a27b-447953025040 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:10:38.662697 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ba9caf-8c62-48f1-a27b-447953025040 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:38.666208 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ba9caf-8c62-48f1-a27b-447953025040 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:38.694899 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 618/1243] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:10:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:10:38.704957 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c710d4-61f6-4da8-8edc-da92bbb43922 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:38.869378 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:38.902206 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c710d4-61f6-4da8-8edc-da92bbb43922 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:38.960922 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aee035-c45c-4d5a-afe6-e2bc7e7a67ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:38.961729 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aee035-c45c-4d5a-afe6-e2bc7e7a67ab None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:38.962181 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aee035-c45c-4d5a-afe6-e2bc7e7a67ab None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:38.962696 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aee035-c45c-4d5a-afe6-e2bc7e7a67ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:38.972260 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aee035-c45c-4d5a-afe6-e2bc7e7a67ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:38.974010 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aee035-c45c-4d5a-afe6-e2bc7e7a67ab None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:38.987441 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-e2aee035-c45c-4d5a-afe6-e2bc7e7a67ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:10:38.987441 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:10:38.987441 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:10:38.987441 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:10:38.987441 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:10:38.987441 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:10:38.987441 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:10:38.987441 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:10:38.987441 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:10:38.987441 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:10:38.987441 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:10:38.987441 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:10:38.987441 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 12:10:38.987441 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 12:10:38.987441 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 12:10:38.988998 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 12:10:38.988998 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:10:38.988998 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:10:38.988998 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:10:38.988998 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:10:38.988998 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:10:38.988998 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:10:38.988998 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:10:38.988998 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:10:38.988998 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:10:38.988998 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:10:38.988998 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:10:38.988998 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:10:38.988998 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:10:38.988998 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:10:38.988998 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:10:38.988998 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:10:38.990496 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 12:10:38.990496 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 12:10:38.990496 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 12:10:38.990496 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 12:10:38.990496 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 12:10:38.990496 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 12:10:38.990496 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:10:38.990496 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:10:38.990496 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 626/1244] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:10:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 12:10:38.995139 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba9caf-8c62-48f1-a27b-447953025040 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:39.163925 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba9caf-8c62-48f1-a27b-447953025040 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:39.217058 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6254936-1a81-4cfb-adfa-3bfc66f8c561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:39.218242 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6254936-1a81-4cfb-adfa-3bfc66f8c561 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:39.218757 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6254936-1a81-4cfb-adfa-3bfc66f8c561 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:39.219512 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6254936-1a81-4cfb-adfa-3bfc66f8c561 None admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:39.221255 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6254936-1a81-4cfb-adfa-3bfc66f8c561 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:10:39.221943 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6254936-1a81-4cfb-adfa-3bfc66f8c561 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:39.225534 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6254936-1a81-4cfb-adfa-3bfc66f8c561 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:39.262273 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 619/1245] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Sep 21 12:10:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:10:39.264116 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aee035-c45c-4d5a-afe6-e2bc7e7a67ab None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:39.420683 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aee035-c45c-4d5a-afe6-e2bc7e7a67ab None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:39.467604 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6029351-5f79-421c-b7c5-83545abbead9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:39.468197 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6029351-5f79-421c-b7c5-83545abbead9 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:39.468544 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6029351-5f79-421c-b7c5-83545abbead9 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:39.468921 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6029351-5f79-421c-b7c5-83545abbead9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:39.470219 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6029351-5f79-421c-b7c5-83545abbead9 None admin] RBAC: Adding query filter params (role.id=327398b6ec324647b6c4ea84a59a026b, scope.project.id=b0abcc6f2ce14825bfc26e6210889c21, user.id=74e866f134f64644bf33e3adecf207c4) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:10:39.470614 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6029351-5f79-421c-b7c5-83545abbead9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:39.472146 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6029351-5f79-421c-b7c5-83545abbead9 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:39.479277 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 627/1246] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:10:39 2022] GET /identity/v3/role_assignments?user.id=74e866f134f64644bf33e3adecf207c4&scope.project.id=b0abcc6f2ce14825bfc26e6210889c21&role.id=327398b6ec324647b6c4ea84a59a026b => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:10:42.158838 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ed739-b50d-4c75-b234-a55186c199a4 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:42.159743 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ed739-b50d-4c75-b234-a55186c199a4 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:42.159743 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ed739-b50d-4c75-b234-a55186c199a4 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:42.160939 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 620/1247] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:10:42.167999 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb1d1e-ef23-4b8d-ab36-0a19bf21fe95 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:42.168987 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb1d1e-ef23-4b8d-ab36-0a19bf21fe95 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:42.169144 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb1d1e-ef23-4b8d-ab36-0a19bf21fe95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:42.177632 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:42.198244 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-3afb1d1e-ef23-4b8d-ab36-0a19bf21fe95 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:10:42.200188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-3afb1d1e-ef23-4b8d-ab36-0a19bf21fe95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:10:42.322617 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 628/1248] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:10:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:10:42.664365 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ed739-b50d-4c75-b234-a55186c199a4 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:42.700189 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:42.836881 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ed739-b50d-4c75-b234-a55186c199a4 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:42.894233 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2936e1-7fd4-4792-abc6-daae0c0d0cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:42.895588 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2936e1-7fd4-4792-abc6-daae0c0d0cfd None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:42.896425 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2936e1-7fd4-4792-abc6-daae0c0d0cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:42.896896 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2936e1-7fd4-4792-abc6-daae0c0d0cfd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:42.915617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2936e1-7fd4-4792-abc6-daae0c0d0cfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:10:42.921531 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-5a2936e1-7fd4-4792-abc6-daae0c0d0cfd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:10:42.921531 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:10:42.921531 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:10:42.921531 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:10:42.921531 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:10:42.921531 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:10:42.921531 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:10:42.921531 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:10:42.921531 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:10:42.921531 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:10:42.921531 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:10:42.921531 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:10:42.921531 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:10:42.921531 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:10:42.921531 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:10:42.921531 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:10:42.924333 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:10:42.924333 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:10:42.924333 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:10:42.924333 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:10:42.924333 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:10:42.924333 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:10:42.924333 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:10:42.924333 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:10:42.924333 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:10:42.924333 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:10:42.924333 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:10:42.924333 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:10:42.924333 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:10:42.924333 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:10:42.924333 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:10:42.924333 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:10:42.925785 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:10:42.925785 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:10:42.925785 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:10:42.925785 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:10:42.925785 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:10:42.925785 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:10:42.925785 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:10:42.925785 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:10:42.925785 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:10:42.925785 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:10:42.925785 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:10:42.925785 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:10:42.925785 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 621/1249] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Sep 21 12:10:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:10:42.936840 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb1d1e-ef23-4b8d-ab36-0a19bf21fe95 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:43.115610 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb1d1e-ef23-4b8d-ab36-0a19bf21fe95 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:43.154651 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:43.160839 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f6b87-eca9-44a6-adeb-f64418bcfbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:43.161670 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f6b87-eca9-44a6-adeb-f64418bcfbc2 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:43.162210 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f6b87-eca9-44a6-adeb-f64418bcfbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:43.162646 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f6b87-eca9-44a6-adeb-f64418bcfbc2 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:43.163496 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f6b87-eca9-44a6-adeb-f64418bcfbc2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:10:43.163966 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f6b87-eca9-44a6-adeb-f64418bcfbc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:43.165585 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f6b87-eca9-44a6-adeb-f64418bcfbc2 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:43.176765 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 629/1250] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:10:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:10:43.183375 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2936e1-7fd4-4792-abc6-daae0c0d0cfd None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:43.335294 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:43.377352 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2936e1-7fd4-4792-abc6-daae0c0d0cfd None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:43.434049 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dacf576-8011-4a8b-a578-70a40f0c60e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:43.434823 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dacf576-8011-4a8b-a578-70a40f0c60e1 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:43.435147 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dacf576-8011-4a8b-a578-70a40f0c60e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:43.435457 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dacf576-8011-4a8b-a578-70a40f0c60e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:43.452216 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dacf576-8011-4a8b-a578-70a40f0c60e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:43.455412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dacf576-8011-4a8b-a578-70a40f0c60e1 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:43.479148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-4dacf576-8011-4a8b-a578-70a40f0c60e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:10:43.479148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:10:43.479148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:10:43.479148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:10:43.479148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:10:43.479148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:10:43.479148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:10:43.479148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:10:43.479148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:10:43.479148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:10:43.479148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:10:43.479148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:10:43.479148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:10:43.479148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:10:43.479148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:10:43.479148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:10:43.481514 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:10:43.481514 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:10:43.481514 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:10:43.481514 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:10:43.481514 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:10:43.481514 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:10:43.481514 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:10:43.481514 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:10:43.481514 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:10:43.481514 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:10:43.481514 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:10:43.481514 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:10:43.481514 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:10:43.481514 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:10:43.481514 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:10:43.481514 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:10:43.481514 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:10:43.483348 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:10:43.483348 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:10:43.483348 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:10:43.483348 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 622/1251] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:10:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 12:10:43.490673 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f6b87-eca9-44a6-adeb-f64418bcfbc2 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:43.666094 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f6b87-eca9-44a6-adeb-f64418bcfbc2 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:43.718256 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe0abd-3731-4514-9cbb-293e98f64a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:43.719227 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe0abd-3731-4514-9cbb-293e98f64a62 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:43.719697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe0abd-3731-4514-9cbb-293e98f64a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:43.720113 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe0abd-3731-4514-9cbb-293e98f64a62 None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:43.721175 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfe0abd-3731-4514-9cbb-293e98f64a62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:10:43.721670 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfe0abd-3731-4514-9cbb-293e98f64a62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:43.723615 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfe0abd-3731-4514-9cbb-293e98f64a62 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:43.744184 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 630/1252] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:10:43.753846 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dacf576-8011-4a8b-a578-70a40f0c60e1 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:43.927622 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dacf576-8011-4a8b-a578-70a40f0c60e1 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:43.966818 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:43.977856 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e3da0-b1e1-4907-9100-6111be79e9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:43.979279 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e3da0-b1e1-4907-9100-6111be79e9ce None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:43.979382 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e3da0-b1e1-4907-9100-6111be79e9ce None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:43.979615 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e3da0-b1e1-4907-9100-6111be79e9ce None admin] PATH_INFO: `/v3/users/placement` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:43.992413 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e3da0-b1e1-4907-9100-6111be79e9ce None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:43.994659 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e3da0-b1e1-4907-9100-6111be79e9ce None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:44.016608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-9e1e3da0-b1e1-4907-9100-6111be79e9ce None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 21 12:10:44.016608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:10:44.016608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:10:44.016608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:10:44.016608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:10:44.016608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:10:44.016608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:10:44.016608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:10:44.016608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:10:44.016608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:10:44.016608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:10:44.016608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:10:44.016608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 12:10:44.016608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 12:10:44.016608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 12:10:44.016608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 12:10:44.018686 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:10:44.018686 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:10:44.018686 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 12:10:44.018686 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:10:44.018686 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 12:10:44.018686 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:10:44.018686 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:10:44.018686 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:10:44.018686 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:10:44.018686 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:10:44.018686 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:10:44.018686 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:10:44.018686 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:10:44.018686 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:10:44.018686 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:10:44.018686 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:10:44.018686 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:10:44.018686 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:10:44.020546 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:10:44.020546 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:10:44.020546 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 12:10:44.020546 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 12:10:44.020546 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 12:10:44.020546 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 12:10:44.020546 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 12:10:44.020546 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 12:10:44.020546 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 21 12:10:44.020546 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:10:44.020546 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 623/1253] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:10:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:10:44.026193 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe0abd-3731-4514-9cbb-293e98f64a62 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:44.115375 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:44.181472 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe0abd-3731-4514-9cbb-293e98f64a62 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:44.226870 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dbfaa0-94d2-471f-a8b3-2ed56c81b1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:44.227547 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dbfaa0-94d2-471f-a8b3-2ed56c81b1d1 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:44.227909 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dbfaa0-94d2-471f-a8b3-2ed56c81b1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:44.228225 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dbfaa0-94d2-471f-a8b3-2ed56c81b1d1 None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:44.229140 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dbfaa0-94d2-471f-a8b3-2ed56c81b1d1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:10:44.229472 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dbfaa0-94d2-471f-a8b3-2ed56c81b1d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:44.231233 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dbfaa0-94d2-471f-a8b3-2ed56c81b1d1 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:44.264582 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 631/1254] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Sep 21 12:10:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:10:44.265589 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e3da0-b1e1-4907-9100-6111be79e9ce None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:44.435500 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e3da0-b1e1-4907-9100-6111be79e9ce None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:44.479269 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd765c-1b5d-4552-86f7-826b7501eb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:44.479889 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd765c-1b5d-4552-86f7-826b7501eb98 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:44.480164 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd765c-1b5d-4552-86f7-826b7501eb98 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:44.480430 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd765c-1b5d-4552-86f7-826b7501eb98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:44.583652 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:44.600994 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd765c-1b5d-4552-86f7-826b7501eb98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:44.603883 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd765c-1b5d-4552-86f7-826b7501eb98 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:44.749206 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 624/1255] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:10:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 21 12:10:44.756487 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dbfaa0-94d2-471f-a8b3-2ed56c81b1d1 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:44.928536 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dbfaa0-94d2-471f-a8b3-2ed56c81b1d1 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:44.943924 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:44.973617 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b9338-1e2e-44df-938f-12bd2cdef491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:44.974753 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b9338-1e2e-44df-938f-12bd2cdef491 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:44.975206 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b9338-1e2e-44df-938f-12bd2cdef491 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:44.975647 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b9338-1e2e-44df-938f-12bd2cdef491 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:44.990522 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b9338-1e2e-44df-938f-12bd2cdef491 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:44.992138 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b9338-1e2e-44df-938f-12bd2cdef491 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:45.009700 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-a06b9338-1e2e-44df-938f-12bd2cdef491 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:10:45.009700 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:10:45.009700 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:10:45.009700 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:10:45.009700 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:10:45.009700 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:10:45.009700 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:10:45.009700 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:10:45.009700 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:10:45.009700 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:10:45.009700 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:10:45.009700 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:10:45.009700 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:10:45.009700 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:10:45.009700 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:10:45.009700 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:10:45.011671 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:10:45.011671 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:10:45.011671 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:10:45.011671 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:10:45.011671 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:10:45.011671 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:10:45.011671 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:10:45.011671 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:10:45.011671 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:10:45.011671 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:10:45.011671 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:10:45.011671 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:10:45.011671 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:10:45.011671 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:10:45.011671 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:10:45.011671 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:10:45.011671 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:10:45.013738 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:10:45.013738 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:10:45.013738 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:10:45.013738 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 632/1256] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:10:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:10:45.020929 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd765c-1b5d-4552-86f7-826b7501eb98 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:45.164556 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:45.185626 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd765c-1b5d-4552-86f7-826b7501eb98 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:45.249443 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d043866-b780-4962-b65f-84214742726a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:45.251318 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d043866-b780-4962-b65f-84214742726a None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:45.251932 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d043866-b780-4962-b65f-84214742726a None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:45.252540 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d043866-b780-4962-b65f-84214742726a None admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:45.253965 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d043866-b780-4962-b65f-84214742726a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:10:45.254612 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d043866-b780-4962-b65f-84214742726a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:45.256919 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d043866-b780-4962-b65f-84214742726a None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:45.276335 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 625/1257] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:10:45.283112 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b9338-1e2e-44df-938f-12bd2cdef491 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:45.457168 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b9338-1e2e-44df-938f-12bd2cdef491 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:45.509981 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bf4a4-d9bf-4928-92f8-ba3cdef4feb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:45.510883 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bf4a4-d9bf-4928-92f8-ba3cdef4feb1 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:45.511343 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bf4a4-d9bf-4928-92f8-ba3cdef4feb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:45.511814 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bf4a4-d9bf-4928-92f8-ba3cdef4feb1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:45.523298 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7bf4a4-d9bf-4928-92f8-ba3cdef4feb1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:45.524948 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7bf4a4-d9bf-4928-92f8-ba3cdef4feb1 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:45.548807 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-bc7bf4a4-d9bf-4928-92f8-ba3cdef4feb1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:10:45.548807 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:10:45.548807 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:10:45.548807 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:10:45.548807 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:10:45.548807 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:10:45.548807 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:10:45.548807 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:10:45.548807 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:10:45.548807 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:10:45.548807 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:10:45.548807 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:10:45.548807 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 12:10:45.548807 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 12:10:45.548807 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 12:10:45.550006 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 12:10:45.550006 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:10:45.550006 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:10:45.550006 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:10:45.550006 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:10:45.550006 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:10:45.550006 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:10:45.550006 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:10:45.550006 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:10:45.550006 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:10:45.550006 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:10:45.550006 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:10:45.550006 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:10:45.550006 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:10:45.550006 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:10:45.550006 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:10:45.550006 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:10:45.551188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 12:10:45.551188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 12:10:45.551188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 12:10:45.551188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 12:10:45.551188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 12:10:45.551188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 12:10:45.551188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:10:45.551188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:10:45.551662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 633/1258] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:10:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:10:45.562393 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d043866-b780-4962-b65f-84214742726a None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:45.750865 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d043866-b780-4962-b65f-84214742726a None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:45.795341 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5098f5a-19d7-4739-b9dc-28f523c47129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:45.796080 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5098f5a-19d7-4739-b9dc-28f523c47129 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:45.796428 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5098f5a-19d7-4739-b9dc-28f523c47129 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:45.796767 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5098f5a-19d7-4739-b9dc-28f523c47129 None admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:45.798093 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5098f5a-19d7-4739-b9dc-28f523c47129 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:10:45.798525 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5098f5a-19d7-4739-b9dc-28f523c47129 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:45.800175 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5098f5a-19d7-4739-b9dc-28f523c47129 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:45.824275 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 626/1259] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Sep 21 12:10:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:10:45.826663 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bf4a4-d9bf-4928-92f8-ba3cdef4feb1 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:45.871927 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:46.011169 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bf4a4-d9bf-4928-92f8-ba3cdef4feb1 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:46.062875 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fad10b-abf6-411c-82a9-dbedab76ea4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:46.064015 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fad10b-abf6-411c-82a9-dbedab76ea4c None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:46.064613 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fad10b-abf6-411c-82a9-dbedab76ea4c None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:46.065117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fad10b-abf6-411c-82a9-dbedab76ea4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:46.066476 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fad10b-abf6-411c-82a9-dbedab76ea4c None admin] RBAC: Adding query filter params (role.id=72c80b472acb462ebadd86463efe91f7, scope.project.id=b0abcc6f2ce14825bfc26e6210889c21, user.id=74e866f134f64644bf33e3adecf207c4) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:10:46.067045 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fad10b-abf6-411c-82a9-dbedab76ea4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:46.069766 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fad10b-abf6-411c-82a9-dbedab76ea4c None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:46.079379 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 634/1260] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:10:45 2022] GET /identity/v3/role_assignments?user.id=74e866f134f64644bf33e3adecf207c4&scope.project.id=b0abcc6f2ce14825bfc26e6210889c21&role.id=72c80b472acb462ebadd86463efe91f7 => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:10:48.391365 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47fffc-7596-45d4-81cd-7dba2a2a28b9 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:48.392298 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47fffc-7596-45d4-81cd-7dba2a2a28b9 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:48.392298 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47fffc-7596-45d4-81cd-7dba2a2a28b9 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:48.393831 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 627/1261] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:10:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:10:48.400006 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b503dd3-f394-4eb1-a240-72cb5952f8e7 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:48.400597 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b503dd3-f394-4eb1-a240-72cb5952f8e7 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:48.400597 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b503dd3-f394-4eb1-a240-72cb5952f8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:48.420547 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-5b503dd3-f394-4eb1-a240-72cb5952f8e7 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:10:48.421778 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-5b503dd3-f394-4eb1-a240-72cb5952f8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:10:48.504196 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 635/1262] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:10:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:10:48.790162 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd47fffc-7596-45d4-81cd-7dba2a2a28b9 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:48.803102 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:48.905873 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd47fffc-7596-45d4-81cd-7dba2a2a28b9 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:48.946081 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49172bdd-57c3-43a5-9bb9-51f043d46258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:48.946787 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49172bdd-57c3-43a5-9bb9-51f043d46258 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:48.947061 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49172bdd-57c3-43a5-9bb9-51f043d46258 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:48.947330 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49172bdd-57c3-43a5-9bb9-51f043d46258 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:48.959493 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49172bdd-57c3-43a5-9bb9-51f043d46258 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:10:48.964426 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-49172bdd-57c3-43a5-9bb9-51f043d46258 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:10:48.964426 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:10:48.964426 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:10:48.964426 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:10:48.964426 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:10:48.964426 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:10:48.964426 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:10:48.964426 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:10:48.964426 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:10:48.964426 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:10:48.964426 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:10:48.964426 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:10:48.964426 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:10:48.964426 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:10:48.964426 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:10:48.964426 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:10:48.966188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:10:48.966188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:10:48.966188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:10:48.966188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:10:48.966188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:10:48.966188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:10:48.966188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:10:48.966188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:10:48.966188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:10:48.966188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:10:48.966188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:10:48.966188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:10:48.966188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:10:48.966188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:10:48.966188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:10:48.966188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:10:48.967897 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:10:48.967897 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:10:48.967897 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:10:48.967897 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:10:48.967897 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:10:48.967897 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:10:48.967897 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:10:48.967897 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:10:48.967897 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:10:48.967897 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:10:48.967897 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:10:48.967897 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:10:48.967897 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 628/1263] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Sep 21 12:10:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:10:48.974399 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b503dd3-f394-4eb1-a240-72cb5952f8e7 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:49.008342 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:49.160784 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b503dd3-f394-4eb1-a240-72cb5952f8e7 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:49.215661 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af27c7-503a-4bd3-ba6b-34dc8e06c8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:49.216592 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af27c7-503a-4bd3-ba6b-34dc8e06c8d1 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:49.217024 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af27c7-503a-4bd3-ba6b-34dc8e06c8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:49.217447 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af27c7-503a-4bd3-ba6b-34dc8e06c8d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:49.218219 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af27c7-503a-4bd3-ba6b-34dc8e06c8d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:10:49.218693 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af27c7-503a-4bd3-ba6b-34dc8e06c8d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:49.220752 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af27c7-503a-4bd3-ba6b-34dc8e06c8d1 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:49.234287 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 636/1264] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:10:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:10:49.243500 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49172bdd-57c3-43a5-9bb9-51f043d46258 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:49.333669 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:49.373522 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49172bdd-57c3-43a5-9bb9-51f043d46258 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:49.410632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371faf99-ffb6-4b69-a368-bf4f46b11dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:49.411422 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371faf99-ffb6-4b69-a368-bf4f46b11dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:49.411588 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371faf99-ffb6-4b69-a368-bf4f46b11dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:49.411816 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371faf99-ffb6-4b69-a368-bf4f46b11dd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:49.424719 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371faf99-ffb6-4b69-a368-bf4f46b11dd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:49.426205 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371faf99-ffb6-4b69-a368-bf4f46b11dd6 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:49.442939 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-371faf99-ffb6-4b69-a368-bf4f46b11dd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:10:49.442939 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:10:49.442939 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:10:49.442939 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:10:49.442939 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:10:49.442939 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:10:49.442939 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:10:49.442939 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:10:49.442939 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:10:49.442939 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:10:49.442939 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:10:49.442939 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:10:49.442939 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:10:49.442939 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:10:49.442939 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:10:49.442939 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:10:49.444732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:10:49.444732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:10:49.444732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:10:49.444732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:10:49.444732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:10:49.444732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:10:49.444732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:10:49.444732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:10:49.444732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:10:49.444732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:10:49.444732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:10:49.444732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:10:49.444732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:10:49.444732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:10:49.444732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:10:49.444732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:10:49.444732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:10:49.446663 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:10:49.446663 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:10:49.446663 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:10:49.446663 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 629/1265] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:10:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:10:49.451568 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af27c7-503a-4bd3-ba6b-34dc8e06c8d1 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:49.543500 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:49.577578 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af27c7-503a-4bd3-ba6b-34dc8e06c8d1 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:49.615225 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e761932-d81d-4a91-91d1-4af1b6a873eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:49.615832 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e761932-d81d-4a91-91d1-4af1b6a873eb None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:49.616105 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e761932-d81d-4a91-91d1-4af1b6a873eb None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:49.616371 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e761932-d81d-4a91-91d1-4af1b6a873eb None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:49.617029 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e761932-d81d-4a91-91d1-4af1b6a873eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:10:49.617324 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e761932-d81d-4a91-91d1-4af1b6a873eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:49.618765 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e761932-d81d-4a91-91d1-4af1b6a873eb None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:49.632917 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 637/1266] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:10:49.641871 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371faf99-ffb6-4b69-a368-bf4f46b11dd6 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:49.784158 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371faf99-ffb6-4b69-a368-bf4f46b11dd6 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:49.809406 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:49.825322 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5616a108-c1ca-4ced-a18c-8dcaefbb2e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:49.826035 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616a108-c1ca-4ced-a18c-8dcaefbb2e03 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:49.826391 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616a108-c1ca-4ced-a18c-8dcaefbb2e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:49.826711 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616a108-c1ca-4ced-a18c-8dcaefbb2e03 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:49.835875 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5616a108-c1ca-4ced-a18c-8dcaefbb2e03 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:49.837424 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5616a108-c1ca-4ced-a18c-8dcaefbb2e03 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:49.850713 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-5616a108-c1ca-4ced-a18c-8dcaefbb2e03 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 21 12:10:49.850713 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:10:49.850713 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:10:49.850713 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:10:49.850713 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:10:49.850713 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:10:49.850713 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:10:49.850713 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:10:49.850713 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:10:49.850713 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:10:49.850713 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:10:49.850713 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:10:49.850713 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 12:10:49.850713 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 12:10:49.850713 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 12:10:49.850713 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 12:10:49.852630 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:10:49.852630 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:10:49.852630 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 12:10:49.852630 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:10:49.852630 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 12:10:49.852630 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:10:49.852630 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:10:49.852630 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:10:49.852630 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:10:49.852630 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:10:49.852630 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:10:49.852630 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:10:49.852630 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:10:49.852630 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:10:49.852630 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:10:49.852630 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:10:49.852630 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:10:49.852630 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:10:49.854685 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:10:49.854685 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:10:49.854685 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 12:10:49.854685 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 12:10:49.854685 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 12:10:49.854685 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 12:10:49.854685 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 12:10:49.854685 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 12:10:49.854685 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 21 12:10:49.854685 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:10:49.854685 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 630/1267] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:10:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:10:49.858145 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e761932-d81d-4a91-91d1-4af1b6a873eb None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:49.972554 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e761932-d81d-4a91-91d1-4af1b6a873eb None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:50.022379 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3dde5-b41a-4caf-a664-7e902661f86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:50.023185 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3dde5-b41a-4caf-a664-7e902661f86d None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:50.023520 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3dde5-b41a-4caf-a664-7e902661f86d None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:50.023833 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3dde5-b41a-4caf-a664-7e902661f86d None admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:50.024665 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3dde5-b41a-4caf-a664-7e902661f86d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:10:50.025008 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3dde5-b41a-4caf-a664-7e902661f86d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:50.026628 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3dde5-b41a-4caf-a664-7e902661f86d None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:50.037696 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:50.051820 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 638/1268] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Sep 21 12:10:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:10:50.058316 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5616a108-c1ca-4ced-a18c-8dcaefbb2e03 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:50.226640 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5616a108-c1ca-4ced-a18c-8dcaefbb2e03 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:50.271247 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d483fd2-29eb-4f8e-99d3-a69d094166b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:50.271962 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d483fd2-29eb-4f8e-99d3-a69d094166b1 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:50.272287 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d483fd2-29eb-4f8e-99d3-a69d094166b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:50.272599 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d483fd2-29eb-4f8e-99d3-a69d094166b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:50.285166 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d483fd2-29eb-4f8e-99d3-a69d094166b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:50.286675 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d483fd2-29eb-4f8e-99d3-a69d094166b1 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:50.303434 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-3d483fd2-29eb-4f8e-99d3-a69d094166b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:10:50.303434 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:10:50.303434 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:10:50.303434 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:10:50.303434 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:10:50.303434 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:10:50.303434 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:10:50.303434 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:10:50.303434 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:10:50.303434 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:10:50.303434 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:10:50.303434 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:10:50.303434 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:10:50.303434 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:10:50.303434 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:10:50.303434 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:10:50.305244 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:10:50.305244 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:10:50.305244 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:10:50.305244 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:10:50.305244 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:10:50.305244 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:10:50.305244 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:10:50.305244 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:10:50.305244 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:10:50.305244 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:10:50.305244 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:10:50.305244 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:10:50.305244 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:10:50.305244 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:10:50.305244 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:10:50.305244 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:10:50.305244 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:10:50.307161 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:10:50.307161 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:10:50.307161 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:10:50.307161 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 631/1269] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:10:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:10:50.311822 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3dde5-b41a-4caf-a664-7e902661f86d None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:50.433249 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3dde5-b41a-4caf-a664-7e902661f86d None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:50.473389 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea9283-6442-4111-a39d-6e5f8ff11b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:50.474130 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea9283-6442-4111-a39d-6e5f8ff11b9b None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:50.474277 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea9283-6442-4111-a39d-6e5f8ff11b9b None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:50.474564 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea9283-6442-4111-a39d-6e5f8ff11b9b None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:50.475223 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea9283-6442-4111-a39d-6e5f8ff11b9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:10:50.475527 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea9283-6442-4111-a39d-6e5f8ff11b9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:50.476919 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea9283-6442-4111-a39d-6e5f8ff11b9b None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:50.490454 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 639/1270] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:10:50.496597 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d483fd2-29eb-4f8e-99d3-a69d094166b1 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:50.532486 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:50.619079 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d483fd2-29eb-4f8e-99d3-a69d094166b1 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:50.659045 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed5e0f-9227-439f-b1a4-f879d32278bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:50.659689 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed5e0f-9227-439f-b1a4-f879d32278bd None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:50.659968 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed5e0f-9227-439f-b1a4-f879d32278bd None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:50.660241 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed5e0f-9227-439f-b1a4-f879d32278bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:50.667989 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed5e0f-9227-439f-b1a4-f879d32278bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:50.669468 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed5e0f-9227-439f-b1a4-f879d32278bd None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:50.683220 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-32ed5e0f-9227-439f-b1a4-f879d32278bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:10:50.683220 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:10:50.683220 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:10:50.683220 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:10:50.683220 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:10:50.683220 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:10:50.683220 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:10:50.683220 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:10:50.683220 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:10:50.683220 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:10:50.683220 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:10:50.683220 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:10:50.683220 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 12:10:50.683220 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 12:10:50.683220 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 12:10:50.685017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 12:10:50.685017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:10:50.685017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:10:50.685017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:10:50.685017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:10:50.685017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:10:50.685017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:10:50.685017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:10:50.685017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:10:50.685017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:10:50.685017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:10:50.685017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:10:50.685017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:10:50.685017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:10:50.685017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:10:50.685017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:10:50.685017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:10:50.686344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 12:10:50.686344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 12:10:50.686344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 12:10:50.686344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 12:10:50.686344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 12:10:50.686344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 12:10:50.686344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:10:50.686344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:10:50.686344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 632/1271] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:10:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:10:50.694001 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea9283-6442-4111-a39d-6e5f8ff11b9b None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:50.761099 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:50.811337 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea9283-6442-4111-a39d-6e5f8ff11b9b None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:50.851034 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844a63a-4291-4383-9ace-becbb44277a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:50.851552 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844a63a-4291-4383-9ace-becbb44277a0 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:50.851834 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844a63a-4291-4383-9ace-becbb44277a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:50.852100 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844a63a-4291-4383-9ace-becbb44277a0 None admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:50.852798 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844a63a-4291-4383-9ace-becbb44277a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:10:50.853095 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844a63a-4291-4383-9ace-becbb44277a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:50.854565 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844a63a-4291-4383-9ace-becbb44277a0 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:50.868158 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 640/1272] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Sep 21 12:10:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:10:50.875171 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed5e0f-9227-439f-b1a4-f879d32278bd None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:51.023808 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:51.034770 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed5e0f-9227-439f-b1a4-f879d32278bd None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:51.073796 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519d958-5bc0-4dd4-84a5-1af2f343c058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:51.074594 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519d958-5bc0-4dd4-84a5-1af2f343c058 None admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:51.074920 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519d958-5bc0-4dd4-84a5-1af2f343c058 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:51.075333 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519d958-5bc0-4dd4-84a5-1af2f343c058 None admin] PATH_INFO: `/v3/projects/b0abcc6f2ce14825bfc26e6210889c21/users/74e866f134f64644bf33e3adecf207c4/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:51.077604 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e519d958-5bc0-4dd4-84a5-1af2f343c058 None admin] RBAC: Authorizing `identity:create_grant(project_id=b0abcc6f2ce14825bfc26e6210889c21, user_id=74e866f134f64644bf33e3adecf207c4, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:51.079793 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e519d958-5bc0-4dd4-84a5-1af2f343c058 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:51.095364 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 633/1273] 10.222.0.60 () {58 vars in 1439 bytes} [Wed Sep 21 12:10:50 2022] PUT /identity/v3/projects/b0abcc6f2ce14825bfc26e6210889c21/users/74e866f134f64644bf33e3adecf207c4/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:10:53.368331 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0758610-44dc-4b38-a7a7-c986211b4dc7 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:53.368913 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0758610-44dc-4b38-a7a7-c986211b4dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:53.369106 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0758610-44dc-4b38-a7a7-c986211b4dc7 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:53.370596 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 641/1274] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:10:53.377603 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d68533-9e35-4ab8-b36f-780343be3691 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:53.378234 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d68533-9e35-4ab8-b36f-780343be3691 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:53.378234 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d68533-9e35-4ab8-b36f-780343be3691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:53.399893 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-63d68533-9e35-4ab8-b36f-780343be3691 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:10:53.401147 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-63d68533-9e35-4ab8-b36f-780343be3691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:10:53.477893 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 634/1275] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:10:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:10:53.759121 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0758610-44dc-4b38-a7a7-c986211b4dc7 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:53.880865 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0758610-44dc-4b38-a7a7-c986211b4dc7 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:53.904012 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:53.924763 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e9e3e1-183d-427b-8203-a7180f68f434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:53.925409 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9e3e1-183d-427b-8203-a7180f68f434 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:53.925690 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9e3e1-183d-427b-8203-a7180f68f434 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:53.925962 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9e3e1-183d-427b-8203-a7180f68f434 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:53.938221 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e9e3e1-183d-427b-8203-a7180f68f434 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 21 12:10:53.943275 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-52e9e3e1-183d-427b-8203-a7180f68f434 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:10:53.943275 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:10:53.943275 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:10:53.943275 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:10:53.943275 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:10:53.943275 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:10:53.943275 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:10:53.943275 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:10:53.943275 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:10:53.943275 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:10:53.943275 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:10:53.943275 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:10:53.943275 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 21 12:10:53.943275 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 21 12:10:53.943275 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 21 12:10:53.943275 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 21 12:10:53.945082 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 21 12:10:53.945082 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 21 12:10:53.945082 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 21 12:10:53.945082 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 21 12:10:53.945082 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:10:53.945082 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:10:53.945082 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:10:53.945082 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:10:53.945082 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:10:53.945082 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:10:53.945082 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:10:53.945082 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:10:53.945082 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:10:53.945082 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:10:53.945082 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:10:53.945082 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:10:53.947008 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:10:53.947008 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:10:53.947008 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:10:53.947008 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:10:53.947008 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 21 12:10:53.947008 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 21 12:10:53.947008 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 21 12:10:53.947008 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 21 12:10:53.947008 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 21 12:10:53.947008 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 21 12:10:53.947008 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 21 12:10:53.947008 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:10:53.947008 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 642/1276] 10.222.0.60 () {56 vars in 1096 bytes} [Wed Sep 21 12:10:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:10:53.952581 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d68533-9e35-4ab8-b36f-780343be3691 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:54.054152 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:54.077666 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d68533-9e35-4ab8-b36f-780343be3691 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:54.118731 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1344d0-3966-403e-87f0-6f620bd7d41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:54.119347 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1344d0-3966-403e-87f0-6f620bd7d41a None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:54.119628 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1344d0-3966-403e-87f0-6f620bd7d41a None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:54.119897 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1344d0-3966-403e-87f0-6f620bd7d41a None admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:54.120592 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1344d0-3966-403e-87f0-6f620bd7d41a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:10:54.120894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1344d0-3966-403e-87f0-6f620bd7d41a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:54.122287 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1344d0-3966-403e-87f0-6f620bd7d41a None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:54.131943 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 635/1277] 10.222.0.60 () {56 vars in 1099 bytes} [Wed Sep 21 12:10:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:10:54.138304 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e9e3e1-183d-427b-8203-a7180f68f434 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:54.289336 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e9e3e1-183d-427b-8203-a7180f68f434 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:54.329277 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb429101-5879-4cdf-850d-8f0e0372dc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:54.329884 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb429101-5879-4cdf-850d-8f0e0372dc54 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:54.330212 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb429101-5879-4cdf-850d-8f0e0372dc54 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:54.330572 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb429101-5879-4cdf-850d-8f0e0372dc54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:54.342111 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb429101-5879-4cdf-850d-8f0e0372dc54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:54.344241 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb429101-5879-4cdf-850d-8f0e0372dc54 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:54.361948 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-fb429101-5879-4cdf-850d-8f0e0372dc54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:10:54.361948 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:10:54.361948 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:10:54.361948 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:10:54.361948 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:10:54.361948 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:10:54.361948 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:10:54.361948 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:10:54.361948 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:10:54.361948 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:10:54.361948 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:10:54.361948 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:10:54.361948 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:10:54.361948 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:10:54.361948 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:10:54.361948 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:10:54.363917 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:10:54.363917 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:10:54.363917 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:10:54.363917 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:10:54.363917 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:10:54.363917 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:10:54.363917 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:10:54.363917 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:10:54.363917 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:10:54.363917 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:10:54.363917 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:10:54.363917 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:10:54.363917 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:10:54.363917 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:10:54.363917 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:10:54.363917 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:10:54.363917 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:10:54.366025 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:10:54.366025 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:10:54.366025 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:10:54.366025 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 643/1278] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:10:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 12:10:54.370734 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1344d0-3966-403e-87f0-6f620bd7d41a None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:54.487245 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1344d0-3966-403e-87f0-6f620bd7d41a None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:54.527108 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918dbe30-912e-4143-8faa-d66ea6c7ae0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:54.527774 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918dbe30-912e-4143-8faa-d66ea6c7ae0c None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:54.528102 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918dbe30-912e-4143-8faa-d66ea6c7ae0c None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:54.528417 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918dbe30-912e-4143-8faa-d66ea6c7ae0c None admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:54.529114 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918dbe30-912e-4143-8faa-d66ea6c7ae0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:10:54.529460 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918dbe30-912e-4143-8faa-d66ea6c7ae0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:54.530936 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918dbe30-912e-4143-8faa-d66ea6c7ae0c None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:54.544741 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 636/1279] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:10:54.551385 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb429101-5879-4cdf-850d-8f0e0372dc54 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:54.591220 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:54.671417 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb429101-5879-4cdf-850d-8f0e0372dc54 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:54.710667 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845a05b-e691-48ab-b66b-b6fe113ce415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:54.711330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845a05b-e691-48ab-b66b-b6fe113ce415 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:54.711607 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845a05b-e691-48ab-b66b-b6fe113ce415 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:54.711880 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845a05b-e691-48ab-b66b-b6fe113ce415 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:54.720882 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845a05b-e691-48ab-b66b-b6fe113ce415 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:54.722357 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845a05b-e691-48ab-b66b-b6fe113ce415 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:54.735331 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-b845a05b-e691-48ab-b66b-b6fe113ce415 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 21 12:10:54.735331 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:10:54.735331 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:10:54.735331 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:10:54.735331 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:10:54.735331 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:10:54.735331 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:10:54.735331 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:10:54.735331 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:10:54.735331 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:10:54.735331 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:10:54.735331 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:10:54.735331 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 21 12:10:54.735331 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 21 12:10:54.735331 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 21 12:10:54.735331 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 21 12:10:54.737087 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:10:54.737087 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:10:54.737087 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 21 12:10:54.737087 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:10:54.737087 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 21 12:10:54.737087 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 21 12:10:54.737087 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:10:54.737087 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:10:54.737087 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:10:54.737087 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:10:54.737087 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:10:54.737087 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:10:54.737087 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:10:54.737087 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:10:54.737087 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:10:54.737087 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:10:54.737087 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:10:54.737087 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:10:54.738428 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:10:54.738428 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:10:54.738428 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 21 12:10:54.738428 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 21 12:10:54.738428 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 21 12:10:54.738428 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 21 12:10:54.738428 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 21 12:10:54.738428 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 21 12:10:54.738428 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 21 12:10:54.738428 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:10:54.738428 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 644/1280] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:10:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:10:54.742998 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918dbe30-912e-4143-8faa-d66ea6c7ae0c None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:54.747287 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:54.916856 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918dbe30-912e-4143-8faa-d66ea6c7ae0c None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:54.978320 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3734204-52ce-4345-b659-88d7907178bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:54.979364 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3734204-52ce-4345-b659-88d7907178bb None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:54.979857 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3734204-52ce-4345-b659-88d7907178bb None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:54.980331 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3734204-52ce-4345-b659-88d7907178bb None admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:54.981668 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3734204-52ce-4345-b659-88d7907178bb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:10:54.982200 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3734204-52ce-4345-b659-88d7907178bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:54.984992 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3734204-52ce-4345-b659-88d7907178bb None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:55.023757 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 637/1281] 10.222.0.60 () {56 vars in 1143 bytes} [Wed Sep 21 12:10:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:10:55.030118 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845a05b-e691-48ab-b66b-b6fe113ce415 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:55.135635 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:55.148229 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845a05b-e691-48ab-b66b-b6fe113ce415 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:55.187000 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7aff6a-3c58-4a8a-a506-805e13655e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:55.188043 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7aff6a-3c58-4a8a-a506-805e13655e06 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:55.188317 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7aff6a-3c58-4a8a-a506-805e13655e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:55.188584 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7aff6a-3c58-4a8a-a506-805e13655e06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:55.272514 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7aff6a-3c58-4a8a-a506-805e13655e06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:55.274001 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7aff6a-3c58-4a8a-a506-805e13655e06 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:55.381647 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:55.394219 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 645/1282] 10.222.0.60 () {58 vars in 1282 bytes} [Wed Sep 21 12:10:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 21 12:10:55.400435 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3734204-52ce-4345-b659-88d7907178bb None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:55.472517 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:55.519239 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3734204-52ce-4345-b659-88d7907178bb None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:55.559173 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0a72e-8e7c-446c-833d-dc6db0691870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:55.559827 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0a72e-8e7c-446c-833d-dc6db0691870 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:55.560108 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0a72e-8e7c-446c-833d-dc6db0691870 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:55.560377 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0a72e-8e7c-446c-833d-dc6db0691870 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:55.573181 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0a72e-8e7c-446c-833d-dc6db0691870 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:55.575296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0a72e-8e7c-446c-833d-dc6db0691870 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:55.592158 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-39b0a72e-8e7c-446c-833d-dc6db0691870 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:10:55.592158 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:10:55.592158 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:10:55.592158 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:10:55.592158 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:10:55.592158 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:10:55.592158 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:10:55.592158 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:10:55.592158 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:10:55.592158 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:10:55.592158 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:10:55.592158 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:10:55.592158 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 21 12:10:55.592158 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 21 12:10:55.592158 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 21 12:10:55.592158 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 21 12:10:55.593915 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:10:55.593915 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:10:55.593915 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:10:55.593915 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:10:55.593915 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:10:55.593915 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:10:55.593915 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:10:55.593915 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:10:55.593915 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:10:55.593915 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:10:55.593915 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:10:55.593915 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:10:55.593915 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:10:55.593915 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:10:55.593915 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:10:55.593915 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:10:55.593915 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 21 12:10:55.595406 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 21 12:10:55.595406 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 21 12:10:55.595406 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:10:55.595406 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 638/1283] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:10:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:10:55.599637 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7aff6a-3c58-4a8a-a506-805e13655e06 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:55.716839 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7aff6a-3c58-4a8a-a506-805e13655e06 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:55.757614 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d43d3-3ffa-47c4-aefb-8b8fc3f6e3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:55.758189 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d43d3-3ffa-47c4-aefb-8b8fc3f6e3cb None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:55.758557 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d43d3-3ffa-47c4-aefb-8b8fc3f6e3cb None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:55.758881 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d43d3-3ffa-47c4-aefb-8b8fc3f6e3cb None admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:55.759621 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d43d3-3ffa-47c4-aefb-8b8fc3f6e3cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:10:55.759961 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d43d3-3ffa-47c4-aefb-8b8fc3f6e3cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:55.761419 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d43d3-3ffa-47c4-aefb-8b8fc3f6e3cb None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:55.775329 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 646/1284] 10.222.0.60 () {56 vars in 1109 bytes} [Wed Sep 21 12:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:10:55.785517 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0a72e-8e7c-446c-833d-dc6db0691870 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:55.975356 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0a72e-8e7c-446c-833d-dc6db0691870 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:56.002669 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:56.041633 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d6217-09aa-4760-8892-804dd7917495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:56.042726 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d6217-09aa-4760-8892-804dd7917495 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:56.043225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d6217-09aa-4760-8892-804dd7917495 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:56.043694 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d6217-09aa-4760-8892-804dd7917495 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:56.056662 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d6217-09aa-4760-8892-804dd7917495 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:56.058222 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d6217-09aa-4760-8892-804dd7917495 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:56.071376 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application [None req-6b4d6217-09aa-4760-8892-804dd7917495 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:10:56.071376 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:10:56.071376 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:10:56.071376 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:10:56.071376 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:10:56.071376 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:10:56.071376 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:10:56.071376 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:10:56.071376 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:10:56.071376 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:10:56.071376 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:10:56.071376 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:10:56.071376 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 21 12:10:56.071376 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 21 12:10:56.071376 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 21 12:10:56.073030 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 21 12:10:56.073030 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:10:56.073030 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:10:56.073030 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:10:56.073030 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:10:56.073030 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:10:56.073030 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:10:56.073030 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:10:56.073030 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application with Lock( Sep 21 12:10:56.073030 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:10:56.073030 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:10:56.073030 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:10:56.073030 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:10:56.073030 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:10:56.073030 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:10:56.073030 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:10:56.073030 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:10:56.074872 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 21 12:10:56.074872 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 21 12:10:56.074872 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 21 12:10:56.074872 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 21 12:10:56.074872 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 21 12:10:56.074872 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 21 12:10:56.074872 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 21 12:10:56.074872 dv-cinder-858678-1-smb devstack@keystone.service[81377]: ERROR keystone.server.flask.application Sep 21 12:10:56.074872 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 639/1285] 10.222.0.60 () {56 vars in 1111 bytes} [Wed Sep 21 12:10:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:10:56.079602 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d43d3-3ffa-47c4-aefb-8b8fc3f6e3cb None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:56.137454 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:56.197670 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d43d3-3ffa-47c4-aefb-8b8fc3f6e3cb None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:56.242765 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcccab1-836e-420f-9fae-b0275073b990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:56.243392 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcccab1-836e-420f-9fae-b0275073b990 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:56.243673 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcccab1-836e-420f-9fae-b0275073b990 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:56.243946 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcccab1-836e-420f-9fae-b0275073b990 None admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:56.244655 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcccab1-836e-420f-9fae-b0275073b990 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:10:56.244958 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcccab1-836e-420f-9fae-b0275073b990 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:56.246471 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcccab1-836e-420f-9fae-b0275073b990 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:56.260665 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 647/1286] 10.222.0.60 () {56 vars in 1148 bytes} [Wed Sep 21 12:10:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:10:56.269756 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d6217-09aa-4760-8892-804dd7917495 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:56.389304 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d6217-09aa-4760-8892-804dd7917495 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:56.428420 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e5eda-215a-4aff-b3ca-be93214941b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:56.429054 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e5eda-215a-4aff-b3ca-be93214941b0 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:56.429337 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e5eda-215a-4aff-b3ca-be93214941b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:56.429609 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e5eda-215a-4aff-b3ca-be93214941b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:56.430645 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e5eda-215a-4aff-b3ca-be93214941b0 None admin] RBAC: Adding query filter params (role.id=72c80b472acb462ebadd86463efe91f7, scope.project.id=b0abcc6f2ce14825bfc26e6210889c21, user.id=74e866f134f64644bf33e3adecf207c4) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:10:56.430956 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e5eda-215a-4aff-b3ca-be93214941b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:56.432518 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e5eda-215a-4aff-b3ca-be93214941b0 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:56.440602 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 640/1287] 10.222.0.60 () {56 vars in 1374 bytes} [Wed Sep 21 12:10:56 2022] GET /identity/v3/role_assignments?user.id=74e866f134f64644bf33e3adecf207c4&scope.project.id=b0abcc6f2ce14825bfc26e6210889c21&role.id=72c80b472acb462ebadd86463efe91f7 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:10:58.749300 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9143936-ab26-4cb3-8df0-03a4f6b8cf1d None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:58.749895 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9143936-ab26-4cb3-8df0-03a4f6b8cf1d None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:58.749895 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9143936-ab26-4cb3-8df0-03a4f6b8cf1d None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:58.751494 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 648/1288] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:10:58.758668 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3cdca1-acc5-4927-96ea-ceeacaf4a9ed None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:58.759476 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3cdca1-acc5-4927-96ea-ceeacaf4a9ed None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:58.759657 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3cdca1-acc5-4927-96ea-ceeacaf4a9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:58.779695 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-bc3cdca1-acc5-4927-96ea-ceeacaf4a9ed None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:10:58.781045 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-bc3cdca1-acc5-4927-96ea-ceeacaf4a9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:10:58.816593 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:58.863095 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 641/1289] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:10:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:10:59.148087 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9143936-ab26-4cb3-8df0-03a4f6b8cf1d None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:59.309522 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9143936-ab26-4cb3-8df0-03a4f6b8cf1d None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:59.322792 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:10:59.349668 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ced3c-7a4a-416a-8a06-c90bd950ee15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:59.350691 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ced3c-7a4a-416a-8a06-c90bd950ee15 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:59.350984 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ced3c-7a4a-416a-8a06-c90bd950ee15 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:59.351259 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ced3c-7a4a-416a-8a06-c90bd950ee15 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:59.351857 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ced3c-7a4a-416a-8a06-c90bd950ee15 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:59.353266 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ced3c-7a4a-416a-8a06-c90bd950ee15 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:59.363560 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-2c4ced3c-7a4a-416a-8a06-c90bd950ee15 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 21 12:10:59.363560 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:10:59.363560 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 12:10:59.363560 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 12:10:59.363560 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 12:10:59.363560 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 12:10:59.363560 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 12:10:59.363560 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:10:59.363560 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 21 12:10:59.363560 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:10:59.363560 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 12:10:59.363560 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:10:59.363560 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:10:59.363560 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:10:59.363560 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:10:59.363560 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:10:59.363560 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:10:59.365789 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:10:59.365789 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:10:59.365789 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:10:59.365789 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:10:59.365789 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:10:59.365789 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:10:59.365789 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 12:10:59.365789 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 12:10:59.365789 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 12:10:59.365789 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 12:10:59.365789 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:10:59.365789 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:10:59.365789 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:10:59.365789 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:10:59.365789 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:10:59.365789 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:10:59.366957 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:10:59.366957 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:10:59.366957 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:10:59.366957 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:10:59.366957 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:10:59.366957 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:10:59.366957 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:10:59.366957 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:10:59.366957 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:10:59.366957 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:10:59.366957 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 12:10:59.366957 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:10:59.366957 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 21 12:10:59.366957 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:10:59.366957 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 649/1290] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Sep 21 12:10:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:10:59.371318 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3cdca1-acc5-4927-96ea-ceeacaf4a9ed None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:59.494020 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3cdca1-acc5-4927-96ea-ceeacaf4a9ed None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:59.536541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371bdda3-c40c-49f9-9464-c4e448424a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:59.537315 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371bdda3-c40c-49f9-9464-c4e448424a94 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:59.537651 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371bdda3-c40c-49f9-9464-c4e448424a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:59.537959 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371bdda3-c40c-49f9-9464-c4e448424a94 None admin] PATH_INFO: `/v3/services` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:59.538857 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371bdda3-c40c-49f9-9464-c4e448424a94 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:10:59.539167 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371bdda3-c40c-49f9-9464-c4e448424a94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:59.540793 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371bdda3-c40c-49f9-9464-c4e448424a94 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:59.547163 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 642/1291] 10.222.0.60 () {56 vars in 1116 bytes} [Wed Sep 21 12:10:59 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:10:59.554008 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ced3c-7a4a-416a-8a06-c90bd950ee15 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:10:59.688811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ced3c-7a4a-416a-8a06-c90bd950ee15 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:10:59.729241 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f65815-25a3-4d84-b1af-f8cf43fe4ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:10:59.729929 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f65815-25a3-4d84-b1af-f8cf43fe4ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:10:59.730253 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f65815-25a3-4d84-b1af-f8cf43fe4ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:10:59.730614 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f65815-25a3-4d84-b1af-f8cf43fe4ec2 None admin] PATH_INFO: `/v3/services` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:10:59.731319 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f65815-25a3-4d84-b1af-f8cf43fe4ec2 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:10:59.731665 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f65815-25a3-4d84-b1af-f8cf43fe4ec2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:10:59.733192 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f65815-25a3-4d84-b1af-f8cf43fe4ec2 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:10:59.738679 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 650/1292] 10.222.0.60 () {56 vars in 1116 bytes} [Wed Sep 21 12:10:59 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:11:02.039574 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab59e59-49d1-4db2-9fa0-b5e8b577e29a None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:11:02.040190 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab59e59-49d1-4db2-9fa0-b5e8b577e29a None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:11:02.040190 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab59e59-49d1-4db2-9fa0-b5e8b577e29a None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:11:02.041769 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 643/1293] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:11:02.048535 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb7f3c-c34b-4dba-a2a0-a8ad25e94c55 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:11:02.049368 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb7f3c-c34b-4dba-a2a0-a8ad25e94c55 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:11:02.049368 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb7f3c-c34b-4dba-a2a0-a8ad25e94c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:11:02.068766 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-cdfb7f3c-c34b-4dba-a2a0-a8ad25e94c55 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:11:02.070007 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-cdfb7f3c-c34b-4dba-a2a0-a8ad25e94c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:11:02.105927 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:11:02.149204 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 651/1294] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:11:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 21 12:11:02.435055 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab59e59-49d1-4db2-9fa0-b5e8b577e29a None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:11:02.472840 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:11:02.568443 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab59e59-49d1-4db2-9fa0-b5e8b577e29a None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:11:02.610153 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a6a16-2bf2-44ee-a726-1fe7a73e0e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:11:02.610806 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a6a16-2bf2-44ee-a726-1fe7a73e0e9b None admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:11:02.611079 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a6a16-2bf2-44ee-a726-1fe7a73e0e9b None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:11:02.611348 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a6a16-2bf2-44ee-a726-1fe7a73e0e9b None admin] PATH_INFO: `/v3/services` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:11:02.612020 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632a6a16-2bf2-44ee-a726-1fe7a73e0e9b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:11:02.613407 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632a6a16-2bf2-44ee-a726-1fe7a73e0e9b None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:11:02.631328 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 644/1295] 10.222.0.60 () {60 vars in 1141 bytes} [Wed Sep 21 12:11:02 2022] POST /identity/v3/services => generated 246 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:11:04.921711 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f1767-4672-4d1c-94a1-03f77d6298f0 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:11:04.922826 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f1767-4672-4d1c-94a1-03f77d6298f0 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:11:04.922826 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f1767-4672-4d1c-94a1-03f77d6298f0 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:11:04.923952 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 652/1296] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:11:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:11:04.929990 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ff2c5-024c-4320-8553-2448fbb0c40d None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:11:04.930595 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ff2c5-024c-4320-8553-2448fbb0c40d None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:11:04.930866 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ff2c5-024c-4320-8553-2448fbb0c40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:11:04.953271 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-713ff2c5-024c-4320-8553-2448fbb0c40d None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:11:04.954540 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-713ff2c5-024c-4320-8553-2448fbb0c40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:11:05.037530 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 645/1297] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:11:04 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:11:05.533087 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f1767-4672-4d1c-94a1-03f77d6298f0 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:11:05.652498 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f1767-4672-4d1c-94a1-03f77d6298f0 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:11:05.692324 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc1269-6e1e-4dfa-bfd1-393542315f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:11:05.692968 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc1269-6e1e-4dfa-bfd1-393542315f26 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:11:05.693248 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc1269-6e1e-4dfa-bfd1-393542315f26 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:11:05.693520 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc1269-6e1e-4dfa-bfd1-393542315f26 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:11:05.694162 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bc1269-6e1e-4dfa-bfd1-393542315f26 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:11:05.695608 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bc1269-6e1e-4dfa-bfd1-393542315f26 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:11:05.705365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-97bc1269-6e1e-4dfa-bfd1-393542315f26 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 21 12:11:05.705365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:11:05.705365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 12:11:05.705365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 12:11:05.705365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 12:11:05.705365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 12:11:05.705365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 12:11:05.705365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:11:05.705365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 21 12:11:05.705365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:11:05.705365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 12:11:05.705365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:11:05.705365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:11:05.705365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:11:05.705365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:11:05.705365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:11:05.705365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:11:05.707348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:11:05.707348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:11:05.707348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:11:05.707348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:11:05.707348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:11:05.707348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:11:05.707348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 12:11:05.707348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 12:11:05.707348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 12:11:05.707348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 12:11:05.707348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:11:05.707348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:11:05.707348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:11:05.707348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:11:05.707348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:11:05.707348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:11:05.708387 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:11:05.708387 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:11:05.708387 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:11:05.708387 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:11:05.708387 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:11:05.708387 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:11:05.708387 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:11:05.708387 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:11:05.708387 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:11:05.708387 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:11:05.708387 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 12:11:05.708387 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:11:05.708387 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 21 12:11:05.708387 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:11:05.708387 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 653/1298] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Sep 21 12:11:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 21 12:11:05.712898 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ff2c5-024c-4320-8553-2448fbb0c40d None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:11:05.734102 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:11:05.834956 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ff2c5-024c-4320-8553-2448fbb0c40d None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:11:05.874513 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75996fa1-34ec-4ddc-9aa9-426622698bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:11:05.875683 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75996fa1-34ec-4ddc-9aa9-426622698bb3 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:11:05.875962 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75996fa1-34ec-4ddc-9aa9-426622698bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:11:05.876232 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75996fa1-34ec-4ddc-9aa9-426622698bb3 None admin] PATH_INFO: `/v3/services` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:11:05.876880 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75996fa1-34ec-4ddc-9aa9-426622698bb3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:11:05.877180 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75996fa1-34ec-4ddc-9aa9-426622698bb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:11:05.878612 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75996fa1-34ec-4ddc-9aa9-426622698bb3 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:11:05.884447 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 646/1299] 10.222.0.60 () {56 vars in 1116 bytes} [Wed Sep 21 12:11:05 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:11:05.891111 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc1269-6e1e-4dfa-bfd1-393542315f26 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:11:05.925894 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:11:06.007275 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc1269-6e1e-4dfa-bfd1-393542315f26 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:11:06.044925 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3668a5-818f-47cc-8f0e-6750b0b93d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:11:06.045613 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3668a5-818f-47cc-8f0e-6750b0b93d9e None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:11:06.045940 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3668a5-818f-47cc-8f0e-6750b0b93d9e None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:11:06.046285 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3668a5-818f-47cc-8f0e-6750b0b93d9e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:11:06.047084 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3668a5-818f-47cc-8f0e-6750b0b93d9e None admin] RBAC: Adding query filter params (interface=public, service_id=f0f4fd87ffc54a9d884128e79c94628a, region_id=RegionOne) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:11:06.047426 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3668a5-818f-47cc-8f0e-6750b0b93d9e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:11:06.048860 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3668a5-818f-47cc-8f0e-6750b0b93d9e None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:11:06.054819 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 654/1300] 10.222.0.60 () {56 vars in 1251 bytes} [Wed Sep 21 12:11:05 2022] GET /identity/v3/endpoints?service_id=f0f4fd87ffc54a9d884128e79c94628a&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:11:06.061049 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75996fa1-34ec-4ddc-9aa9-426622698bb3 None admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:11:06.163181 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:11:06.186984 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75996fa1-34ec-4ddc-9aa9-426622698bb3 None admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:11:06.226565 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e1ef23-33ef-4d11-a500-4548305d81a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:11:06.227297 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1ef23-33ef-4d11-a500-4548305d81a2 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:11:06.227582 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1ef23-33ef-4d11-a500-4548305d81a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:11:06.227854 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1ef23-33ef-4d11-a500-4548305d81a2 None admin] PATH_INFO: `/v3/services` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:11:06.228465 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e1ef23-33ef-4d11-a500-4548305d81a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:11:06.229894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e1ef23-33ef-4d11-a500-4548305d81a2 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:11:06.238233 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 647/1301] 10.222.0.60 () {56 vars in 1087 bytes} [Wed Sep 21 12:11:06 2022] GET /identity/v3/services => generated 2191 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:11:08.527496 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14629f-fcc8-4496-9be7-96df37bbac06 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:11:08.528316 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14629f-fcc8-4496-9be7-96df37bbac06 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:11:08.528468 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14629f-fcc8-4496-9be7-96df37bbac06 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:11:08.529878 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 655/1302] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:11:08.537444 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e5830-9444-4f10-ba91-d79e38c34eb6 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:11:08.538051 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e5830-9444-4f10-ba91-d79e38c34eb6 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:11:08.538470 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e5830-9444-4f10-ba91-d79e38c34eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:11:08.565444 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-082e5830-9444-4f10-ba91-d79e38c34eb6 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:11:08.566797 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-082e5830-9444-4f10-ba91-d79e38c34eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:11:08.680162 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 648/1303] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:11:08 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 21 12:11:08.983413 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14629f-fcc8-4496-9be7-96df37bbac06 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:11:09.103921 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:11:09.114142 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af14629f-fcc8-4496-9be7-96df37bbac06 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:11:09.157055 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e84546-3ec6-40ac-b7bc-99b5732119d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:11:09.157693 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e84546-3ec6-40ac-b7bc-99b5732119d3 None admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:11:09.157969 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e84546-3ec6-40ac-b7bc-99b5732119d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:11:09.158241 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e84546-3ec6-40ac-b7bc-99b5732119d3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:11:09.158862 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e84546-3ec6-40ac-b7bc-99b5732119d3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:11:09.160258 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e84546-3ec6-40ac-b7bc-99b5732119d3 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:11:09.172921 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application [None req-21e84546-3ec6-40ac-b7bc-99b5732119d3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 21 12:11:09.172921 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:11:09.172921 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 21 12:11:09.172921 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 21 12:11:09.172921 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 21 12:11:09.172921 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 21 12:11:09.172921 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 21 12:11:09.172921 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:11:09.172921 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 21 12:11:09.172921 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:11:09.172921 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 21 12:11:09.172921 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:11:09.172921 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 21 12:11:09.172921 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 21 12:11:09.172921 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 21 12:11:09.172921 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 21 12:11:09.172921 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 21 12:11:09.178985 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 21 12:11:09.178985 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 21 12:11:09.178985 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 21 12:11:09.178985 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 21 12:11:09.178985 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 21 12:11:09.178985 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 21 12:11:09.178985 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 21 12:11:09.178985 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 21 12:11:09.178985 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 21 12:11:09.178985 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 21 12:11:09.178985 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 21 12:11:09.178985 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 21 12:11:09.178985 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 21 12:11:09.178985 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 21 12:11:09.178985 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 21 12:11:09.178985 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.get_or_create( Sep 21 12:11:09.180082 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 21 12:11:09.180082 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application with Lock( Sep 21 12:11:09.180082 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 21 12:11:09.180082 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self._enter() Sep 21 12:11:09.180082 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 21 12:11:09.180082 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 21 12:11:09.180082 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 21 12:11:09.180082 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application return self.creator() Sep 21 12:11:09.180082 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 21 12:11:09.180082 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application created_value = creator( Sep 21 12:11:09.180082 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 21 12:11:09.180082 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 21 12:11:09.180082 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 21 12:11:09.180082 dv-cinder-858678-1-smb devstack@keystone.service[81378]: ERROR keystone.server.flask.application Sep 21 12:11:09.180082 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 656/1304] 10.222.0.60 () {56 vars in 1117 bytes} [Wed Sep 21 12:11:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 21 12:11:09.181780 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e5830-9444-4f10-ba91-d79e38c34eb6 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:11:09.285036 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:11:09.314539 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e5830-9444-4f10-ba91-d79e38c34eb6 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:11:09.356359 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c3db0-5123-4c3c-81ab-9ab00bd07e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:11:09.357053 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c3db0-5123-4c3c-81ab-9ab00bd07e72 None admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:11:09.357364 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c3db0-5123-4c3c-81ab-9ab00bd07e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:11:09.357659 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c3db0-5123-4c3c-81ab-9ab00bd07e72 None admin] PATH_INFO: `/v3/services` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:11:09.358343 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c3db0-5123-4c3c-81ab-9ab00bd07e72 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:11:09.358711 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c3db0-5123-4c3c-81ab-9ab00bd07e72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:11:09.360422 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c3db0-5123-4c3c-81ab-9ab00bd07e72 None admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:11:09.366329 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 649/1305] 10.222.0.60 () {56 vars in 1116 bytes} [Wed Sep 21 12:11:09 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:11:09.376503 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e84546-3ec6-40ac-b7bc-99b5732119d3 None admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:11:09.552145 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e84546-3ec6-40ac-b7bc-99b5732119d3 None admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:11:09.600440 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602d648-2322-46e3-a334-a83a3afe1f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:11:09.601460 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602d648-2322-46e3-a334-a83a3afe1f82 None admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:11:09.601916 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602d648-2322-46e3-a334-a83a3afe1f82 None admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:11:09.602413 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602d648-2322-46e3-a334-a83a3afe1f82 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:11:09.603622 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602d648-2322-46e3-a334-a83a3afe1f82 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:11:09.605882 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602d648-2322-46e3-a334-a83a3afe1f82 None admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:11:09.636669 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 657/1306] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:11:09 2022] POST /identity/v3/endpoints => generated 331 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:11:19.363171 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=30 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:11:19.629696 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:12:24.551426 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9612f-3540-4266-9833-3d08ab093ee9 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:12:24.552394 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9612f-3540-4266-9833-3d08ab093ee9 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:12:24.552828 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9612f-3540-4266-9833-3d08ab093ee9 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:12:24.566664 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966b160-753f-4b69-9ca5-f1d774ed28b9 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:12:24.567762 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966b160-753f-4b69-9ca5-f1d774ed28b9 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:12:24.568257 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966b160-753f-4b69-9ca5-f1d774ed28b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:12:24.574475 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 650/1307] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:12:24 2022] GET /identity => generated 270 bytes in 24 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:12:24.679162 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-3966b160-753f-4b69-9ca5-f1d774ed28b9 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:12:24.680431 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-3966b160-753f-4b69-9ca5-f1d774ed28b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:12:24.826293 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 658/1308] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:12:25.135326 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d4120-a4c9-49ea-ae5f-48be02975de4 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:12:25.135996 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d4120-a4c9-49ea-ae5f-48be02975de4 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:12:25.136538 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d4120-a4c9-49ea-ae5f-48be02975de4 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:12:25.138557 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 651/1309] 10.222.0.60 () {54 vars in 963 bytes} [Wed Sep 21 12:12:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:12:25.146728 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e13ef0-9683-4594-8295-fe809eb105a3 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:12:25.147388 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e13ef0-9683-4594-8295-fe809eb105a3 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:12:25.147869 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e13ef0-9683-4594-8295-fe809eb105a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:12:25.253445 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-14e13ef0-9683-4594-8295-fe809eb105a3 None None] MFA Rules not processed for user `ab0521c25c2d4417944efa4745588f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:12:25.255656 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-14e13ef0-9683-4594-8295-fe809eb105a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:12:25.286614 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:12:25.369160 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 659/1310] 10.222.0.60 () {58 vars in 1060 bytes} [Wed Sep 21 12:12:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:12:25.380217 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d4120-a4c9-49ea-ae5f-48be02975de4 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:12:25.383109 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-401d4120-a4c9-49ea-ae5f-48be02975de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:12:25.544458 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d4120-a4c9-49ea-ae5f-48be02975de4 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:12:25.729171 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e74fc58-093d-4fb4-b2a5-e2ed1e6a6f57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:12:25.731504 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74fc58-093d-4fb4-b2a5-e2ed1e6a6f57 service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:12:25.732332 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74fc58-093d-4fb4-b2a5-e2ed1e6a6f57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:12:25.733308 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74fc58-093d-4fb4-b2a5-e2ed1e6a6f57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:12:25.737444 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-8e74fc58-093d-4fb4-b2a5-e2ed1e6a6f57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:12:25.875158 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:12:26.025482 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e74fc58-093d-4fb4-b2a5-e2ed1e6a6f57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:12:26.028774 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e74fc58-093d-4fb4-b2a5-e2ed1e6a6f57 service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:12:26.072991 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 652/1311] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:12:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 693 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:12:29.939564 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177abb3-fefd-492b-8121-be6d8399951b None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:12:29.940097 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177abb3-fefd-492b-8121-be6d8399951b None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:12:29.940212 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177abb3-fefd-492b-8121-be6d8399951b None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:12:29.941559 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 660/1312] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:12:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:12:29.947613 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e4c5a-a9d7-4c57-8cb0-d9867d03af9a None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:12:29.948204 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e4c5a-a9d7-4c57-8cb0-d9867d03af9a None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:12:29.948204 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e4c5a-a9d7-4c57-8cb0-d9867d03af9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:12:30.032681 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-c22e4c5a-a9d7-4c57-8cb0-d9867d03af9a None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:12:30.034021 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-c22e4c5a-a9d7-4c57-8cb0-d9867d03af9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:12:30.155566 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 653/1313] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:12:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:12:30.447693 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8177abb3-fefd-492b-8121-be6d8399951b None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:12:30.449745 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-8177abb3-fefd-492b-8121-be6d8399951b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:12:30.593015 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8177abb3-fefd-492b-8121-be6d8399951b None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:12:30.707680 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:12:30.711877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d042738a-925e-4a47-9659-6757c6b184e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:12:30.712872 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042738a-925e-4a47-9659-6757c6b184e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:12:30.713439 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042738a-925e-4a47-9659-6757c6b184e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:12:30.714152 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042738a-925e-4a47-9659-6757c6b184e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:12:30.716492 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d042738a-925e-4a47-9659-6757c6b184e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:12:30.853041 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d042738a-925e-4a47-9659-6757c6b184e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:12:30.854715 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d042738a-925e-4a47-9659-6757c6b184e0 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:12:30.877023 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 661/1314] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:12:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:12:33.564011 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d03b92-4943-4570-97d3-61eab018afa2 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:12:33.564597 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d03b92-4943-4570-97d3-61eab018afa2 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:12:33.564597 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d03b92-4943-4570-97d3-61eab018afa2 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:12:33.565911 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 654/1315] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:12:33.572199 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa890a5-f8a2-4a37-b378-0f6c4ae1a5f1 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:12:33.572842 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa890a5-f8a2-4a37-b378-0f6c4ae1a5f1 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:12:33.572842 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa890a5-f8a2-4a37-b378-0f6c4ae1a5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:12:33.655591 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-0aa890a5-f8a2-4a37-b378-0f6c4ae1a5f1 None None] MFA Rules not processed for user `96c3d608c85140b1bcd4f716a3c47b7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:12:33.656855 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-0aa890a5-f8a2-4a37-b378-0f6c4ae1a5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:12:33.716931 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:12:33.768603 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 662/1316] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:12:33 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:12:34.066066 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d03b92-4943-4570-97d3-61eab018afa2 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:12:34.067745 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-c7d03b92-4943-4570-97d3-61eab018afa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:12:34.079012 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:12:34.194072 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d03b92-4943-4570-97d3-61eab018afa2 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:12:34.277711 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c42a4-e67e-481b-98fe-496ebe9177fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:12:34.278447 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c42a4-e67e-481b-98fe-496ebe9177fe service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:12:34.278764 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c42a4-e67e-481b-98fe-496ebe9177fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:12:34.279038 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c42a4-e67e-481b-98fe-496ebe9177fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:12:34.281306 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-a51c42a4-e67e-481b-98fe-496ebe9177fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:12:34.352396 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:12:34.412715 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c42a4-e67e-481b-98fe-496ebe9177fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:12:34.415306 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c42a4-e67e-481b-98fe-496ebe9177fe service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:12:34.446381 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 655/1317] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:12:34 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:12:37.295869 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3093b6-c96f-43dc-ba53-365270b1afd3 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:12:37.296418 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3093b6-c96f-43dc-ba53-365270b1afd3 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:12:37.296418 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3093b6-c96f-43dc-ba53-365270b1afd3 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:12:37.297776 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 663/1318] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:12:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:12:37.303941 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca4fd4-9d0d-4405-b94a-2aa1b4dff6c2 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:12:37.304509 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca4fd4-9d0d-4405-b94a-2aa1b4dff6c2 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:12:37.304509 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca4fd4-9d0d-4405-b94a-2aa1b4dff6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:12:37.379349 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-5aca4fd4-9d0d-4405-b94a-2aa1b4dff6c2 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:12:37.380599 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-5aca4fd4-9d0d-4405-b94a-2aa1b4dff6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:12:37.486995 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 656/1319] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:12:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:12:37.804343 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad5b3d-1fc5-491c-961f-b4dc9ebdcb9c None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:12:37.804632 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad5b3d-1fc5-491c-961f-b4dc9ebdcb9c None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:12:37.804889 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad5b3d-1fc5-491c-961f-b4dc9ebdcb9c None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:12:37.806241 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 664/1320] 10.222.0.60 () {54 vars in 963 bytes} [Wed Sep 21 12:12:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:12:37.813334 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1486f63-a2ee-4b57-9998-50e0b3ad352e None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:12:37.813632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1486f63-a2ee-4b57-9998-50e0b3ad352e None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:12:37.813881 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1486f63-a2ee-4b57-9998-50e0b3ad352e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:12:37.840090 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:12:37.898861 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-f1486f63-a2ee-4b57-9998-50e0b3ad352e None None] MFA Rules not processed for user `ab0521c25c2d4417944efa4745588f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:12:37.900105 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-f1486f63-a2ee-4b57-9998-50e0b3ad352e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:12:37.982205 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 657/1321] 10.222.0.60 () {58 vars in 1060 bytes} [Wed Sep 21 12:12:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:12:37.992048 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad5b3d-1fc5-491c-961f-b4dc9ebdcb9c None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:12:37.993613 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b8ad5b3d-1fc5-491c-961f-b4dc9ebdcb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:12:38.110429 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad5b3d-1fc5-491c-961f-b4dc9ebdcb9c None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:12:38.196585 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0826277-8099-443a-82e9-3619b3a71313 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:12:38.197196 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0826277-8099-443a-82e9-3619b3a71313 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:12:38.197473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0826277-8099-443a-82e9-3619b3a71313 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:12:38.197743 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0826277-8099-443a-82e9-3619b3a71313 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:12:38.199609 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a0826277-8099-443a-82e9-3619b3a71313 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:12:38.207730 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:12:38.331684 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0826277-8099-443a-82e9-3619b3a71313 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:12:38.333160 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0826277-8099-443a-82e9-3619b3a71313 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:12:38.353631 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 665/1322] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:12:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:12:41.970551 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6323c65-6408-4445-8d08-37d1f77d88fd None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:12:41.971348 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6323c65-6408-4445-8d08-37d1f77d88fd None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:12:41.971348 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6323c65-6408-4445-8d08-37d1f77d88fd None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:12:41.972708 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 658/1323] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:12:41.979547 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42a549-ebec-49de-9f32-86542c3dc803 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:12:41.980308 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42a549-ebec-49de-9f32-86542c3dc803 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:12:41.980557 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42a549-ebec-49de-9f32-86542c3dc803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:12:42.103946 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-4c42a549-ebec-49de-9f32-86542c3dc803 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:12:42.106012 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-4c42a549-ebec-49de-9f32-86542c3dc803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:12:42.214045 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:12:42.274944 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 666/1324] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:12:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:12:42.714050 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6323c65-6408-4445-8d08-37d1f77d88fd None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:12:42.715905 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-b6323c65-6408-4445-8d08-37d1f77d88fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:12:42.876731 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6323c65-6408-4445-8d08-37d1f77d88fd None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:12:42.895618 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:12:43.020528 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6fe78-5c7a-4a40-af43-240ac280a2e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:12:43.021251 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6fe78-5c7a-4a40-af43-240ac280a2e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:12:43.021418 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6fe78-5c7a-4a40-af43-240ac280a2e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:12:43.021686 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6fe78-5c7a-4a40-af43-240ac280a2e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:12:43.023476 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-74b6fe78-5c7a-4a40-af43-240ac280a2e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:12:43.227628 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6fe78-5c7a-4a40-af43-240ac280a2e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:12:43.230204 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6fe78-5c7a-4a40-af43-240ac280a2e2 service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:12:43.268090 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 659/1325] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:12:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:12:45.712378 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98419d-6004-4c5a-8a13-5af5a936b6a8 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:12:45.712945 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98419d-6004-4c5a-8a13-5af5a936b6a8 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:12:45.713282 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f98419d-6004-4c5a-8a13-5af5a936b6a8 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:12:45.715946 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 667/1326] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:12:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:12:45.725350 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a287125-5d7c-42cf-9cf2-d10a0e78a938 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:12:45.726206 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a287125-5d7c-42cf-9cf2-d10a0e78a938 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:12:45.726206 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a287125-5d7c-42cf-9cf2-d10a0e78a938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:12:45.811759 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:12:45.835949 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-7a287125-5d7c-42cf-9cf2-d10a0e78a938 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:12:45.837269 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-7a287125-5d7c-42cf-9cf2-d10a0e78a938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:12:45.966014 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 660/1327] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:12:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:12:46.301214 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98419d-6004-4c5a-8a13-5af5a936b6a8 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:12:46.302917 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-0f98419d-6004-4c5a-8a13-5af5a936b6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:12:46.477619 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f98419d-6004-4c5a-8a13-5af5a936b6a8 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:12:46.630952 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf0987-b4c7-4574-a5aa-3f1d6629b06c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:12:46.632019 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf0987-b4c7-4574-a5aa-3f1d6629b06c service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:12:46.632523 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf0987-b4c7-4574-a5aa-3f1d6629b06c service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:12:46.633012 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf0987-b4c7-4574-a5aa-3f1d6629b06c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:12:46.635809 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7cbf0987-b4c7-4574-a5aa-3f1d6629b06c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:12:46.674943 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:12:46.829546 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf0987-b4c7-4574-a5aa-3f1d6629b06c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:12:46.831532 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf0987-b4c7-4574-a5aa-3f1d6629b06c service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:12:46.854155 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 668/1328] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:12:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:12:50.726838 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d34687-0b21-4136-9bce-7b0b5e4fffcd None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:12:50.727755 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d34687-0b21-4136-9bce-7b0b5e4fffcd None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:12:50.727755 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d34687-0b21-4136-9bce-7b0b5e4fffcd None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:12:50.729466 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 661/1329] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:12:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:12:50.737989 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a860f-1676-40c2-ac89-b651c12e67fe None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:12:50.738888 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a860f-1676-40c2-ac89-b651c12e67fe None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:12:50.738888 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a860f-1676-40c2-ac89-b651c12e67fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:12:50.818174 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-4c2a860f-1676-40c2-ac89-b651c12e67fe None None] MFA Rules not processed for user `96c3d608c85140b1bcd4f716a3c47b7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:12:50.819485 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-4c2a860f-1676-40c2-ac89-b651c12e67fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:12:50.911584 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:12:50.970207 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 669/1330] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:12:50 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:12:51.259074 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d34687-0b21-4136-9bce-7b0b5e4fffcd None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:12:51.260908 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-c7d34687-0b21-4136-9bce-7b0b5e4fffcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:12:51.439190 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d34687-0b21-4136-9bce-7b0b5e4fffcd None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:12:51.463462 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:12:51.524460 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976264e2-97a2-446d-8d20-e5c0b33a8fe9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:12:51.525074 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976264e2-97a2-446d-8d20-e5c0b33a8fe9 service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:12:51.525348 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976264e2-97a2-446d-8d20-e5c0b33a8fe9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:12:51.525615 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976264e2-97a2-446d-8d20-e5c0b33a8fe9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:12:51.527318 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-976264e2-97a2-446d-8d20-e5c0b33a8fe9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:12:51.659241 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976264e2-97a2-446d-8d20-e5c0b33a8fe9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:12:51.660858 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976264e2-97a2-446d-8d20-e5c0b33a8fe9 service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:12:51.681364 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 662/1331] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:12:51 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:12:54.336261 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba40ae-e5fe-4a55-85df-ce1ce30abaae None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:12:54.336842 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba40ae-e5fe-4a55-85df-ce1ce30abaae None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:12:54.336842 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba40ae-e5fe-4a55-85df-ce1ce30abaae None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:12:54.338165 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 670/1332] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:12:54.345075 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3f95c-9ad3-4521-a1ab-a74db2adc82e None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:12:54.345685 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3f95c-9ad3-4521-a1ab-a74db2adc82e None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:12:54.345685 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3f95c-9ad3-4521-a1ab-a74db2adc82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:12:54.427157 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:12:54.430467 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-26d3f95c-9ad3-4521-a1ab-a74db2adc82e None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:12:54.432547 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-26d3f95c-9ad3-4521-a1ab-a74db2adc82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:12:54.566505 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 663/1333] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:12:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:12:54.858804 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba40ae-e5fe-4a55-85df-ce1ce30abaae None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:12:54.860381 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ebba40ae-e5fe-4a55-85df-ce1ce30abaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:12:54.983819 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba40ae-e5fe-4a55-85df-ce1ce30abaae None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:12:55.073208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc4da6-5aec-4935-872f-b17af753c0ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:12:55.073809 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc4da6-5aec-4935-872f-b17af753c0ea service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:12:55.074084 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc4da6-5aec-4935-872f-b17af753c0ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:12:55.074349 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc4da6-5aec-4935-872f-b17af753c0ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:12:55.076666 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-bcdc4da6-5aec-4935-872f-b17af753c0ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:12:55.108971 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:12:55.210442 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc4da6-5aec-4935-872f-b17af753c0ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:12:55.212215 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc4da6-5aec-4935-872f-b17af753c0ea service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:12:55.238877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 671/1334] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:12:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:12:57.597544 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ab2b7-03b5-4755-a807-c52d8b575378 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:12:57.598128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ab2b7-03b5-4755-a807-c52d8b575378 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:12:57.598128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ab2b7-03b5-4755-a807-c52d8b575378 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:12:57.599485 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 664/1335] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:12:57.608527 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbb279-ecf8-4fa6-b1df-06132af4c2c7 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:12:57.609087 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbb279-ecf8-4fa6-b1df-06132af4c2c7 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:12:57.616678 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbb279-ecf8-4fa6-b1df-06132af4c2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:12:57.702500 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-dcbbb279-ecf8-4fa6-b1df-06132af4c2c7 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:12:57.703949 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-dcbbb279-ecf8-4fa6-b1df-06132af4c2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:12:57.791935 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:12:57.818893 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 672/1336] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:12:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:12:58.117968 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ab2b7-03b5-4755-a807-c52d8b575378 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:12:58.119653 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-1a0ab2b7-03b5-4755-a807-c52d8b575378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:12:58.245742 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ab2b7-03b5-4755-a807-c52d8b575378 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:12:58.279551 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:12:58.334204 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc9dbd-13da-4611-ba94-3aaa530c7fa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:12:58.334851 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc9dbd-13da-4611-ba94-3aaa530c7fa4 service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:12:58.335122 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc9dbd-13da-4611-ba94-3aaa530c7fa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:12:58.335384 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc9dbd-13da-4611-ba94-3aaa530c7fa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:12:58.337056 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-1adc9dbd-13da-4611-ba94-3aaa530c7fa4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:12:58.472509 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc9dbd-13da-4611-ba94-3aaa530c7fa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:12:58.473968 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc9dbd-13da-4611-ba94-3aaa530c7fa4 service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:12:58.495910 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 665/1337] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:12:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:13:01.242212 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26873f60-e001-47a4-b337-0a4a5816aad8 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:13:01.243052 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26873f60-e001-47a4-b337-0a4a5816aad8 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:13:01.243240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26873f60-e001-47a4-b337-0a4a5816aad8 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:13:01.244971 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 673/1338] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:13:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:13:01.252545 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806f63c-b83e-4fe5-b833-546473b48560 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:13:01.253174 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806f63c-b83e-4fe5-b833-546473b48560 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:13:01.253536 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806f63c-b83e-4fe5-b833-546473b48560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:13:01.350315 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-7806f63c-b83e-4fe5-b833-546473b48560 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:13:01.351591 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-7806f63c-b83e-4fe5-b833-546473b48560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:13:01.360975 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:13:01.458867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 666/1339] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:13:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:13:01.749293 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26873f60-e001-47a4-b337-0a4a5816aad8 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:13:01.751040 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-26873f60-e001-47a4-b337-0a4a5816aad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:13:01.865927 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26873f60-e001-47a4-b337-0a4a5816aad8 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:13:01.951967 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9823923-3d6e-41b1-a628-11774614fa67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:13:01.952589 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9823923-3d6e-41b1-a628-11774614fa67 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:13:01.952881 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9823923-3d6e-41b1-a628-11774614fa67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:13:01.953138 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9823923-3d6e-41b1-a628-11774614fa67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:13:01.954912 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f9823923-3d6e-41b1-a628-11774614fa67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:13:01.998205 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:13:02.087265 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9823923-3d6e-41b1-a628-11774614fa67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:13:02.088736 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9823923-3d6e-41b1-a628-11774614fa67 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:13:02.109450 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 674/1340] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:13:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:13:07.050836 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b8d7e-1f63-43de-a403-aaa828d820f8 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:13:07.051392 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b8d7e-1f63-43de-a403-aaa828d820f8 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:13:07.051392 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b8d7e-1f63-43de-a403-aaa828d820f8 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:13:07.053085 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 667/1341] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:13:07.059003 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c34ba-7e1a-41f6-a040-c4ecb0cc7655 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:13:07.059545 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c34ba-7e1a-41f6-a040-c4ecb0cc7655 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:13:07.059545 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c34ba-7e1a-41f6-a040-c4ecb0cc7655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:13:07.161014 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-676c34ba-7e1a-41f6-a040-c4ecb0cc7655 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:13:07.162441 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-676c34ba-7e1a-41f6-a040-c4ecb0cc7655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:13:07.301333 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:13:07.319218 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 675/1342] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:13:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:13:07.729094 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b8d7e-1f63-43de-a403-aaa828d820f8 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:13:07.730862 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-ff7b8d7e-1f63-43de-a403-aaa828d820f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:13:07.894053 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b8d7e-1f63-43de-a403-aaa828d820f8 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:13:07.962645 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:13:08.017174 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5419ff7-2c4f-4dd9-86b2-775a6521ed24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:13:08.018218 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5419ff7-2c4f-4dd9-86b2-775a6521ed24 service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:13:08.018753 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5419ff7-2c4f-4dd9-86b2-775a6521ed24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:13:08.019207 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5419ff7-2c4f-4dd9-86b2-775a6521ed24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:13:08.022422 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-a5419ff7-2c4f-4dd9-86b2-775a6521ed24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:13:08.246977 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5419ff7-2c4f-4dd9-86b2-775a6521ed24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:13:08.250072 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5419ff7-2c4f-4dd9-86b2-775a6521ed24 service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:13:08.283010 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 668/1343] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:13:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:13:11.572033 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76a79a-84fc-4ed3-8b18-2407a7c0ec9b None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:13:11.572827 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76a79a-84fc-4ed3-8b18-2407a7c0ec9b None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:13:11.573151 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76a79a-84fc-4ed3-8b18-2407a7c0ec9b None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:13:11.576362 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 676/1344] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:13:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:13:11.582600 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a5dd4-74c4-4881-aa55-feac05dc926e None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:13:11.583428 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a5dd4-74c4-4881-aa55-feac05dc926e None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:13:11.583651 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a5dd4-74c4-4881-aa55-feac05dc926e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:13:11.671819 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-1d1a5dd4-74c4-4881-aa55-feac05dc926e None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:13:11.673071 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-1d1a5dd4-74c4-4881-aa55-feac05dc926e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:13:11.696356 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:13:11.816173 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 669/1345] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:13:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:13:12.103928 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a76a79a-84fc-4ed3-8b18-2407a7c0ec9b None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:13:12.105622 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7a76a79a-84fc-4ed3-8b18-2407a7c0ec9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:13:12.244680 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a76a79a-84fc-4ed3-8b18-2407a7c0ec9b None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:13:12.339221 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8684ada4-df89-4eee-af98-9482f78da2c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:13:12.339935 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684ada4-df89-4eee-af98-9482f78da2c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:13:12.340274 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684ada4-df89-4eee-af98-9482f78da2c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:13:12.340633 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684ada4-df89-4eee-af98-9482f78da2c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:13:12.343114 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-8684ada4-df89-4eee-af98-9482f78da2c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:13:12.396868 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:13:12.479617 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8684ada4-df89-4eee-af98-9482f78da2c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:13:12.481104 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8684ada4-df89-4eee-af98-9482f78da2c4 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:13:12.503139 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 677/1346] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:13:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:13:17.409439 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6ec5b-9251-4e28-9842-52ebf50a1092 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:13:17.410261 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6ec5b-9251-4e28-9842-52ebf50a1092 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:13:17.410261 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6ec5b-9251-4e28-9842-52ebf50a1092 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:13:17.411459 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 670/1347] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:13:17.417431 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd6474-4ba6-4130-b612-a7dd888772e5 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:13:17.418217 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd6474-4ba6-4130-b612-a7dd888772e5 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:13:17.418217 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd6474-4ba6-4130-b612-a7dd888772e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:13:17.504485 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-00cd6474-4ba6-4130-b612-a7dd888772e5 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:13:17.506741 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-00cd6474-4ba6-4130-b612-a7dd888772e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:13:17.668938 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:13:17.673355 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 678/1348] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:13:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:13:17.967648 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6ec5b-9251-4e28-9842-52ebf50a1092 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:13:17.970339 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-c3c6ec5b-9251-4e28-9842-52ebf50a1092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:13:18.111318 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6ec5b-9251-4e28-9842-52ebf50a1092 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:13:18.172695 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:13:18.215705 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca869a8d-291f-4db0-8c32-054f4900d16f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:13:18.216908 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca869a8d-291f-4db0-8c32-054f4900d16f service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:13:18.217730 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca869a8d-291f-4db0-8c32-054f4900d16f service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:13:18.218273 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca869a8d-291f-4db0-8c32-054f4900d16f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:13:18.221848 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-ca869a8d-291f-4db0-8c32-054f4900d16f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:13:18.406037 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca869a8d-291f-4db0-8c32-054f4900d16f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:13:18.409173 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca869a8d-291f-4db0-8c32-054f4900d16f service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:13:18.444016 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 671/1349] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:13:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:13:23.955098 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38845113-cfbd-439c-8de9-837cfabba102 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:13:23.956053 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38845113-cfbd-439c-8de9-837cfabba102 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:13:23.956490 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38845113-cfbd-439c-8de9-837cfabba102 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:13:23.961979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 679/1350] 10.222.0.60 () {54 vars in 921 bytes} [Wed Sep 21 12:13:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:13:23.970501 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9ecee-6711-43cf-bb81-de40deeb3bb7 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:13:23.970501 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9ecee-6711-43cf-bb81-de40deeb3bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:13:23.970501 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9ecee-6711-43cf-bb81-de40deeb3bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:13:24.095046 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-61a9ecee-6711-43cf-bb81-de40deeb3bb7 None None] MFA Rules not processed for user `74e866f134f64644bf33e3adecf207c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:13:24.096253 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-61a9ecee-6711-43cf-bb81-de40deeb3bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:13:24.126502 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:13:24.308695 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 672/1351] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Sep 21 12:13:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:13:29.997752 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73248e-b879-412d-a03f-b4f0bc68a576 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:13:29.998298 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73248e-b879-412d-a03f-b4f0bc68a576 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:13:29.998845 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73248e-b879-412d-a03f-b4f0bc68a576 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:13:30.002107 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 680/1352] 10.222.0.60 () {54 vars in 921 bytes} [Wed Sep 21 12:13:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:13:30.008674 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d3da2-2e3c-43ff-8242-139ce6700ab0 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:13:30.009209 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d3da2-2e3c-43ff-8242-139ce6700ab0 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:13:30.009646 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d3da2-2e3c-43ff-8242-139ce6700ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:13:30.140775 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-870d3da2-2e3c-43ff-8242-139ce6700ab0 None None] MFA Rules not processed for user `74e866f134f64644bf33e3adecf207c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:13:30.142038 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-870d3da2-2e3c-43ff-8242-139ce6700ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:13:30.241182 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:13:30.287570 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 673/1353] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Sep 21 12:13:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:13:32.164853 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154db10c-dbbd-4a0b-8708-af01b3a6dcf5 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:13:32.165572 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154db10c-dbbd-4a0b-8708-af01b3a6dcf5 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:13:32.166182 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154db10c-dbbd-4a0b-8708-af01b3a6dcf5 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:13:32.168589 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 681/1354] 10.222.0.60 () {54 vars in 921 bytes} [Wed Sep 21 12:13:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:13:32.174579 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a816db8-a40d-4ae4-ba2b-5050a93b92e6 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:13:32.175143 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a816db8-a40d-4ae4-ba2b-5050a93b92e6 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:13:32.175529 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a816db8-a40d-4ae4-ba2b-5050a93b92e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:13:32.268254 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-0a816db8-a40d-4ae4-ba2b-5050a93b92e6 None None] MFA Rules not processed for user `74e866f134f64644bf33e3adecf207c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:13:32.269824 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-0a816db8-a40d-4ae4-ba2b-5050a93b92e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:13:32.413619 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 674/1355] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Sep 21 12:13:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:13:37.119904 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a19dd5-47e7-4150-a67a-f1ee9da02ed1 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:13:37.120735 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a19dd5-47e7-4150-a67a-f1ee9da02ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:13:37.120735 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a19dd5-47e7-4150-a67a-f1ee9da02ed1 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:13:37.122339 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 682/1356] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:13:37.129978 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba4ca4-5f60-45a8-b7dc-3cc20e67ef96 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:13:37.130756 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba4ca4-5f60-45a8-b7dc-3cc20e67ef96 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:13:37.130999 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba4ca4-5f60-45a8-b7dc-3cc20e67ef96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:13:37.206568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:13:37.256083 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-10ba4ca4-5f60-45a8-b7dc-3cc20e67ef96 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:13:37.256083 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-10ba4ca4-5f60-45a8-b7dc-3cc20e67ef96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:13:37.464369 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 675/1357] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:13:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:13:37.790210 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225dfad-182c-44c4-bc2a-2688eb5b5bd1 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:13:37.790947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225dfad-182c-44c4-bc2a-2688eb5b5bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:13:37.791605 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225dfad-182c-44c4-bc2a-2688eb5b5bd1 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:13:37.794847 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 683/1358] 10.222.0.60 () {54 vars in 965 bytes} [Wed Sep 21 12:13:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:13:37.805795 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11cac2-8e2f-4ab8-94cf-2be22c8913bf None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:13:37.806074 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11cac2-8e2f-4ab8-94cf-2be22c8913bf None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:13:37.806348 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11cac2-8e2f-4ab8-94cf-2be22c8913bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:13:37.911553 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-7c11cac2-8e2f-4ab8-94cf-2be22c8913bf None None] MFA Rules not processed for user `6cb4001f94b8439180ca2a93d3b279b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:13:37.913389 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-7c11cac2-8e2f-4ab8-94cf-2be22c8913bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:13:38.021085 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:13:38.156648 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 676/1359] 10.222.0.60 () {58 vars in 1062 bytes} [Wed Sep 21 12:13:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:13:38.170008 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225dfad-182c-44c4-bc2a-2688eb5b5bd1 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:13:38.171586 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-0225dfad-182c-44c4-bc2a-2688eb5b5bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:13:38.350856 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225dfad-182c-44c4-bc2a-2688eb5b5bd1 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:13:38.471371 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:13:38.532151 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41d9e3-624a-4a9f-9e53-e46051e8cd9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:13:38.532968 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41d9e3-624a-4a9f-9e53-e46051e8cd9c service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:13:38.533383 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41d9e3-624a-4a9f-9e53-e46051e8cd9c service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:13:38.533800 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41d9e3-624a-4a9f-9e53-e46051e8cd9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:13:38.535881 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-5d41d9e3-624a-4a9f-9e53-e46051e8cd9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:13:38.676882 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d41d9e3-624a-4a9f-9e53-e46051e8cd9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:13:38.678883 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d41d9e3-624a-4a9f-9e53-e46051e8cd9c service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:13:38.710183 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 684/1360] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:13:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:13:41.597689 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdb3aa-b7bd-4698-b569-8a41956b5015 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:13:41.598133 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdb3aa-b7bd-4698-b569-8a41956b5015 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:13:41.598378 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdb3aa-b7bd-4698-b569-8a41956b5015 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:13:41.606443 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71e71a-8429-4bb8-acf3-46625a632369 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:13:41.606443 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71e71a-8429-4bb8-acf3-46625a632369 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:13:41.607933 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71e71a-8429-4bb8-acf3-46625a632369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:13:41.611939 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 677/1361] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:13:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:13:41.699660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-de71e71a-8429-4bb8-acf3-46625a632369 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:13:41.699660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-de71e71a-8429-4bb8-acf3-46625a632369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:13:41.751291 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:13:41.853214 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 685/1362] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:13:42.163440 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cdb3aa-b7bd-4698-b569-8a41956b5015 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:13:42.167934 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-25cdb3aa-b7bd-4698-b569-8a41956b5015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:13:42.447888 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cdb3aa-b7bd-4698-b569-8a41956b5015 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:13:42.468014 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:13:42.700617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0fe181-12af-489e-8292-c64a7635760d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:13:42.701770 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fe181-12af-489e-8292-c64a7635760d service nova] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:13:42.702278 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fe181-12af-489e-8292-c64a7635760d service nova] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:13:42.702806 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fe181-12af-489e-8292-c64a7635760d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:13:42.706086 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-db0fe181-12af-489e-8292-c64a7635760d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:13:42.877241 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0fe181-12af-489e-8292-c64a7635760d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:13:42.880362 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0fe181-12af-489e-8292-c64a7635760d service nova] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:13:42.912209 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 678/1363] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:13:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 750 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:13:45.835289 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42978f7-ad38-47be-b351-19f8bf0879c0 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:13:45.836101 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42978f7-ad38-47be-b351-19f8bf0879c0 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:13:45.836101 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42978f7-ad38-47be-b351-19f8bf0879c0 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:13:45.839774 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 686/1364] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:13:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:13:45.846277 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb865772-3c48-43e2-94e2-c0cd2e854e8f None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:13:45.847116 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb865772-3c48-43e2-94e2-c0cd2e854e8f None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:13:45.847116 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb865772-3c48-43e2-94e2-c0cd2e854e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:13:45.865516 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:13:45.946848 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-fb865772-3c48-43e2-94e2-c0cd2e854e8f None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:13:45.948253 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-fb865772-3c48-43e2-94e2-c0cd2e854e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:13:46.078797 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 679/1365] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:13:46.374815 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe012a-8c44-4c93-a7df-eadf6cb06fd5 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:13:46.375270 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe012a-8c44-4c93-a7df-eadf6cb06fd5 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:13:46.375652 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effe012a-8c44-4c93-a7df-eadf6cb06fd5 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:13:46.377452 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 687/1366] 10.222.0.60 () {54 vars in 965 bytes} [Wed Sep 21 12:13:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:13:46.383613 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb5875-ef32-4b5e-ac9e-d7e1e05dd1e2 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:13:46.383959 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb5875-ef32-4b5e-ac9e-d7e1e05dd1e2 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:13:46.384180 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb5875-ef32-4b5e-ac9e-d7e1e05dd1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:13:46.482142 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-dafb5875-ef32-4b5e-ac9e-d7e1e05dd1e2 None None] MFA Rules not processed for user `6cb4001f94b8439180ca2a93d3b279b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:13:46.483421 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-dafb5875-ef32-4b5e-ac9e-d7e1e05dd1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:13:46.545766 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:13:46.730478 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 680/1367] 10.222.0.60 () {58 vars in 1062 bytes} [Wed Sep 21 12:13:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:13:46.745789 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe012a-8c44-4c93-a7df-eadf6cb06fd5 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:13:46.749070 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-effe012a-8c44-4c93-a7df-eadf6cb06fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:13:47.086716 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effe012a-8c44-4c93-a7df-eadf6cb06fd5 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:13:47.132717 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:13:47.257496 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9faf69a-c788-49c8-a36f-979ff49c7eba None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:13:47.258024 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9faf69a-c788-49c8-a36f-979ff49c7eba None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:13:47.259230 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9faf69a-c788-49c8-a36f-979ff49c7eba None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:13:47.267913 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 681/1368] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:13:47 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:13:47.270702 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60eac69-c1ce-40ed-986e-b2c4899e1fcd None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:13:47.271218 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60eac69-c1ce-40ed-986e-b2c4899e1fcd None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:13:47.271692 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60eac69-c1ce-40ed-986e-b2c4899e1fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:13:47.353509 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a63f0-278f-4064-a4e6-a9e30a6f144b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:13:47.354855 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a63f0-278f-4064-a4e6-a9e30a6f144b service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:13:47.355435 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a63f0-278f-4064-a4e6-a9e30a6f144b service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:13:47.356016 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a63f0-278f-4064-a4e6-a9e30a6f144b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:13:47.359296 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-4e1a63f0-278f-4064-a4e6-a9e30a6f144b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:13:47.405602 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-b60eac69-c1ce-40ed-986e-b2c4899e1fcd None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:13:47.408066 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-b60eac69-c1ce-40ed-986e-b2c4899e1fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:13:47.519860 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a63f0-278f-4064-a4e6-a9e30a6f144b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:13:47.521572 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a63f0-278f-4064-a4e6-a9e30a6f144b service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:13:47.547499 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 688/1369] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:13:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 803 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:13:47.587503 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:13:47.598570 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 682/1370] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:13:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:13:47.912348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d12cb-afc8-42ae-ac6f-75568a4b0bb2 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:13:47.912685 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d12cb-afc8-42ae-ac6f-75568a4b0bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:13:47.912995 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d12cb-afc8-42ae-ac6f-75568a4b0bb2 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:13:47.914703 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 689/1371] 10.222.0.60 () {54 vars in 963 bytes} [Wed Sep 21 12:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:13:47.920764 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96305797-f919-4ffe-81b5-4a8fbe57cdef None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:13:47.921084 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96305797-f919-4ffe-81b5-4a8fbe57cdef None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:13:47.921396 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96305797-f919-4ffe-81b5-4a8fbe57cdef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:13:48.035861 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-96305797-f919-4ffe-81b5-4a8fbe57cdef None None] MFA Rules not processed for user `1b44dd2471684d358018f36ec0afc063`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:13:48.037442 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-96305797-f919-4ffe-81b5-4a8fbe57cdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:13:48.169064 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 683/1372] 10.222.0.60 () {58 vars in 1060 bytes} [Wed Sep 21 12:13:47 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:13:48.187132 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d12cb-afc8-42ae-ac6f-75568a4b0bb2 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:13:48.191918 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-664d12cb-afc8-42ae-ac6f-75568a4b0bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:13:48.243299 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:13:48.356025 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d12cb-afc8-42ae-ac6f-75568a4b0bb2 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:13:48.461718 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ea1eb-f9d1-40ac-a185-aa94e2623587 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:13:48.462233 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ea1eb-f9d1-40ac-a185-aa94e2623587 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:13:48.462552 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ea1eb-f9d1-40ac-a185-aa94e2623587 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:13:48.462841 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ea1eb-f9d1-40ac-a185-aa94e2623587 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:13:48.465254 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-297ea1eb-f9d1-40ac-a185-aa94e2623587 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:13:48.603568 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:13:48.675888 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ea1eb-f9d1-40ac-a185-aa94e2623587 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:13:48.678710 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ea1eb-f9d1-40ac-a185-aa94e2623587 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:13:48.717712 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 690/1373] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:13:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:13:50.880249 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef841bf-3bb1-44b6-bcd4-464ccb074825 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:13:50.881026 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef841bf-3bb1-44b6-bcd4-464ccb074825 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:13:50.881026 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef841bf-3bb1-44b6-bcd4-464ccb074825 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:13:50.882556 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 684/1374] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:13:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:13:50.889995 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ac66a-d6bd-4c83-aa95-77581837becb None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:13:50.891167 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ac66a-d6bd-4c83-aa95-77581837becb None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:13:50.891167 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ac66a-d6bd-4c83-aa95-77581837becb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:13:51.010463 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-af0ac66a-d6bd-4c83-aa95-77581837becb None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:13:51.010463 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-af0ac66a-d6bd-4c83-aa95-77581837becb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:13:51.171343 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 691/1375] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:13:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:13:51.474188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef841bf-3bb1-44b6-bcd4-464ccb074825 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:13:51.476231 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-aef841bf-3bb1-44b6-bcd4-464ccb074825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:13:51.594214 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:13:51.715909 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef841bf-3bb1-44b6-bcd4-464ccb074825 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:13:51.898276 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7cb303-25aa-4c6f-ada8-6faf2718fbba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:13:51.899345 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7cb303-25aa-4c6f-ada8-6faf2718fbba service nova] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:13:51.899345 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7cb303-25aa-4c6f-ada8-6faf2718fbba service nova] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:13:51.899652 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7cb303-25aa-4c6f-ada8-6faf2718fbba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:13:51.901159 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-de7cb303-25aa-4c6f-ada8-6faf2718fbba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:13:51.967019 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:13:52.030760 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7cb303-25aa-4c6f-ada8-6faf2718fbba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:13:52.033255 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7cb303-25aa-4c6f-ada8-6faf2718fbba service nova] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:13:52.068522 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 685/1376] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:13:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:13:54.839417 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695d0e4-6327-4be2-8246-ade89cd73d6d None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:13:54.840209 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695d0e4-6327-4be2-8246-ade89cd73d6d None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:13:54.840209 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695d0e4-6327-4be2-8246-ade89cd73d6d None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:13:54.841541 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 692/1377] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:13:54.847295 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b32b9a-0ddf-467d-a97a-1ba754dcc510 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:13:54.848098 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b32b9a-0ddf-467d-a97a-1ba754dcc510 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:13:54.848098 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b32b9a-0ddf-467d-a97a-1ba754dcc510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:13:54.932865 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-49b32b9a-0ddf-467d-a97a-1ba754dcc510 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:13:54.934255 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-49b32b9a-0ddf-467d-a97a-1ba754dcc510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:13:55.061840 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 686/1378] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:13:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:13:55.366067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695d0e4-6327-4be2-8246-ade89cd73d6d None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:13:55.367896 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-3695d0e4-6327-4be2-8246-ade89cd73d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:13:55.422305 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:13:55.594108 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695d0e4-6327-4be2-8246-ade89cd73d6d None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:13:55.757773 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:13:55.766474 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b28a9c-19aa-4ffa-8288-57ef31ec7d81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:13:55.769716 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b28a9c-19aa-4ffa-8288-57ef31ec7d81 service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:13:55.769716 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b28a9c-19aa-4ffa-8288-57ef31ec7d81 service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:13:55.769716 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b28a9c-19aa-4ffa-8288-57ef31ec7d81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:13:55.770606 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-25b28a9c-19aa-4ffa-8288-57ef31ec7d81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:13:55.914049 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b28a9c-19aa-4ffa-8288-57ef31ec7d81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:13:55.918306 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b28a9c-19aa-4ffa-8288-57ef31ec7d81 service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:13:55.942735 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 693/1379] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:13:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:13:58.691802 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437f4ef-3e20-4b72-a9ce-2805867af68b None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:13:58.692681 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437f4ef-3e20-4b72-a9ce-2805867af68b None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:13:58.692681 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437f4ef-3e20-4b72-a9ce-2805867af68b None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:13:58.695372 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 687/1380] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:13:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:13:58.701668 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179d720-6d2b-4804-96e0-c8c5a59d4bd1 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:13:58.702549 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179d720-6d2b-4804-96e0-c8c5a59d4bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:13:58.702549 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179d720-6d2b-4804-96e0-c8c5a59d4bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:13:58.825913 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-2179d720-6d2b-4804-96e0-c8c5a59d4bd1 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:13:58.827449 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2179d720-6d2b-4804-96e0-c8c5a59d4bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:13:58.929854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:13:58.981438 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 694/1381] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:13:59.329354 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437f4ef-3e20-4b72-a9ce-2805867af68b None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:13:59.329354 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-6437f4ef-3e20-4b72-a9ce-2805867af68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:13:59.366704 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:13:59.546556 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437f4ef-3e20-4b72-a9ce-2805867af68b None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:13:59.684614 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:13:59.701239 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a314f6-e74c-4dab-a374-80122fe1f61a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:13:59.702104 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a314f6-e74c-4dab-a374-80122fe1f61a service nova] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:13:59.702238 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a314f6-e74c-4dab-a374-80122fe1f61a service nova] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:13:59.702491 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a314f6-e74c-4dab-a374-80122fe1f61a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:13:59.704387 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-93a314f6-e74c-4dab-a374-80122fe1f61a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:13:59.839327 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a314f6-e74c-4dab-a374-80122fe1f61a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:13:59.841006 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a314f6-e74c-4dab-a374-80122fe1f61a service nova] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:13:59.864429 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 688/1382] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:13:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:14:02.747223 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7f31f-7940-4eef-a96c-37133ba6db52 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:02.748152 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7f31f-7940-4eef-a96c-37133ba6db52 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:02.748294 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7f31f-7940-4eef-a96c-37133ba6db52 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:02.750510 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 695/1383] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:14:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:14:02.759561 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e257447-7e33-49a9-8728-c184f0ceb480 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:02.761058 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e257447-7e33-49a9-8728-c184f0ceb480 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:02.761058 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e257447-7e33-49a9-8728-c184f0ceb480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:02.890806 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-5e257447-7e33-49a9-8728-c184f0ceb480 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:14:02.892431 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-5e257447-7e33-49a9-8728-c184f0ceb480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:02.984005 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:14:03.043592 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 689/1384] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:14:03.357790 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a7f31f-7940-4eef-a96c-37133ba6db52 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:14:03.360882 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-97a7f31f-7940-4eef-a96c-37133ba6db52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:03.567029 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a7f31f-7940-4eef-a96c-37133ba6db52 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:14:03.663475 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:14:03.754889 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc605e-ff48-4c8a-a7f4-5f54276fe9c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:14:03.755581 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc605e-ff48-4c8a-a7f4-5f54276fe9c2 service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:03.755970 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc605e-ff48-4c8a-a7f4-5f54276fe9c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:03.756346 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc605e-ff48-4c8a-a7f4-5f54276fe9c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:03.758387 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-9dfc605e-ff48-4c8a-a7f4-5f54276fe9c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:03.906789 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc605e-ff48-4c8a-a7f4-5f54276fe9c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:14:03.908359 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc605e-ff48-4c8a-a7f4-5f54276fe9c2 service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:14:03.932362 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 696/1385] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:14:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:14:06.736874 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5245db-65fb-4d29-a136-d2d08293d431 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:06.737784 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5245db-65fb-4d29-a136-d2d08293d431 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:06.737784 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5245db-65fb-4d29-a136-d2d08293d431 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:06.739754 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 690/1386] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:14:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:14:06.746263 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3eec1d-edfc-4976-94ca-37191c256c14 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:06.747142 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3eec1d-edfc-4976-94ca-37191c256c14 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:06.747142 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3eec1d-edfc-4976-94ca-37191c256c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:06.837559 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-4f3eec1d-edfc-4976-94ca-37191c256c14 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:14:06.838925 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-4f3eec1d-edfc-4976-94ca-37191c256c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:06.849366 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:14:06.989702 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 697/1387] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:14:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:14:07.266182 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600cbed-e2ac-4302-a8c4-73bb2ce6e447 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:07.266584 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600cbed-e2ac-4302-a8c4-73bb2ce6e447 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:07.267070 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600cbed-e2ac-4302-a8c4-73bb2ce6e447 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:07.269836 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 691/1388] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:14:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:14:07.278522 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82deb2-cad5-409a-808f-0bf935c08cce None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:07.278786 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82deb2-cad5-409a-808f-0bf935c08cce None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:07.279063 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82deb2-cad5-409a-808f-0bf935c08cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:07.294841 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600cbed-e2ac-4302-a8c4-73bb2ce6e447 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:14:07.297086 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-9600cbed-e2ac-4302-a8c4-73bb2ce6e447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:07.365747 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-dc82deb2-cad5-409a-808f-0bf935c08cce None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:14:07.367072 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-dc82deb2-cad5-409a-808f-0bf935c08cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:07.518153 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:14:07.534798 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 698/1389] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:14:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:14:07.544848 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600cbed-e2ac-4302-a8c4-73bb2ce6e447 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:14:07.601545 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:14:07.706522 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3d8e3-458d-4883-9fad-d07e9f8aca0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:14:07.707315 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3d8e3-458d-4883-9fad-d07e9f8aca0e service nova] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:07.707772 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3d8e3-458d-4883-9fad-d07e9f8aca0e service nova] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:07.708103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3d8e3-458d-4883-9fad-d07e9f8aca0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:07.710337 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-36f3d8e3-458d-4883-9fad-d07e9f8aca0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:07.843612 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f3d8e3-458d-4883-9fad-d07e9f8aca0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:14:07.845247 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f3d8e3-458d-4883-9fad-d07e9f8aca0e service nova] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:14:07.868231 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 692/1390] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:14:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:14:07.939720 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d11413-6539-4e8f-b9b9-6d3a4b8cae91 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:07.940297 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d11413-6539-4e8f-b9b9-6d3a4b8cae91 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:07.940297 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d11413-6539-4e8f-b9b9-6d3a4b8cae91 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:07.941672 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 699/1391] 10.222.0.60 () {54 vars in 962 bytes} [Wed Sep 21 12:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:14:07.947907 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebea13e-3836-410b-bb24-2abea1ddf592 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:07.948187 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebea13e-3836-410b-bb24-2abea1ddf592 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:07.948485 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebea13e-3836-410b-bb24-2abea1ddf592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:08.021347 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:14:08.046671 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-1ebea13e-3836-410b-bb24-2abea1ddf592 None None] MFA Rules not processed for user `c513a6c91a0240de87c7b51b07617827`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:14:08.048907 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-1ebea13e-3836-410b-bb24-2abea1ddf592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:08.186661 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 693/1392] 10.222.0.60 () {58 vars in 1059 bytes} [Wed Sep 21 12:14:07 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:14:08.197393 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d11413-6539-4e8f-b9b9-6d3a4b8cae91 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:14:08.199946 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-e2d11413-6539-4e8f-b9b9-6d3a4b8cae91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:08.377861 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d11413-6539-4e8f-b9b9-6d3a4b8cae91 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:14:08.493312 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3f22f-21d7-4f31-af1f-85e349dd03b3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c513a6c91a0240de87c7b51b07617827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:14:08.494901 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3f22f-21d7-4f31-af1f-85e349dd03b3 service glance] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:08.495414 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3f22f-21d7-4f31-af1f-85e349dd03b3 service glance] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:08.495953 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3f22f-21d7-4f31-af1f-85e349dd03b3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:08.499276 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-73a3f22f-21d7-4f31-af1f-85e349dd03b3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:08.571024 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:14:08.660545 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3f22f-21d7-4f31-af1f-85e349dd03b3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:14:08.662016 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3f22f-21d7-4f31-af1f-85e349dd03b3 service glance] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:14:08.689385 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 700/1393] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:14:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:14:09.653654 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73b426-60be-49bc-ad5f-74df8a38a83b None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:09.654569 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73b426-60be-49bc-ad5f-74df8a38a83b None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:09.654569 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73b426-60be-49bc-ad5f-74df8a38a83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:09.780461 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-4d73b426-60be-49bc-ad5f-74df8a38a83b None None] MFA Rules not processed for user `bbd7a1d5a8d04e3798ffcab27bad936b`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:14:09.782628 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-4d73b426-60be-49bc-ad5f-74df8a38a83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:09.959826 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 694/1394] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Sep 21 12:14:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:14:10.017883 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a738b3-77e0-42cc-a7fb-1f065d1c769b None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:10.018602 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a738b3-77e0-42cc-a7fb-1f065d1c769b None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:10.018743 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a738b3-77e0-42cc-a7fb-1f065d1c769b None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:10.021306 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 701/1395] 10.222.0.60 () {54 vars in 943 bytes} [Wed Sep 21 12:14:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:14:10.032178 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f7350-771d-4145-baa4-a370e3a44051 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:10.032681 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f7350-771d-4145-baa4-a370e3a44051 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:10.033111 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f7350-771d-4145-baa4-a370e3a44051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:10.045383 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:14:10.131546 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-a58f7350-771d-4145-baa4-a370e3a44051 None None] MFA Rules not processed for user `cbc2bab11b264196859802907b93ac37`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:14:10.132985 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-a58f7350-771d-4145-baa4-a370e3a44051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:10.280322 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 695/1396] 10.222.0.60 () {58 vars in 1040 bytes} [Wed Sep 21 12:14:10 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:14:10.293447 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a738b3-77e0-42cc-a7fb-1f065d1c769b None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:14:10.295490 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-41a738b3-77e0-42cc-a7fb-1f065d1c769b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:10.426799 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f96b8-80c2-481d-beaf-b94ed6afcaf9 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:10.427085 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f96b8-80c2-481d-beaf-b94ed6afcaf9 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:10.427368 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f96b8-80c2-481d-beaf-b94ed6afcaf9 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:10.428788 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 696/1397] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:14:10.434892 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb26f5-4261-4601-ae88-9eb6bf94e641 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:10.435171 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb26f5-4261-4601-ae88-9eb6bf94e641 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:10.435441 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb26f5-4261-4601-ae88-9eb6bf94e641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:10.479324 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a738b3-77e0-42cc-a7fb-1f065d1c769b None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:14:10.494821 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:14:10.516067 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-8beb26f5-4261-4601-ae88-9eb6bf94e641 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:14:10.517851 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-8beb26f5-4261-4601-ae88-9eb6bf94e641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:10.537973 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:14:10.633920 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899d613-e767-45f6-bd68-17767bce34f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc2bab11b264196859802907b93ac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:14:10.634693 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899d613-e767-45f6-bd68-17767bce34f3 service swift] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:10.634996 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899d613-e767-45f6-bd68-17767bce34f3 service swift] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:10.635261 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899d613-e767-45f6-bd68-17767bce34f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:10.636985 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-8899d613-e767-45f6-bd68-17767bce34f3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:10.679697 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 697/1398] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:14:10.759377 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8899d613-e767-45f6-bd68-17767bce34f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:14:10.761212 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8899d613-e767-45f6-bd68-17767bce34f3 service swift] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:14:10.771602 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 702/1399] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Sep 21 12:14:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 21 12:14:11.004266 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb26f5-4261-4601-ae88-9eb6bf94e641 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:14:11.006671 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-8beb26f5-4261-4601-ae88-9eb6bf94e641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:11.241540 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb26f5-4261-4601-ae88-9eb6bf94e641 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:14:11.301795 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:14:11.473630 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e72c9-bff6-44ee-907b-abb91d93e2ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:14:11.475970 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e72c9-bff6-44ee-907b-abb91d93e2ca service nova] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:11.476523 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e72c9-bff6-44ee-907b-abb91d93e2ca service nova] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:11.477236 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e72c9-bff6-44ee-907b-abb91d93e2ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:11.482583 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-d34e72c9-bff6-44ee-907b-abb91d93e2ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:11.723596 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e72c9-bff6-44ee-907b-abb91d93e2ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:14:11.725328 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e72c9-bff6-44ee-907b-abb91d93e2ca service nova] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:14:11.757363 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 698/1400] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:14:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 754 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:14:14.714463 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d291098-6483-45a0-a491-c6a4685953cc None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:14.715010 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d291098-6483-45a0-a491-c6a4685953cc None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:14.715010 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d291098-6483-45a0-a491-c6a4685953cc None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:14.716480 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 703/1401] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:14:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:14:14.722548 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e9f44-c97e-4b3a-bb99-69456e75d8cd None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:14.723068 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e9f44-c97e-4b3a-bb99-69456e75d8cd None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:14.723149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e9f44-c97e-4b3a-bb99-69456e75d8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:14.790015 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:14:14.815208 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-914e9f44-c97e-4b3a-bb99-69456e75d8cd None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:14:14.816469 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-914e9f44-c97e-4b3a-bb99-69456e75d8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:14.978495 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 699/1402] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:14:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:14:15.287701 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d291098-6483-45a0-a491-c6a4685953cc None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:14:15.292077 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-1d291098-6483-45a0-a491-c6a4685953cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:15.381350 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:14:15.546632 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d291098-6483-45a0-a491-c6a4685953cc None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:14:15.717800 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aaf947-8a27-4d00-b7ab-fb69afb58fed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:14:15.718947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aaf947-8a27-4d00-b7ab-fb69afb58fed service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:15.718947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aaf947-8a27-4d00-b7ab-fb69afb58fed service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:15.718947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aaf947-8a27-4d00-b7ab-fb69afb58fed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:15.721128 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d8aaf947-8a27-4d00-b7ab-fb69afb58fed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:15.731682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:14:15.953097 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aaf947-8a27-4d00-b7ab-fb69afb58fed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:14:15.957686 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aaf947-8a27-4d00-b7ab-fb69afb58fed service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:14:16.027523 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 704/1403] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:14:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 740 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:14:19.272973 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e36b6-3a57-4a02-b1d0-d9c5c1e6074a None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:19.273776 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e36b6-3a57-4a02-b1d0-d9c5c1e6074a None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:19.273776 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e36b6-3a57-4a02-b1d0-d9c5c1e6074a None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:19.280089 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 700/1404] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:14:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:14:19.280845 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04f86a-0688-4a39-a76c-21ca85cc8952 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:19.281278 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04f86a-0688-4a39-a76c-21ca85cc8952 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:19.281369 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04f86a-0688-4a39-a76c-21ca85cc8952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:19.420601 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-ca04f86a-0688-4a39-a76c-21ca85cc8952 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:14:19.422248 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ca04f86a-0688-4a39-a76c-21ca85cc8952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:19.557594 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:14:19.607368 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 705/1405] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:14:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:14:19.966719 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e36b6-3a57-4a02-b1d0-d9c5c1e6074a None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:14:19.968833 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-549e36b6-3a57-4a02-b1d0-d9c5c1e6074a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:20.208410 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:14:20.266548 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e36b6-3a57-4a02-b1d0-d9c5c1e6074a None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:14:20.517671 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa8ba95-cde3-42cd-ac45-542a7ce171a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:14:20.518821 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8ba95-cde3-42cd-ac45-542a7ce171a1 service nova] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:20.518821 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8ba95-cde3-42cd-ac45-542a7ce171a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:20.518821 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8ba95-cde3-42cd-ac45-542a7ce171a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:20.520698 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-daa8ba95-cde3-42cd-ac45-542a7ce171a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:20.627112 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:14:20.642899 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa8ba95-cde3-42cd-ac45-542a7ce171a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:14:20.645190 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa8ba95-cde3-42cd-ac45-542a7ce171a1 service nova] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:14:20.670832 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 701/1406] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:14:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 705 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:14:23.072697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494be5b-ebf3-4a39-b084-e4df4e68d304 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:23.073321 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494be5b-ebf3-4a39-b084-e4df4e68d304 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:23.073321 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494be5b-ebf3-4a39-b084-e4df4e68d304 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:23.080643 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951f501-ebe6-4fd6-a31a-1d8a91414019 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:23.081227 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951f501-ebe6-4fd6-a31a-1d8a91414019 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:23.081227 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e951f501-ebe6-4fd6-a31a-1d8a91414019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:23.082635 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 706/1407] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:14:23 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:14:23.188955 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-e951f501-ebe6-4fd6-a31a-1d8a91414019 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:14:23.190385 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-e951f501-ebe6-4fd6-a31a-1d8a91414019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:23.362712 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 702/1408] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:14:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:14:23.676280 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494be5b-ebf3-4a39-b084-e4df4e68d304 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:14:23.679141 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-c494be5b-ebf3-4a39-b084-e4df4e68d304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:24.011861 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494be5b-ebf3-4a39-b084-e4df4e68d304 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:14:24.142858 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:14:24.262997 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866dd31-b06a-4c9d-962b-b9532b42f953 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:14:24.263536 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866dd31-b06a-4c9d-962b-b9532b42f953 service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:24.263816 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866dd31-b06a-4c9d-962b-b9532b42f953 service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:24.264102 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866dd31-b06a-4c9d-962b-b9532b42f953 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:24.266313 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-c866dd31-b06a-4c9d-962b-b9532b42f953 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:24.404860 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c866dd31-b06a-4c9d-962b-b9532b42f953 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:14:24.408076 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c866dd31-b06a-4c9d-962b-b9532b42f953 service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:14:24.444813 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 707/1409] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:14:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 769 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:14:33.347626 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=75 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:14:34.441772 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=69 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:14:37.004537 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c3c6f-d22e-4ac5-95c5-9860f28c28a2 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:37.005165 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c3c6f-d22e-4ac5-95c5-9860f28c28a2 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:37.005330 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c3c6f-d22e-4ac5-95c5-9860f28c28a2 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:37.006918 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 703/1410] 10.222.0.60 () {54 vars in 918 bytes} [Wed Sep 21 12:14:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:14:37.013547 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41820622-6bed-426d-8b60-0d32ef1812fe None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:37.014120 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41820622-6bed-426d-8b60-0d32ef1812fe None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:37.014536 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41820622-6bed-426d-8b60-0d32ef1812fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:37.113360 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-41820622-6bed-426d-8b60-0d32ef1812fe None None] MFA Rules not processed for user `74e866f134f64644bf33e3adecf207c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:14:37.114644 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-41820622-6bed-426d-8b60-0d32ef1812fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:37.263069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 708/1411] 10.222.0.60 () {58 vars in 1015 bytes} [Wed Sep 21 12:14:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:14:37.280286 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9dce56-3819-41cb-a7d6-2ba44589757e None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:37.280718 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9dce56-3819-41cb-a7d6-2ba44589757e None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:37.281087 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9dce56-3819-41cb-a7d6-2ba44589757e None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:37.282603 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 704/1412] 10.222.0.60 () {54 vars in 918 bytes} [Wed Sep 21 12:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:14:37.288554 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add271a-ac7c-4fb0-96b8-0a3f3074d62a None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:37.288824 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add271a-ac7c-4fb0-96b8-0a3f3074d62a None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:37.289121 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add271a-ac7c-4fb0-96b8-0a3f3074d62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:37.377970 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:14:37.381685 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-4add271a-ac7c-4fb0-96b8-0a3f3074d62a None None] MFA Rules not processed for user `6cb4001f94b8439180ca2a93d3b279b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:14:37.383891 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-4add271a-ac7c-4fb0-96b8-0a3f3074d62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:37.538683 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 709/1413] 10.222.0.60 () {58 vars in 1015 bytes} [Wed Sep 21 12:14:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:14:40.328936 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce458a-1e76-4a83-9a11-51989c510751 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:40.329762 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce458a-1e76-4a83-9a11-51989c510751 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:40.329762 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce458a-1e76-4a83-9a11-51989c510751 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:40.331051 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 705/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 12:14:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:14:40.338466 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f311fc2-ca82-4831-9946-47510e557627 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:40.339012 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f311fc2-ca82-4831-9946-47510e557627 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:40.339429 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f311fc2-ca82-4831-9946-47510e557627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:40.447386 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-9f311fc2-ca82-4831-9946-47510e557627 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:14:40.448814 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-9f311fc2-ca82-4831-9946-47510e557627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:40.520083 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:14:40.574535 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 710/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 12:14:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:14:40.884079 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce458a-1e76-4a83-9a11-51989c510751 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:14:40.887198 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-c6ce458a-1e76-4a83-9a11-51989c510751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:41.141260 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce458a-1e76-4a83-9a11-51989c510751 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:14:41.271911 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:14:41.327219 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8ab86-97d2-499f-8979-631e61c0a3e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:14:41.327983 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8ab86-97d2-499f-8979-631e61c0a3e6 service nova] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:41.328372 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8ab86-97d2-499f-8979-631e61c0a3e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:41.328840 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8ab86-97d2-499f-8979-631e61c0a3e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:41.330797 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-a1e8ab86-97d2-499f-8979-631e61c0a3e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:41.452760 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8ab86-97d2-499f-8979-631e61c0a3e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:14:41.455875 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8ab86-97d2-499f-8979-631e61c0a3e6 service nova] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:14:41.493026 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 706/1416] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:14:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:14:42.737192 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8e0a3-7ad5-4649-8e74-f1c4e4476887 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:42.737773 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8e0a3-7ad5-4649-8e74-f1c4e4476887 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:42.737773 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8e0a3-7ad5-4649-8e74-f1c4e4476887 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:42.739178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 12:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:14:42.747496 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a0cb9-1e80-4f69-b795-cc0d84d5449c None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:42.748132 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a0cb9-1e80-4f69-b795-cc0d84d5449c None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:42.748132 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a0cb9-1e80-4f69-b795-cc0d84d5449c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:42.836149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-a36a0cb9-1e80-4f69-b795-cc0d84d5449c None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:14:42.837930 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-a36a0cb9-1e80-4f69-b795-cc0d84d5449c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:42.871884 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:14:42.956848 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 12:14:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:14:43.191879 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8e0a3-7ad5-4649-8e74-f1c4e4476887 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:14:43.193421 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-e3c8e0a3-7ad5-4649-8e74-f1c4e4476887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:43.376180 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8e0a3-7ad5-4649-8e74-f1c4e4476887 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:14:43.422623 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:14:43.509953 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af52ec-8c59-4cb6-a432-30cc2dbf8ed2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:14:43.510515 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af52ec-8c59-4cb6-a432-30cc2dbf8ed2 service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:43.510797 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af52ec-8c59-4cb6-a432-30cc2dbf8ed2 service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:43.511070 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af52ec-8c59-4cb6-a432-30cc2dbf8ed2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:43.512819 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-88af52ec-8c59-4cb6-a432-30cc2dbf8ed2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:43.747217 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af52ec-8c59-4cb6-a432-30cc2dbf8ed2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:14:43.748918 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af52ec-8c59-4cb6-a432-30cc2dbf8ed2 service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:14:43.772338 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 712/1419] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:14:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:14:45.079238 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662794f-3936-41cd-8e90-0dbc3f515c3a None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:45.080083 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662794f-3936-41cd-8e90-0dbc3f515c3a None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:45.080083 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662794f-3936-41cd-8e90-0dbc3f515c3a None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:45.081620 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 12:14:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:14:45.089850 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d88ee1-fe01-49d1-9387-5fed38183f6d None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:45.090528 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d88ee1-fe01-49d1-9387-5fed38183f6d None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:45.090528 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d88ee1-fe01-49d1-9387-5fed38183f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:45.154911 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:14:45.182193 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-78d88ee1-fe01-49d1-9387-5fed38183f6d None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:14:45.183489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-78d88ee1-fe01-49d1-9387-5fed38183f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:45.299038 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 12:14:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:14:45.465565 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662794f-3936-41cd-8e90-0dbc3f515c3a None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:14:45.467090 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-e662794f-3936-41cd-8e90-0dbc3f515c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:45.633007 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662794f-3936-41cd-8e90-0dbc3f515c3a None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:14:45.653622 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:14:45.802059 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ace67c-1ccc-48bc-be3b-2106c5ad5121 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:14:45.803104 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ace67c-1ccc-48bc-be3b-2106c5ad5121 service nova] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:45.803581 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ace67c-1ccc-48bc-be3b-2106c5ad5121 service nova] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:45.804060 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ace67c-1ccc-48bc-be3b-2106c5ad5121 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:45.807234 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-19ace67c-1ccc-48bc-be3b-2106c5ad5121 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:45.920759 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ace67c-1ccc-48bc-be3b-2106c5ad5121 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:14:45.923391 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ace67c-1ccc-48bc-be3b-2106c5ad5121 service nova] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:14:45.947406 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 709/1422] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:14:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:14:47.174042 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529c6cc-f5fc-4b38-8096-9c9169f9ceb3 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:47.174851 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529c6cc-f5fc-4b38-8096-9c9169f9ceb3 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:47.174851 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529c6cc-f5fc-4b38-8096-9c9169f9ceb3 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:47.176065 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 12:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:14:47.183551 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabb8b3-dbdb-4f1e-b9cf-2290ebfbfd45 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:47.184386 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabb8b3-dbdb-4f1e-b9cf-2290ebfbfd45 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:47.184546 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabb8b3-dbdb-4f1e-b9cf-2290ebfbfd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:47.207301 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:14:47.305344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-adabb8b3-dbdb-4f1e-b9cf-2290ebfbfd45 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:14:47.307596 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-adabb8b3-dbdb-4f1e-b9cf-2290ebfbfd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:47.471554 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 12:14:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:14:47.624177 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529c6cc-f5fc-4b38-8096-9c9169f9ceb3 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:14:47.625720 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-e529c6cc-f5fc-4b38-8096-9c9169f9ceb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:47.753546 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:14:47.798046 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529c6cc-f5fc-4b38-8096-9c9169f9ceb3 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:14:47.935773 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fae64-3e1a-4c40-be41-866fa7c2035c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:14:47.936464 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fae64-3e1a-4c40-be41-866fa7c2035c service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:47.936787 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fae64-3e1a-4c40-be41-866fa7c2035c service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:47.937103 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fae64-3e1a-4c40-be41-866fa7c2035c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:47.939022 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7f9fae64-3e1a-4c40-be41-866fa7c2035c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:48.035620 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:14:48.055069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9fae64-3e1a-4c40-be41-866fa7c2035c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:14:48.057556 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9fae64-3e1a-4c40-be41-866fa7c2035c service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:14:48.083564 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 715/1425] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:14:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:14:49.275197 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520a462-44f6-47a1-ac84-b03134b47981 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:49.275834 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520a462-44f6-47a1-ac84-b03134b47981 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:49.275834 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520a462-44f6-47a1-ac84-b03134b47981 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:49.277331 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 12:14:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:14:49.284946 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787d255-7f8c-4861-9517-0fae72d363af None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:49.285544 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787d255-7f8c-4861-9517-0fae72d363af None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:49.285544 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787d255-7f8c-4861-9517-0fae72d363af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:49.377182 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-9787d255-7f8c-4861-9517-0fae72d363af None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:14:49.378446 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-9787d255-7f8c-4861-9517-0fae72d363af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:49.513290 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 12:14:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:14:49.670564 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520a462-44f6-47a1-ac84-b03134b47981 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:14:49.672226 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-e520a462-44f6-47a1-ac84-b03134b47981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:49.807781 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:14:49.887752 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520a462-44f6-47a1-ac84-b03134b47981 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:14:50.028484 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4d0f9-0679-4f2d-a733-8b6bbfe414f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:14:50.029185 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4d0f9-0679-4f2d-a733-8b6bbfe414f7 service nova] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:50.029509 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4d0f9-0679-4f2d-a733-8b6bbfe414f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:50.029912 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4d0f9-0679-4f2d-a733-8b6bbfe414f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:50.031749 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-3bb4d0f9-0679-4f2d-a733-8b6bbfe414f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:50.090417 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:14:50.141885 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb4d0f9-0679-4f2d-a733-8b6bbfe414f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:14:50.143489 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb4d0f9-0679-4f2d-a733-8b6bbfe414f7 service nova] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:14:50.165838 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 712/1428] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:14:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:14:51.301164 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9625b78-d2e2-494b-98f5-4720734593e0 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:51.301636 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9625b78-d2e2-494b-98f5-4720734593e0 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:51.301770 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9625b78-d2e2-494b-98f5-4720734593e0 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:51.303094 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 12:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:14:51.310899 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256918a3-aa3d-4fa2-8ffd-d44e8e64dfa0 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:51.311459 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256918a3-aa3d-4fa2-8ffd-d44e8e64dfa0 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:51.311565 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256918a3-aa3d-4fa2-8ffd-d44e8e64dfa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:51.399699 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-256918a3-aa3d-4fa2-8ffd-d44e8e64dfa0 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:14:51.400954 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-256918a3-aa3d-4fa2-8ffd-d44e8e64dfa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:51.504991 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 12:14:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:14:51.659416 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9625b78-d2e2-494b-98f5-4720734593e0 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:14:51.661024 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d9625b78-d2e2-494b-98f5-4720734593e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:51.721687 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:14:51.854090 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9625b78-d2e2-494b-98f5-4720734593e0 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:14:51.985790 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29277d-185d-45ca-a5b2-9d05be9565ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:14:51.986430 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29277d-185d-45ca-a5b2-9d05be9565ec service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:51.986709 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29277d-185d-45ca-a5b2-9d05be9565ec service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:51.986967 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29277d-185d-45ca-a5b2-9d05be9565ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:51.988661 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ea29277d-185d-45ca-a5b2-9d05be9565ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:51.996510 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:14:52.109808 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29277d-185d-45ca-a5b2-9d05be9565ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:14:52.111351 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29277d-185d-45ca-a5b2-9d05be9565ec service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:14:52.130851 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 718/1431] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:14:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:14:53.259535 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c951c-e228-4621-b1f6-34eaf5349553 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:53.260221 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c951c-e228-4621-b1f6-34eaf5349553 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:53.260221 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c951c-e228-4621-b1f6-34eaf5349553 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:53.261473 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 12:14:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:14:53.268920 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d97d2-2ff4-4715-91dc-2bbec88311a2 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:53.269516 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d97d2-2ff4-4715-91dc-2bbec88311a2 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:53.269516 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d97d2-2ff4-4715-91dc-2bbec88311a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:53.352553 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-4d0d97d2-2ff4-4715-91dc-2bbec88311a2 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:14:53.353806 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-4d0d97d2-2ff4-4715-91dc-2bbec88311a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:53.432204 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:14:53.472552 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 12:14:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:14:53.624748 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c951c-e228-4621-b1f6-34eaf5349553 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:14:53.626287 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-e80c951c-e228-4621-b1f6-34eaf5349553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:53.644984 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:14:53.874147 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c951c-e228-4621-b1f6-34eaf5349553 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:14:53.994304 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:14:54.028087 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb81169-46bc-4a0c-90a3-c8e152473770 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:14:54.028705 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb81169-46bc-4a0c-90a3-c8e152473770 service nova] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:54.028983 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb81169-46bc-4a0c-90a3-c8e152473770 service nova] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:54.029258 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb81169-46bc-4a0c-90a3-c8e152473770 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:54.030987 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-9fb81169-46bc-4a0c-90a3-c8e152473770 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:54.137296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb81169-46bc-4a0c-90a3-c8e152473770 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:14:54.138886 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb81169-46bc-4a0c-90a3-c8e152473770 service nova] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:14:54.160371 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 715/1434] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:14:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:14:55.306266 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b6542-5079-4ba5-9056-285f58c9ff44 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:55.306839 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b6542-5079-4ba5-9056-285f58c9ff44 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:55.306953 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b6542-5079-4ba5-9056-285f58c9ff44 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:55.308398 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 12:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:14:55.315777 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a405e-92ca-457b-a2cb-6f5c8b831d7e None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:55.316626 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a405e-92ca-457b-a2cb-6f5c8b831d7e None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:55.316806 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a405e-92ca-457b-a2cb-6f5c8b831d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:55.399158 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-072a405e-92ca-457b-a2cb-6f5c8b831d7e None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:14:55.400407 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-072a405e-92ca-457b-a2cb-6f5c8b831d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:55.443605 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:14:55.503016 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 12:14:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:14:55.668588 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b6542-5079-4ba5-9056-285f58c9ff44 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:14:55.670344 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-124b6542-5079-4ba5-9056-285f58c9ff44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:55.852374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b6542-5079-4ba5-9056-285f58c9ff44 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:14:55.933754 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:14:56.009299 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3a5b5-a58c-4d7d-9ddc-4e5c83f96d55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:14:56.009917 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3a5b5-a58c-4d7d-9ddc-4e5c83f96d55 service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:56.010196 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3a5b5-a58c-4d7d-9ddc-4e5c83f96d55 service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:56.010495 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3a5b5-a58c-4d7d-9ddc-4e5c83f96d55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:56.012187 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-58d3a5b5-a58c-4d7d-9ddc-4e5c83f96d55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:56.117651 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3a5b5-a58c-4d7d-9ddc-4e5c83f96d55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:14:56.119238 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3a5b5-a58c-4d7d-9ddc-4e5c83f96d55 service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:14:56.140514 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 721/1437] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:14:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:14:57.276266 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe608af7-2d96-4c8f-86b3-66cdd91fbb30 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:57.276807 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe608af7-2d96-4c8f-86b3-66cdd91fbb30 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:57.276807 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe608af7-2d96-4c8f-86b3-66cdd91fbb30 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:57.278418 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 12:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:14:57.286766 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2827c-182d-4706-bdc4-04eef10046c0 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:57.287322 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2827c-182d-4706-bdc4-04eef10046c0 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:57.287322 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2827c-182d-4706-bdc4-04eef10046c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:57.368695 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-8ba2827c-182d-4706-bdc4-04eef10046c0 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:14:57.369939 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-8ba2827c-182d-4706-bdc4-04eef10046c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:57.372071 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:14:57.482598 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 12:14:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:14:57.639555 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe608af7-2d96-4c8f-86b3-66cdd91fbb30 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:14:57.641352 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-fe608af7-2d96-4c8f-86b3-66cdd91fbb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:57.806785 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe608af7-2d96-4c8f-86b3-66cdd91fbb30 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:14:57.836899 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:14:57.934208 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185199e0-364c-438d-adaa-0655fad10ac2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:14:57.934852 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185199e0-364c-438d-adaa-0655fad10ac2 service nova] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:14:57.935131 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185199e0-364c-438d-adaa-0655fad10ac2 service nova] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:14:57.935402 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185199e0-364c-438d-adaa-0655fad10ac2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:14:57.937026 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-185199e0-364c-438d-adaa-0655fad10ac2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:14:58.030919 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185199e0-364c-438d-adaa-0655fad10ac2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:14:58.032575 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185199e0-364c-438d-adaa-0655fad10ac2 service nova] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:14:58.051245 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 718/1440] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:14:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:15:00.210934 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd690a82-5423-4b46-9862-be981c9db9ab None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:15:00.211526 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd690a82-5423-4b46-9862-be981c9db9ab None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:15:00.211526 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd690a82-5423-4b46-9862-be981c9db9ab None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:15:00.212819 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 12:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:15:00.218581 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161978b3-6afc-4100-8b8e-5081a94e7b89 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:15:00.219023 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161978b3-6afc-4100-8b8e-5081a94e7b89 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:15:00.219132 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161978b3-6afc-4100-8b8e-5081a94e7b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:15:00.264462 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:15:00.298090 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-161978b3-6afc-4100-8b8e-5081a94e7b89 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:15:00.299363 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-161978b3-6afc-4100-8b8e-5081a94e7b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:15:00.409373 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 12:15:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:15:00.700126 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd690a82-5423-4b46-9862-be981c9db9ab None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:15:00.701679 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-cd690a82-5423-4b46-9862-be981c9db9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:15:00.822042 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd690a82-5423-4b46-9862-be981c9db9ab None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:15:00.858792 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:15:00.904962 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e63fe0-94eb-42c1-8ac2-9c4bf8d1e1da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:15:00.905573 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e63fe0-94eb-42c1-8ac2-9c4bf8d1e1da service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:15:00.905852 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e63fe0-94eb-42c1-8ac2-9c4bf8d1e1da service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:15:00.906122 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e63fe0-94eb-42c1-8ac2-9c4bf8d1e1da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:15:00.907817 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-e2e63fe0-94eb-42c1-8ac2-9c4bf8d1e1da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:15:01.028613 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e63fe0-94eb-42c1-8ac2-9c4bf8d1e1da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:15:01.030125 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e63fe0-94eb-42c1-8ac2-9c4bf8d1e1da service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:15:01.051232 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 724/1443] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:15:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:15:03.564264 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1287fd4-d32d-449e-9861-553424d3a7ef None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:15:03.564804 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1287fd4-d32d-449e-9861-553424d3a7ef None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:15:03.564911 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1287fd4-d32d-449e-9861-553424d3a7ef None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:15:03.566456 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 12:15:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:15:03.573165 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600deab3-4b9d-4792-adf3-a253c4b0fbf4 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:15:03.574113 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600deab3-4b9d-4792-adf3-a253c4b0fbf4 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:15:03.574113 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600deab3-4b9d-4792-adf3-a253c4b0fbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:15:03.650313 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-600deab3-4b9d-4792-adf3-a253c4b0fbf4 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:15:03.651601 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-600deab3-4b9d-4792-adf3-a253c4b0fbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:15:03.665836 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:15:03.770868 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 12:15:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:15:04.070956 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1287fd4-d32d-449e-9861-553424d3a7ef None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:15:04.072847 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-a1287fd4-d32d-449e-9861-553424d3a7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:15:04.186641 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1287fd4-d32d-449e-9861-553424d3a7ef None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:15:04.200969 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:15:04.269175 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8f538-ee66-4033-bccc-c16f363b752e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:15:04.269797 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8f538-ee66-4033-bccc-c16f363b752e service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:15:04.270107 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8f538-ee66-4033-bccc-c16f363b752e service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:15:04.270396 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8f538-ee66-4033-bccc-c16f363b752e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:15:04.272073 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-fed8f538-ee66-4033-bccc-c16f363b752e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:15:04.397945 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed8f538-ee66-4033-bccc-c16f363b752e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:15:04.399335 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed8f538-ee66-4033-bccc-c16f363b752e service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:15:04.419952 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 721/1446] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:15:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:15:06.991792 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2120f-5340-4d82-9663-c1f0e4ff067d None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:15:06.992329 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2120f-5340-4d82-9663-c1f0e4ff067d None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:15:06.992445 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2120f-5340-4d82-9663-c1f0e4ff067d None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:15:06.994553 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 12:15:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:15:07.000536 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed85f8c-42ae-4cff-abe5-287a4aac9543 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:15:07.001128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed85f8c-42ae-4cff-abe5-287a4aac9543 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:15:07.001128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed85f8c-42ae-4cff-abe5-287a4aac9543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:15:07.059908 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:15:07.091678 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-8ed85f8c-42ae-4cff-abe5-287a4aac9543 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:15:07.093808 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-8ed85f8c-42ae-4cff-abe5-287a4aac9543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:15:07.283361 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 12:15:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:15:07.582688 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c2120f-5340-4d82-9663-c1f0e4ff067d None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:15:07.584503 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-83c2120f-5340-4d82-9663-c1f0e4ff067d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:15:07.709516 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c2120f-5340-4d82-9663-c1f0e4ff067d None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:15:07.770789 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:15:07.825286 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e31a4-2f1f-45b1-8d89-4efe2aa8dba1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:15:07.825965 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e31a4-2f1f-45b1-8d89-4efe2aa8dba1 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:15:07.826352 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e31a4-2f1f-45b1-8d89-4efe2aa8dba1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:15:07.826831 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e31a4-2f1f-45b1-8d89-4efe2aa8dba1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:15:07.828673 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-5a7e31a4-2f1f-45b1-8d89-4efe2aa8dba1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:15:07.977847 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e31a4-2f1f-45b1-8d89-4efe2aa8dba1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:15:07.979521 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e31a4-2f1f-45b1-8d89-4efe2aa8dba1 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:15:08.007078 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 727/1449] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:15:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:15:10.483278 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79745ff2-ef9c-4ea7-81e9-dd52fa260c1a None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:15:10.484142 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79745ff2-ef9c-4ea7-81e9-dd52fa260c1a None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:15:10.484142 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79745ff2-ef9c-4ea7-81e9-dd52fa260c1a None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:15:10.485277 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 12:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:15:10.491647 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596a156-62c5-4aa1-8f46-efb92f1a2580 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:15:10.492213 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596a156-62c5-4aa1-8f46-efb92f1a2580 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:15:10.492213 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596a156-62c5-4aa1-8f46-efb92f1a2580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:15:10.570638 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-0596a156-62c5-4aa1-8f46-efb92f1a2580 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:15:10.571909 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-0596a156-62c5-4aa1-8f46-efb92f1a2580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:15:10.596405 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:15:10.705860 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 12:15:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:15:11.002446 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79745ff2-ef9c-4ea7-81e9-dd52fa260c1a None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:15:11.004031 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-79745ff2-ef9c-4ea7-81e9-dd52fa260c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:15:11.116315 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79745ff2-ef9c-4ea7-81e9-dd52fa260c1a None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:15:11.140068 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:15:11.200306 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d500f-cb82-4c7e-afe0-203604bc2802 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:15:11.200820 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d500f-cb82-4c7e-afe0-203604bc2802 service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:15:11.201102 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d500f-cb82-4c7e-afe0-203604bc2802 service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:15:11.201375 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d500f-cb82-4c7e-afe0-203604bc2802 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:15:11.203030 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-897d500f-cb82-4c7e-afe0-203604bc2802 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:15:11.326278 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d500f-cb82-4c7e-afe0-203604bc2802 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:15:11.327750 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d500f-cb82-4c7e-afe0-203604bc2802 service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:15:11.348756 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 724/1452] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:15:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:15:13.731198 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e752def-3eda-4d3c-9ce1-edb1ea4cd1f8 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:15:13.731785 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e752def-3eda-4d3c-9ce1-edb1ea4cd1f8 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:15:13.731785 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e752def-3eda-4d3c-9ce1-edb1ea4cd1f8 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:15:13.733252 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 12:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:15:13.739438 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346c4f8-309a-4ee0-b927-1d974dc74def None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:15:13.740055 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346c4f8-309a-4ee0-b927-1d974dc74def None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:15:13.740055 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346c4f8-309a-4ee0-b927-1d974dc74def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:15:13.811914 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:15:13.815178 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-9346c4f8-309a-4ee0-b927-1d974dc74def None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:15:13.817153 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-9346c4f8-309a-4ee0-b927-1d974dc74def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:15:13.933106 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 12:15:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:15:14.230947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e752def-3eda-4d3c-9ce1-edb1ea4cd1f8 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:15:14.240736 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7e752def-3eda-4d3c-9ce1-edb1ea4cd1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:15:14.353608 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e752def-3eda-4d3c-9ce1-edb1ea4cd1f8 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:15:14.430421 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:15:14.459885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb9554-0004-4ada-89fc-67206b5f86ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:15:14.460531 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb9554-0004-4ada-89fc-67206b5f86ff service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:15:14.460821 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb9554-0004-4ada-89fc-67206b5f86ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:15:14.461073 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb9554-0004-4ada-89fc-67206b5f86ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:15:14.462842 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-37cb9554-0004-4ada-89fc-67206b5f86ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:15:14.628905 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb9554-0004-4ada-89fc-67206b5f86ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:15:14.630377 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb9554-0004-4ada-89fc-67206b5f86ff service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:15:14.654149 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 730/1455] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:15:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:15:16.989146 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27ff91-be97-4a83-99cd-46d686302959 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:15:16.989685 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27ff91-be97-4a83-99cd-46d686302959 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:15:16.989878 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27ff91-be97-4a83-99cd-46d686302959 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:15:16.991266 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 12:15:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:15:16.996985 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3c396-e14b-470a-ab68-893a3284d299 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:15:16.997468 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3c396-e14b-470a-ab68-893a3284d299 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:15:16.997585 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3c396-e14b-470a-ab68-893a3284d299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:15:17.076455 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-7bd3c396-e14b-470a-ab68-893a3284d299 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:15:17.077711 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7bd3c396-e14b-470a-ab68-893a3284d299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:15:17.111209 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:15:17.183716 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 12:15:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:15:17.468758 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27ff91-be97-4a83-99cd-46d686302959 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:15:17.470316 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-9f27ff91-be97-4a83-99cd-46d686302959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:15:17.585972 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27ff91-be97-4a83-99cd-46d686302959 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:15:17.616753 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:15:17.665632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528bbec6-3c6d-4238-8035-c361437606d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:15:17.666239 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bbec6-3c6d-4238-8035-c361437606d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:15:17.666548 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bbec6-3c6d-4238-8035-c361437606d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:15:17.666821 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bbec6-3c6d-4238-8035-c361437606d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:15:17.668457 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-528bbec6-3c6d-4238-8035-c361437606d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:15:17.790791 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528bbec6-3c6d-4238-8035-c361437606d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:15:17.792236 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528bbec6-3c6d-4238-8035-c361437606d6 service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:15:17.811550 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 727/1458] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:15:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:15:20.126558 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0112ed-e3a9-4e4a-912f-5a6d3d800d9e None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:15:20.127194 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0112ed-e3a9-4e4a-912f-5a6d3d800d9e None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:15:20.127194 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0112ed-e3a9-4e4a-912f-5a6d3d800d9e None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:15:20.128520 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 12:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:15:20.135149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002c617-609d-442a-a9b0-bd0d695748df None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:15:20.135684 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002c617-609d-442a-a9b0-bd0d695748df None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:15:20.135684 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002c617-609d-442a-a9b0-bd0d695748df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:15:20.212068 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-8002c617-609d-442a-a9b0-bd0d695748df None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:15:20.213337 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-8002c617-609d-442a-a9b0-bd0d695748df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:15:20.223171 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:15:20.347116 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 12:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:15:20.839113 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0112ed-e3a9-4e4a-912f-5a6d3d800d9e None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:15:20.840717 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-3f0112ed-e3a9-4e4a-912f-5a6d3d800d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:15:20.965655 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0112ed-e3a9-4e4a-912f-5a6d3d800d9e None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:15:21.033373 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:15:21.056424 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e33795b-f993-4b5e-b604-1b963cec4dfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:15:21.057117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33795b-f993-4b5e-b604-1b963cec4dfd service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:15:21.057437 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33795b-f993-4b5e-b604-1b963cec4dfd service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:15:21.057748 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33795b-f993-4b5e-b604-1b963cec4dfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:15:21.059652 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7e33795b-f993-4b5e-b604-1b963cec4dfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:15:21.199833 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e33795b-f993-4b5e-b604-1b963cec4dfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:15:21.201511 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e33795b-f993-4b5e-b604-1b963cec4dfd service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:15:21.223017 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 733/1461] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:15:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:15:23.560642 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8cc57-71a9-426c-9e2f-3c783e27d9ba None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:15:23.561361 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8cc57-71a9-426c-9e2f-3c783e27d9ba None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:15:23.561502 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8cc57-71a9-426c-9e2f-3c783e27d9ba None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:15:23.563105 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 12:15:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:15:23.569323 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492baf0-c451-48fe-8640-8e202b8f2303 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:15:23.570208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492baf0-c451-48fe-8640-8e202b8f2303 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:15:23.570208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e492baf0-c451-48fe-8640-8e202b8f2303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:15:23.646247 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-e492baf0-c451-48fe-8640-8e202b8f2303 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:15:23.648060 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-e492baf0-c451-48fe-8640-8e202b8f2303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:15:23.693429 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:15:23.760857 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 12:15:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:15:24.050468 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac8cc57-71a9-426c-9e2f-3c783e27d9ba None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:15:24.052196 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-7ac8cc57-71a9-426c-9e2f-3c783e27d9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:15:24.168064 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac8cc57-71a9-426c-9e2f-3c783e27d9ba None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:15:24.209587 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:15:24.249110 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599de6a7-ec34-4bbe-8bbf-46e10bb5059a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:15:24.249631 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599de6a7-ec34-4bbe-8bbf-46e10bb5059a service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:15:24.249904 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599de6a7-ec34-4bbe-8bbf-46e10bb5059a service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:15:24.250175 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599de6a7-ec34-4bbe-8bbf-46e10bb5059a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:15:24.252394 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-599de6a7-ec34-4bbe-8bbf-46e10bb5059a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:15:24.474136 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599de6a7-ec34-4bbe-8bbf-46e10bb5059a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:15:24.477249 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599de6a7-ec34-4bbe-8bbf-46e10bb5059a service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:15:24.499839 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 730/1464] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:15:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:15:26.914351 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07a872-db7d-472a-bc1e-85a3657055c9 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:15:26.915031 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07a872-db7d-472a-bc1e-85a3657055c9 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:15:26.915031 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f07a872-db7d-472a-bc1e-85a3657055c9 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:15:26.916706 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 12:15:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:15:26.923133 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78e3af-0c31-4a1e-8ad7-6a72f67bba86 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:15:26.923658 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78e3af-0c31-4a1e-8ad7-6a72f67bba86 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:15:26.923789 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78e3af-0c31-4a1e-8ad7-6a72f67bba86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:15:27.003022 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-7d78e3af-0c31-4a1e-8ad7-6a72f67bba86 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:15:27.004333 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-7d78e3af-0c31-4a1e-8ad7-6a72f67bba86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:15:27.029499 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:15:27.130008 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 12:15:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:15:27.424118 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07a872-db7d-472a-bc1e-85a3657055c9 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:15:27.425709 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-8f07a872-db7d-472a-bc1e-85a3657055c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:15:27.552207 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f07a872-db7d-472a-bc1e-85a3657055c9 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:15:27.639118 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:15:27.648656 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8abeae1-346d-48f1-95eb-23d029bbe914 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:15:27.649318 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abeae1-346d-48f1-95eb-23d029bbe914 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:15:27.649637 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abeae1-346d-48f1-95eb-23d029bbe914 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:15:27.649950 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abeae1-346d-48f1-95eb-23d029bbe914 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:15:27.652093 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-e8abeae1-346d-48f1-95eb-23d029bbe914 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:15:27.792475 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8abeae1-346d-48f1-95eb-23d029bbe914 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:15:27.794205 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8abeae1-346d-48f1-95eb-23d029bbe914 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:15:27.817099 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 736/1467] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:15:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:15:30.159489 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da75e93-449a-4c04-8351-4babf932bf60 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:15:30.160125 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da75e93-449a-4c04-8351-4babf932bf60 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:15:30.160280 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da75e93-449a-4c04-8351-4babf932bf60 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:15:30.161900 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 12:15:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:15:30.168817 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b05882-9bb2-4f07-8833-274437ac3d0f None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:15:30.169416 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b05882-9bb2-4f07-8833-274437ac3d0f None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:15:30.169416 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b05882-9bb2-4f07-8833-274437ac3d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:15:30.256206 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-f0b05882-9bb2-4f07-8833-274437ac3d0f None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:15:30.257550 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f0b05882-9bb2-4f07-8833-274437ac3d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:15:30.314753 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:15:30.385216 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 12:15:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:15:30.678216 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da75e93-449a-4c04-8351-4babf932bf60 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:15:30.681172 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-4da75e93-449a-4c04-8351-4babf932bf60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:15:30.821445 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da75e93-449a-4c04-8351-4babf932bf60 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:15:30.883166 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:15:30.915688 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2cfe38-1d87-4127-8ee8-6dc2967bf974 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:15:30.916306 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cfe38-1d87-4127-8ee8-6dc2967bf974 service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:15:30.916578 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cfe38-1d87-4127-8ee8-6dc2967bf974 service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:15:30.916844 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cfe38-1d87-4127-8ee8-6dc2967bf974 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:15:30.918610 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-5e2cfe38-1d87-4127-8ee8-6dc2967bf974 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:15:31.054765 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2cfe38-1d87-4127-8ee8-6dc2967bf974 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:15:31.056217 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2cfe38-1d87-4127-8ee8-6dc2967bf974 service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:15:31.077385 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 733/1470] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:15:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:15:40.381396 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=22 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:15:41.074405 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=66 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:15:54.353341 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573de342-bdde-4cce-b6f8-46c86369e574 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:15:54.354083 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573de342-bdde-4cce-b6f8-46c86369e574 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:15:54.354083 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573de342-bdde-4cce-b6f8-46c86369e574 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:15:54.355299 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 738/1471] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:15:54.364335 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e022a-fe50-40c8-aa18-c1eb8c71d2f0 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:15:54.365722 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e022a-fe50-40c8-aa18-c1eb8c71d2f0 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:15:54.365722 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e022a-fe50-40c8-aa18-c1eb8c71d2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:15:54.454339 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-256e022a-fe50-40c8-aa18-c1eb8c71d2f0 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:15:54.455829 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-256e022a-fe50-40c8-aa18-c1eb8c71d2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:15:54.587936 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 734/1472] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:15:54.903028 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fd955-4a36-40be-b5e9-b4691d3d2b69 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:15:54.903451 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fd955-4a36-40be-b5e9-b4691d3d2b69 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:15:54.903776 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fd955-4a36-40be-b5e9-b4691d3d2b69 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:15:54.905261 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 739/1473] 10.222.0.60 () {54 vars in 962 bytes} [Wed Sep 21 12:15:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:15:54.911176 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb810cea-0dc6-43bd-a3b2-2fac85ce10af None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:15:54.911653 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb810cea-0dc6-43bd-a3b2-2fac85ce10af None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:15:54.912640 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb810cea-0dc6-43bd-a3b2-2fac85ce10af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:15:55.005236 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-cb810cea-0dc6-43bd-a3b2-2fac85ce10af None None] MFA Rules not processed for user `c513a6c91a0240de87c7b51b07617827`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:15:55.006525 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-cb810cea-0dc6-43bd-a3b2-2fac85ce10af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:15:55.032070 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:15:55.101471 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 735/1474] 10.222.0.60 () {58 vars in 1059 bytes} [Wed Sep 21 12:15:54 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:15:55.110032 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640fd955-4a36-40be-b5e9-b4691d3d2b69 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:15:55.111666 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-640fd955-4a36-40be-b5e9-b4691d3d2b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:15:55.245981 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640fd955-4a36-40be-b5e9-b4691d3d2b69 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:15:55.344853 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7720762-debc-4dc1-9e24-5234d27ee6e4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c513a6c91a0240de87c7b51b07617827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:15:55.345467 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7720762-debc-4dc1-9e24-5234d27ee6e4 service glance] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:15:55.345740 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7720762-debc-4dc1-9e24-5234d27ee6e4 service glance] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:15:55.346004 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7720762-debc-4dc1-9e24-5234d27ee6e4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:15:55.347937 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b7720762-debc-4dc1-9e24-5234d27ee6e4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:15:55.433746 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:15:55.503861 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7720762-debc-4dc1-9e24-5234d27ee6e4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:15:55.505355 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7720762-debc-4dc1-9e24-5234d27ee6e4 service glance] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:15:55.527653 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 740/1475] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:15:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:15:57.949183 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b50783-de48-482c-9742-62289f742b5e None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:15:57.949789 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b50783-de48-482c-9742-62289f742b5e None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:15:57.950112 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b50783-de48-482c-9742-62289f742b5e None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:15:57.952712 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 736/1476] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:15:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:15:57.959902 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abed7c-9b10-4f1a-a0fd-d6513e86832c None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:15:57.960802 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abed7c-9b10-4f1a-a0fd-d6513e86832c None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:15:57.960802 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abed7c-9b10-4f1a-a0fd-d6513e86832c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:15:58.041035 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-a8abed7c-9b10-4f1a-a0fd-d6513e86832c None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:15:58.042337 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a8abed7c-9b10-4f1a-a0fd-d6513e86832c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:15:58.177221 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 741/1477] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:15:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:15:58.587201 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b50783-de48-482c-9742-62289f742b5e None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:15:58.589233 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-e6b50783-de48-482c-9742-62289f742b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:15:58.744300 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b50783-de48-482c-9742-62289f742b5e None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:15:58.809549 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:15:58.865289 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494281eb-1252-4b1a-b0bf-79c4cebd265c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:15:58.865968 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494281eb-1252-4b1a-b0bf-79c4cebd265c admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:15:58.866340 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494281eb-1252-4b1a-b0bf-79c4cebd265c admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:15:58.866748 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494281eb-1252-4b1a-b0bf-79c4cebd265c admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:15:58.867514 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494281eb-1252-4b1a-b0bf-79c4cebd265c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:15:58.869523 dv-cinder-858678-1-smb devstack@keystone.service[81377]: WARNING py.warnings [None req-494281eb-1252-4b1a-b0bf-79c4cebd265c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 12:15:58.869523 dv-cinder-858678-1-smb devstack@keystone.service[81377]: warnings.warn(msg) Sep 21 12:15:58.869523 dv-cinder-858678-1-smb devstack@keystone.service[81377]: Sep 21 12:15:58.870750 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494281eb-1252-4b1a-b0bf-79c4cebd265c admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:15:58.898775 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 737/1478] 10.222.0.60 () {56 vars in 1108 bytes} [Wed Sep 21 12:15:58 2022] GET /identity/v3/projects => generated 2553 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:16:01.670125 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8da11-958b-48cb-83b4-c1dbd68ac5f6 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:16:01.670979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8da11-958b-48cb-83b4-c1dbd68ac5f6 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:16:01.670979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8da11-958b-48cb-83b4-c1dbd68ac5f6 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:16:01.672014 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 742/1479] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:16:01.678951 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c0dbc-5500-4021-93ea-bdfc8d756ed4 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:16:01.679799 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c0dbc-5500-4021-93ea-bdfc8d756ed4 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:16:01.679799 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c0dbc-5500-4021-93ea-bdfc8d756ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:16:01.804147 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-cd6c0dbc-5500-4021-93ea-bdfc8d756ed4 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:16:01.806274 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-cd6c0dbc-5500-4021-93ea-bdfc8d756ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:16:01.935838 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 738/1480] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:16:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:16:02.242332 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8da11-958b-48cb-83b4-c1dbd68ac5f6 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:16:02.244394 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-aed8da11-958b-48cb-83b4-c1dbd68ac5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:16:02.256273 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:16:02.438699 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8da11-958b-48cb-83b4-c1dbd68ac5f6 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:16:02.548213 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:16:02.597704 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9472d0-6f5f-410c-bcb0-366518f36f36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:16:02.598340 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9472d0-6f5f-410c-bcb0-366518f36f36 service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:16:02.598657 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9472d0-6f5f-410c-bcb0-366518f36f36 service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:16:02.598995 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9472d0-6f5f-410c-bcb0-366518f36f36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:16:02.600770 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-eb9472d0-6f5f-410c-bcb0-366518f36f36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:16:02.721239 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9472d0-6f5f-410c-bcb0-366518f36f36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:16:02.723070 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9472d0-6f5f-410c-bcb0-366518f36f36 service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:16:02.749664 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 743/1481] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:16:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:16:05.275847 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724838f-361c-485c-a909-4458c13ad2d5 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:16:05.276551 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724838f-361c-485c-a909-4458c13ad2d5 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:16:05.276551 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724838f-361c-485c-a909-4458c13ad2d5 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:16:05.278215 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 739/1482] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:16:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:16:05.284871 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16584327-a4cb-4a50-8f4f-0740015c4f1f None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:16:05.285474 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16584327-a4cb-4a50-8f4f-0740015c4f1f None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:16:05.285669 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16584327-a4cb-4a50-8f4f-0740015c4f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:16:05.377076 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-16584327-a4cb-4a50-8f4f-0740015c4f1f None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:16:05.379159 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-16584327-a4cb-4a50-8f4f-0740015c4f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:16:05.459171 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:16:05.523677 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 744/1483] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:16:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:16:06.021363 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724838f-361c-485c-a909-4458c13ad2d5 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:16:06.023014 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-a724838f-361c-485c-a909-4458c13ad2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:16:06.051667 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:16:06.151909 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724838f-361c-485c-a909-4458c13ad2d5 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:16:06.260750 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7edffae-0e34-41f5-b977-7d3feb721b6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:16:06.261745 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edffae-0e34-41f5-b977-7d3feb721b6f service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:16:06.262213 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edffae-0e34-41f5-b977-7d3feb721b6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:16:06.262758 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edffae-0e34-41f5-b977-7d3feb721b6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:16:06.266159 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-c7edffae-0e34-41f5-b977-7d3feb721b6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:16:06.374253 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:16:06.417941 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7edffae-0e34-41f5-b977-7d3feb721b6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:16:06.419438 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7edffae-0e34-41f5-b977-7d3feb721b6f service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:16:06.563874 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 740/1484] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:16:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:16:09.021785 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edadfa-2c28-4ec9-96fb-8c295f304adc None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:16:09.022408 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edadfa-2c28-4ec9-96fb-8c295f304adc None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:16:09.022941 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edadfa-2c28-4ec9-96fb-8c295f304adc None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:16:09.025559 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 745/1485] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:16:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:16:09.035936 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb08e6c-ad88-4765-a8fa-c69d10e6911d None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:16:09.036773 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb08e6c-ad88-4765-a8fa-c69d10e6911d None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:16:09.036966 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb08e6c-ad88-4765-a8fa-c69d10e6911d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:16:09.134287 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-7cb08e6c-ad88-4765-a8fa-c69d10e6911d None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:16:09.135590 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-7cb08e6c-ad88-4765-a8fa-c69d10e6911d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:16:09.253571 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 741/1486] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:16:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:16:09.558598 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edadfa-2c28-4ec9-96fb-8c295f304adc None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:16:09.560409 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-e4edadfa-2c28-4ec9-96fb-8c295f304adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:16:09.693643 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edadfa-2c28-4ec9-96fb-8c295f304adc None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:16:09.779821 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:16:09.781426 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d3151-ffd5-429a-9173-acc0d539ff40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:16:09.782114 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d3151-ffd5-429a-9173-acc0d539ff40 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:16:09.782443 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d3151-ffd5-429a-9173-acc0d539ff40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:16:09.783109 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d3151-ffd5-429a-9173-acc0d539ff40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:16:09.785283 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2f3d3151-ffd5-429a-9173-acc0d539ff40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:16:09.929769 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3d3151-ffd5-429a-9173-acc0d539ff40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:16:09.931275 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3d3151-ffd5-429a-9173-acc0d539ff40 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:16:09.951607 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 746/1487] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:16:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:16:12.470779 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5012ec-d379-4320-bd58-d1ddfff0528d None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:16:12.471408 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5012ec-d379-4320-bd58-d1ddfff0528d None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:16:12.471408 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5012ec-d379-4320-bd58-d1ddfff0528d None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:16:12.472766 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 742/1488] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:16:12.479182 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2043d8-ebf3-4eef-8d7e-2b5192a9fe0c None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:16:12.479787 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2043d8-ebf3-4eef-8d7e-2b5192a9fe0c None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:16:12.479979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2043d8-ebf3-4eef-8d7e-2b5192a9fe0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:16:12.563953 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-aa2043d8-ebf3-4eef-8d7e-2b5192a9fe0c None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:16:12.566424 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-aa2043d8-ebf3-4eef-8d7e-2b5192a9fe0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:16:12.631862 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:16:12.686239 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 747/1489] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:16:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:16:12.998531 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5012ec-d379-4320-bd58-d1ddfff0528d None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:16:13.000278 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-0d5012ec-d379-4320-bd58-d1ddfff0528d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:16:13.044234 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:16:13.136661 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5012ec-d379-4320-bd58-d1ddfff0528d None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:16:13.246503 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66b5aa-8bf0-4b69-8076-ed2e2403a3a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:16:13.247026 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66b5aa-8bf0-4b69-8076-ed2e2403a3a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:16:13.247304 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66b5aa-8bf0-4b69-8076-ed2e2403a3a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:16:13.247574 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66b5aa-8bf0-4b69-8076-ed2e2403a3a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:16:13.249246 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-ba66b5aa-8bf0-4b69-8076-ed2e2403a3a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:16:13.363000 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:16:13.401105 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66b5aa-8bf0-4b69-8076-ed2e2403a3a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:16:13.402652 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66b5aa-8bf0-4b69-8076-ed2e2403a3a6 service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:16:13.426209 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 743/1490] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:16:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:16:15.993869 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f71020-f151-4a18-8544-93fccebf487a None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:16:15.994607 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f71020-f151-4a18-8544-93fccebf487a None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:16:15.994607 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f71020-f151-4a18-8544-93fccebf487a None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:16:15.995836 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 748/1491] 10.222.0.60 () {54 vars in 927 bytes} [Wed Sep 21 12:16:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:16:16.001818 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d5fec-d3aa-47ce-b3fa-f01ec0536062 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:16:16.002617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d5fec-d3aa-47ce-b3fa-f01ec0536062 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:16:16.002806 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d5fec-d3aa-47ce-b3fa-f01ec0536062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:16:16.103371 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-b09d5fec-d3aa-47ce-b3fa-f01ec0536062 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:16:16.105563 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-b09d5fec-d3aa-47ce-b3fa-f01ec0536062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:16:16.233567 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 744/1492] 10.222.0.60 () {58 vars in 1024 bytes} [Wed Sep 21 12:16:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:16:16.533950 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f71020-f151-4a18-8544-93fccebf487a None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:16:16.535677 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d4f71020-f151-4a18-8544-93fccebf487a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:16:16.704774 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f71020-f151-4a18-8544-93fccebf487a None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:16:16.832119 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a92517d-e602-49dd-8680-943824690e24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:16:16.832747 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92517d-e602-49dd-8680-943824690e24 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:16:16.833521 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92517d-e602-49dd-8680-943824690e24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:16:16.833793 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92517d-e602-49dd-8680-943824690e24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:16:16.835687 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-3a92517d-e602-49dd-8680-943824690e24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:16:16.846816 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:16:16.997579 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a92517d-e602-49dd-8680-943824690e24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:16:16.999094 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a92517d-e602-49dd-8680-943824690e24 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:16:17.022382 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 749/1493] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:16:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:16:26.231924 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=82 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:16:27.019232 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=50 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:17:36.498195 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6d3eb-742f-4877-9072-209a904879bd None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:17:36.498934 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6d3eb-742f-4877-9072-209a904879bd None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:17:36.498934 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6d3eb-742f-4877-9072-209a904879bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:17:36.649433 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-63f6d3eb-742f-4877-9072-209a904879bd None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:17:36.650737 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-63f6d3eb-742f-4877-9072-209a904879bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:17:36.796894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 745/1494] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:17:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:17:36.805758 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15496906-9dfb-4111-884e-6c9ada981cbb None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:17:36.806437 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15496906-9dfb-4111-884e-6c9ada981cbb None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:17:36.806437 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15496906-9dfb-4111-884e-6c9ada981cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:17:36.828566 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-15496906-9dfb-4111-884e-6c9ada981cbb None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:17:36.829838 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-15496906-9dfb-4111-884e-6c9ada981cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:17:36.839752 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 750/1495] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:17:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:17:36.845055 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6d3eb-742f-4877-9072-209a904879bd None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:17:36.855778 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6d3eb-742f-4877-9072-209a904879bd None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:17:36.860957 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf9a2d-f353-4878-b83c-131f66a396fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:17:36.862226 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf9a2d-f353-4878-b83c-131f66a396fd admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:17:36.862539 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf9a2d-f353-4878-b83c-131f66a396fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:17:36.862808 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf9a2d-f353-4878-b83c-131f66a396fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:17:36.863464 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebf9a2d-f353-4878-b83c-131f66a396fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:17:36.863761 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebf9a2d-f353-4878-b83c-131f66a396fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:17:36.864796 dv-cinder-858678-1-smb devstack@keystone.service[81377]: WARNING py.warnings [None req-9ebf9a2d-f353-4878-b83c-131f66a396fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 21 12:17:36.864796 dv-cinder-858678-1-smb devstack@keystone.service[81377]: warnings.warn(msg) Sep 21 12:17:36.864796 dv-cinder-858678-1-smb devstack@keystone.service[81377]: Sep 21 12:17:36.865688 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebf9a2d-f353-4878-b83c-131f66a396fd admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:17:36.880482 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 746/1496] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:17:36.898662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15496906-9dfb-4111-884e-6c9ada981cbb None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:17:36.909273 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15496906-9dfb-4111-884e-6c9ada981cbb None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:17:36.914875 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c577cf-861a-4a8d-9da4-bcc4c285f29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:17:36.915635 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c577cf-861a-4a8d-9da4-bcc4c285f29e admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:17:36.916042 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c577cf-861a-4a8d-9da4-bcc4c285f29e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:17:36.916503 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c577cf-861a-4a8d-9da4-bcc4c285f29e admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:17:36.917428 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c577cf-861a-4a8d-9da4-bcc4c285f29e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:17:36.919378 dv-cinder-858678-1-smb devstack@keystone.service[81378]: WARNING py.warnings [None req-69c577cf-861a-4a8d-9da4-bcc4c285f29e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 12:17:36.919378 dv-cinder-858678-1-smb devstack@keystone.service[81378]: warnings.warn(msg) Sep 21 12:17:36.919378 dv-cinder-858678-1-smb devstack@keystone.service[81378]: Sep 21 12:17:36.920737 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c577cf-861a-4a8d-9da4-bcc4c285f29e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:17:36.972263 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 751/1497] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:17:36 2022] POST /identity/v3/projects => generated 379 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:17:36.977764 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf9a2d-f353-4878-b83c-131f66a396fd admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:17:36.999473 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf9a2d-f353-4878-b83c-131f66a396fd admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:17:37.089710 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:17:37.097954 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0aac0c-d4b6-4eb0-89d9-681d5f3bc59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:17:37.098617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0aac0c-d4b6-4eb0-89d9-681d5f3bc59e admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:17:37.098901 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0aac0c-d4b6-4eb0-89d9-681d5f3bc59e admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:17:37.099175 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0aac0c-d4b6-4eb0-89d9-681d5f3bc59e admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:17:37.099862 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0aac0c-d4b6-4eb0-89d9-681d5f3bc59e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:17:37.100905 dv-cinder-858678-1-smb devstack@keystone.service[81377]: WARNING py.warnings [None req-5f0aac0c-d4b6-4eb0-89d9-681d5f3bc59e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 12:17:37.100905 dv-cinder-858678-1-smb devstack@keystone.service[81377]: warnings.warn(msg) Sep 21 12:17:37.100905 dv-cinder-858678-1-smb devstack@keystone.service[81377]: Sep 21 12:17:37.102153 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0aac0c-d4b6-4eb0-89d9-681d5f3bc59e admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:17:37.128165 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 747/1498] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:17:36 2022] POST /identity/v3/users => generated 290 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:17:37.133367 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c577cf-861a-4a8d-9da4-bcc4c285f29e admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:17:37.146164 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c577cf-861a-4a8d-9da4-bcc4c285f29e admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:17:37.151390 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad5815-af5c-4dbf-8bdf-07c15abc3496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:17:37.152021 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad5815-af5c-4dbf-8bdf-07c15abc3496 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:17:37.152298 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad5815-af5c-4dbf-8bdf-07c15abc3496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:17:37.152567 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad5815-af5c-4dbf-8bdf-07c15abc3496 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:17:37.153233 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad5815-af5c-4dbf-8bdf-07c15abc3496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:17:37.154260 dv-cinder-858678-1-smb devstack@keystone.service[81378]: WARNING py.warnings [None req-c2ad5815-af5c-4dbf-8bdf-07c15abc3496 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 21 12:17:37.154260 dv-cinder-858678-1-smb devstack@keystone.service[81378]: warnings.warn(msg) Sep 21 12:17:37.154260 dv-cinder-858678-1-smb devstack@keystone.service[81378]: Sep 21 12:17:37.155204 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad5815-af5c-4dbf-8bdf-07c15abc3496 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:17:37.170954 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 752/1499] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:17:37.175530 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0aac0c-d4b6-4eb0-89d9-681d5f3bc59e admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:17:37.186264 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0aac0c-d4b6-4eb0-89d9-681d5f3bc59e admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:17:37.191691 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34a8a4-25ec-46d2-88d9-985e71c44a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:17:37.192325 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34a8a4-25ec-46d2-88d9-985e71c44a06 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:17:37.192605 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34a8a4-25ec-46d2-88d9-985e71c44a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:17:37.192875 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34a8a4-25ec-46d2-88d9-985e71c44a06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:17:37.193537 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d34a8a4-25ec-46d2-88d9-985e71c44a06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:17:37.194608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: WARNING py.warnings [None req-4d34a8a4-25ec-46d2-88d9-985e71c44a06 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 21 12:17:37.194608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: warnings.warn(msg) Sep 21 12:17:37.194608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: Sep 21 12:17:37.195526 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d34a8a4-25ec-46d2-88d9-985e71c44a06 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:17:37.214056 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 748/1500] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:17:37.219282 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad5815-af5c-4dbf-8bdf-07c15abc3496 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:17:37.230867 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad5815-af5c-4dbf-8bdf-07c15abc3496 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:17:37.236091 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583135ce-8318-4404-bea9-2bde822ed44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:17:37.236793 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583135ce-8318-4404-bea9-2bde822ed44c admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:17:37.237102 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583135ce-8318-4404-bea9-2bde822ed44c admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:17:37.237378 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583135ce-8318-4404-bea9-2bde822ed44c admin admin] PATH_INFO: `/v3/projects/d0d13d86c36e46cd8a7e1e3390c706f1/users/f3051132d57c4377b750b9cba11bd3fd/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:17:37.256389 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583135ce-8318-4404-bea9-2bde822ed44c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0d13d86c36e46cd8a7e1e3390c706f1, user_id=f3051132d57c4377b750b9cba11bd3fd, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:17:37.257443 dv-cinder-858678-1-smb devstack@keystone.service[81378]: WARNING py.warnings [None req-583135ce-8318-4404-bea9-2bde822ed44c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 12:17:37.257443 dv-cinder-858678-1-smb devstack@keystone.service[81378]: warnings.warn(msg) Sep 21 12:17:37.257443 dv-cinder-858678-1-smb devstack@keystone.service[81378]: Sep 21 12:17:37.259606 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583135ce-8318-4404-bea9-2bde822ed44c admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:17:37.275927 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 753/1501] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:17:37 2022] PUT /identity/v3/projects/d0d13d86c36e46cd8a7e1e3390c706f1/users/f3051132d57c4377b750b9cba11bd3fd/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:17:37.290345 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a824803-bd72-4d52-acfd-f5504841b674 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:17:37.290881 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a824803-bd72-4d52-acfd-f5504841b674 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:17:37.291367 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a824803-bd72-4d52-acfd-f5504841b674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:17:37.341735 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-7a824803-bd72-4d52-acfd-f5504841b674 None None] MFA Rules not processed for user `f3051132d57c4377b750b9cba11bd3fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:17:37.342957 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-7a824803-bd72-4d52-acfd-f5504841b674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:17:37.423016 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 749/1502] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:17:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:17:37.441183 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5436c-32ff-41b6-8d54-73e0485d948f None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:17:37.441470 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5436c-32ff-41b6-8d54-73e0485d948f None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:17:37.441752 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5436c-32ff-41b6-8d54-73e0485d948f None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:17:37.443355 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 754/1503] 10.222.0.60 () {54 vars in 963 bytes} [Wed Sep 21 12:17:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:17:37.449317 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdb103-adf5-4aed-b3cc-1094680155a3 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:17:37.449733 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdb103-adf5-4aed-b3cc-1094680155a3 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:17:37.450101 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdb103-adf5-4aed-b3cc-1094680155a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:17:37.529060 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-f5cdb103-adf5-4aed-b3cc-1094680155a3 None None] MFA Rules not processed for user `1b44dd2471684d358018f36ec0afc063`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:17:37.531196 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-f5cdb103-adf5-4aed-b3cc-1094680155a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:17:37.678351 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 750/1504] 10.222.0.60 () {58 vars in 1060 bytes} [Wed Sep 21 12:17:37 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:17:37.689070 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5436c-32ff-41b6-8d54-73e0485d948f None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:17:37.702862 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5436c-32ff-41b6-8d54-73e0485d948f None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:17:37.706691 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6058b-2381-4562-b152-b27cc3f8df7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:17:37.707293 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6058b-2381-4562-b152-b27cc3f8df7d service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:17:37.707567 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6058b-2381-4562-b152-b27cc3f8df7d service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:17:37.707839 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6058b-2381-4562-b152-b27cc3f8df7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:17:37.717694 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6058b-2381-4562-b152-b27cc3f8df7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:17:37.719206 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b6058b-2381-4562-b152-b27cc3f8df7d service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:17:37.733619 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 755/1505] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:17:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:17:37.788860 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603a720-9776-49f5-856e-56ba55cc0f2a None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:17:37.789174 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603a720-9776-49f5-856e-56ba55cc0f2a None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:17:37.789395 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603a720-9776-49f5-856e-56ba55cc0f2a None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:17:37.790795 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 751/1506] 10.222.0.60 () {52 vars in 830 bytes} [Wed Sep 21 12:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:17:37.795378 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6058b-2381-4562-b152-b27cc3f8df7d service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:17:37.867675 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6058b-2381-4562-b152-b27cc3f8df7d service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:17:37.872833 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11cc3ea-6669-4b11-9bf2-07b5430a6c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:17:37.873480 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11cc3ea-6669-4b11-9bf2-07b5430a6c1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:17:37.873760 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11cc3ea-6669-4b11-9bf2-07b5430a6c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:17:37.874036 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11cc3ea-6669-4b11-9bf2-07b5430a6c1b admin admin] PATH_INFO: `/v3/users/f3051132d57c4377b750b9cba11bd3fd` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:17:37.875266 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11cc3ea-6669-4b11-9bf2-07b5430a6c1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3051132d57c4377b750b9cba11bd3fd)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:17:37.876310 dv-cinder-858678-1-smb devstack@keystone.service[81378]: WARNING py.warnings [None req-e11cc3ea-6669-4b11-9bf2-07b5430a6c1b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 12:17:37.876310 dv-cinder-858678-1-smb devstack@keystone.service[81378]: warnings.warn(msg) Sep 21 12:17:37.876310 dv-cinder-858678-1-smb devstack@keystone.service[81378]: Sep 21 12:17:37.878104 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11cc3ea-6669-4b11-9bf2-07b5430a6c1b admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:17:37.967281 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-e11cc3ea-6669-4b11-9bf2-07b5430a6c1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3051132d57c4377b750b9cba11bd3fd'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:17:37.978702 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-e11cc3ea-6669-4b11-9bf2-07b5430a6c1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3051132d57c4377b750b9cba11bd3fd'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:17:38.016229 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-e11cc3ea-6669-4b11-9bf2-07b5430a6c1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3051132d57c4377b750b9cba11bd3fd'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:17:38.017171 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-e11cc3ea-6669-4b11-9bf2-07b5430a6c1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3051132d57c4377b750b9cba11bd3fd'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:17:38.029875 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:17:38.036214 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-e11cc3ea-6669-4b11-9bf2-07b5430a6c1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3051132d57c4377b750b9cba11bd3fd'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:17:38.045890 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 756/1507] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:17:37 2022] DELETE /identity/v3/users/f3051132d57c4377b750b9cba11bd3fd => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:17:38.051586 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083e4eb-a76b-4fcb-8331-c88490e143bb None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:17:38.052046 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083e4eb-a76b-4fcb-8331-c88490e143bb None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:17:38.052415 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083e4eb-a76b-4fcb-8331-c88490e143bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:17:38.074583 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-4083e4eb-a76b-4fcb-8331-c88490e143bb None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:17:38.075884 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-4083e4eb-a76b-4fcb-8331-c88490e143bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:17:38.087780 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:17:38.188483 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 752/1508] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:17:38.199283 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11cc3ea-6669-4b11-9bf2-07b5430a6c1b admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:17:38.200959 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-e11cc3ea-6669-4b11-9bf2-07b5430a6c1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:17:38.294895 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11cc3ea-6669-4b11-9bf2-07b5430a6c1b admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:17:38.298787 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f326466-bffc-486d-9d91-73b06ff3b950 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:17:38.299950 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f326466-bffc-486d-9d91-73b06ff3b950 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:17:38.300227 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f326466-bffc-486d-9d91-73b06ff3b950 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:17:38.301489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f326466-bffc-486d-9d91-73b06ff3b950 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:17:38.311777 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f326466-bffc-486d-9d91-73b06ff3b950 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:17:38.313243 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f326466-bffc-486d-9d91-73b06ff3b950 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:17:38.324346 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 757/1509] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:17:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:17:38.835992 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083e4eb-a76b-4fcb-8331-c88490e143bb None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:17:38.837571 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-4083e4eb-a76b-4fcb-8331-c88490e143bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:17:38.853248 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083e4eb-a76b-4fcb-8331-c88490e143bb None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:17:38.858333 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21bef76-323a-46c1-bf65-920fae8f69de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:17:38.859024 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21bef76-323a-46c1-bf65-920fae8f69de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:17:38.859300 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21bef76-323a-46c1-bf65-920fae8f69de admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:17:38.859570 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21bef76-323a-46c1-bf65-920fae8f69de admin admin] PATH_INFO: `/v3/projects/d0d13d86c36e46cd8a7e1e3390c706f1` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:17:38.860824 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21bef76-323a-46c1-bf65-920fae8f69de admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0d13d86c36e46cd8a7e1e3390c706f1)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:17:38.862570 dv-cinder-858678-1-smb devstack@keystone.service[81377]: WARNING py.warnings [None req-c21bef76-323a-46c1-bf65-920fae8f69de admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 12:17:38.862570 dv-cinder-858678-1-smb devstack@keystone.service[81377]: warnings.warn(msg) Sep 21 12:17:38.862570 dv-cinder-858678-1-smb devstack@keystone.service[81377]: Sep 21 12:17:38.863778 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21bef76-323a-46c1-bf65-920fae8f69de admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:17:38.941673 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-c21bef76-323a-46c1-bf65-920fae8f69de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0d13d86c36e46cd8a7e1e3390c706f1', 'request_id': 'req-c21bef76-323a-46c1-bf65-920fae8f69de'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:17:38.953375 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-c21bef76-323a-46c1-bf65-920fae8f69de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0d13d86c36e46cd8a7e1e3390c706f1', 'request_id': 'req-c21bef76-323a-46c1-bf65-920fae8f69de'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:17:38.962453 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-c21bef76-323a-46c1-bf65-920fae8f69de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0d13d86c36e46cd8a7e1e3390c706f1', 'request_id': 'req-c21bef76-323a-46c1-bf65-920fae8f69de'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:17:38.983374 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-c21bef76-323a-46c1-bf65-920fae8f69de admin admin] The token cache is being invalidate because project d0d13d86c36e46cd8a7e1e3390c706f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:17:38.983641 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-c21bef76-323a-46c1-bf65-920fae8f69de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:17:38.984354 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-c21bef76-323a-46c1-bf65-920fae8f69de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:17:38.986082 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 753/1510] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:17:38 2022] DELETE /identity/v3/projects/d0d13d86c36e46cd8a7e1e3390c706f1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:17:48.319424 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=38 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:17:48.980006 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:19:16.530791 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1e629-caf0-45b7-90be-aeb20652e706 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:19:16.531522 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1e629-caf0-45b7-90be-aeb20652e706 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:19:16.531522 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d1e629-caf0-45b7-90be-aeb20652e706 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:19:16.532687 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 758/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 12:19:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:19:16.538846 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890c572-5a91-4b61-87da-8922bd747b88 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:19:16.539771 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890c572-5a91-4b61-87da-8922bd747b88 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:19:16.539771 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890c572-5a91-4b61-87da-8922bd747b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:19:16.568146 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-e890c572-5a91-4b61-87da-8922bd747b88 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:19:16.569448 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-e890c572-5a91-4b61-87da-8922bd747b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:19:16.641450 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 754/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 12:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:19:16.805414 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1e629-caf0-45b7-90be-aeb20652e706 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:19:16.807628 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-40d1e629-caf0-45b7-90be-aeb20652e706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:19:16.934584 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d1e629-caf0-45b7-90be-aeb20652e706 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:19:16.940825 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de5a9e-15e2-4ca1-93e3-2302810a109e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:19:16.941518 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de5a9e-15e2-4ca1-93e3-2302810a109e service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:19:16.941937 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de5a9e-15e2-4ca1-93e3-2302810a109e service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:19:16.942329 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de5a9e-15e2-4ca1-93e3-2302810a109e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:19:16.951912 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49de5a9e-15e2-4ca1-93e3-2302810a109e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:19:16.954091 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49de5a9e-15e2-4ca1-93e3-2302810a109e service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:19:16.969360 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 759/1513] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:19:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:19:18.207892 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6954d3-656d-41b4-82be-fbb1a674cca2 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:19:18.208490 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6954d3-656d-41b4-82be-fbb1a674cca2 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:19:18.208592 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6954d3-656d-41b4-82be-fbb1a674cca2 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:19:18.211020 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 755/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 12:19:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:19:18.219263 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554794b8-22ef-4bdb-83db-ff04447b0bb5 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:19:18.219851 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554794b8-22ef-4bdb-83db-ff04447b0bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:19:18.219851 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554794b8-22ef-4bdb-83db-ff04447b0bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:19:18.241293 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-554794b8-22ef-4bdb-83db-ff04447b0bb5 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:19:18.242576 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-554794b8-22ef-4bdb-83db-ff04447b0bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:19:18.251712 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 760/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 12:19:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:19:18.409768 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6954d3-656d-41b4-82be-fbb1a674cca2 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:19:18.426600 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6954d3-656d-41b4-82be-fbb1a674cca2 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:19:18.432711 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c6bf4f-f061-4ee8-86cf-09befa3c5494 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:19:18.433352 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6bf4f-f061-4ee8-86cf-09befa3c5494 service nova] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:19:18.433672 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6bf4f-f061-4ee8-86cf-09befa3c5494 service nova] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:19:18.433975 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6bf4f-f061-4ee8-86cf-09befa3c5494 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:19:18.444319 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c6bf4f-f061-4ee8-86cf-09befa3c5494 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:19:18.445986 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c6bf4f-f061-4ee8-86cf-09befa3c5494 service nova] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:19:18.458227 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 756/1516] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:19:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:19:18.926195 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a820953-4555-4b76-a235-7e168a44d834 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:19:18.926195 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a820953-4555-4b76-a235-7e168a44d834 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:19:18.926768 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a820953-4555-4b76-a235-7e168a44d834 None None] PATH_INFO: `/v3` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:19:18.928906 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 761/1517] 10.222.0.76 () {54 vars in 925 bytes} [Wed Sep 21 12:19:18 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:19:18.936121 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d26d6-3122-44c6-9179-a29724acb3d9 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:19:18.936545 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d26d6-3122-44c6-9179-a29724acb3d9 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:19:18.936926 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d26d6-3122-44c6-9179-a29724acb3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:19:18.997015 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-fa7d26d6-3122-44c6-9179-a29724acb3d9 None None] MFA Rules not processed for user `74e866f134f64644bf33e3adecf207c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:19:18.998473 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-fa7d26d6-3122-44c6-9179-a29724acb3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:19:19.081786 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 757/1518] 10.222.0.76 () {58 vars in 1015 bytes} [Wed Sep 21 12:19:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:19:28.235165 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=49 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:19:29.078200 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=77 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:19:29.224103 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2ce9e-48c4-46b5-9697-2ae04cd58299 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:19:29.224553 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2ce9e-48c4-46b5-9697-2ae04cd58299 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:19:29.224948 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2ce9e-48c4-46b5-9697-2ae04cd58299 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:19:29.226605 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 762/1519] 10.222.0.60 () {54 vars in 961 bytes} [Wed Sep 21 12:19:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:19:29.233057 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be678e1f-c226-44b8-8980-b44d2f16539c None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:19:29.234055 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be678e1f-c226-44b8-8980-b44d2f16539c None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:19:29.234636 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be678e1f-c226-44b8-8980-b44d2f16539c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:19:29.260482 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-be678e1f-c226-44b8-8980-b44d2f16539c None None] MFA Rules not processed for user `74e866f134f64644bf33e3adecf207c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:19:29.261857 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-be678e1f-c226-44b8-8980-b44d2f16539c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:19:29.272229 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 758/1520] 10.222.0.60 () {58 vars in 1058 bytes} [Wed Sep 21 12:19:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:19:29.282149 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d2ce9e-48c4-46b5-9697-2ae04cd58299 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:19:29.298419 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d2ce9e-48c4-46b5-9697-2ae04cd58299 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:19:29.303710 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ce682-1232-444c-af11-35b7a06aa347 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e866f134f64644bf33e3adecf207c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:19:29.304334 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ce682-1232-444c-af11-35b7a06aa347 service placement] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:19:29.304614 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ce682-1232-444c-af11-35b7a06aa347 service placement] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:19:29.304890 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ce682-1232-444c-af11-35b7a06aa347 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:19:29.315802 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ce682-1232-444c-af11-35b7a06aa347 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:19:29.317440 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ce682-1232-444c-af11-35b7a06aa347 service placement] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:19:29.330769 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 763/1521] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:19:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:19:30.112351 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99296a9a-ee33-46a0-8eae-41146c8369e0 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:19:30.112968 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99296a9a-ee33-46a0-8eae-41146c8369e0 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:19:30.112968 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99296a9a-ee33-46a0-8eae-41146c8369e0 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:19:30.114403 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 12:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:19:30.122209 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b27fd-463d-4960-a7fb-918dbdd2f718 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:19:30.122722 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b27fd-463d-4960-a7fb-918dbdd2f718 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:19:30.123098 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b27fd-463d-4960-a7fb-918dbdd2f718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:19:30.145534 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-de1b27fd-463d-4960-a7fb-918dbdd2f718 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:19:30.146918 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-de1b27fd-463d-4960-a7fb-918dbdd2f718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:19:30.155483 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 12:19:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:19:30.318353 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99296a9a-ee33-46a0-8eae-41146c8369e0 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:19:30.335196 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99296a9a-ee33-46a0-8eae-41146c8369e0 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:19:30.341370 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb195f3-8cd7-416c-9f53-8c5c3c44b140 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:19:30.342020 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb195f3-8cd7-416c-9f53-8c5c3c44b140 service nova] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:19:30.342295 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb195f3-8cd7-416c-9f53-8c5c3c44b140 service nova] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:19:30.343196 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb195f3-8cd7-416c-9f53-8c5c3c44b140 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:19:30.352805 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb195f3-8cd7-416c-9f53-8c5c3c44b140 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:19:30.354430 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb195f3-8cd7-416c-9f53-8c5c3c44b140 service nova] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:19:30.366258 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 760/1524] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:19:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:19:31.526005 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5eb33-95c3-43ca-b828-73cc1c2afb15 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:19:31.526892 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5eb33-95c3-43ca-b828-73cc1c2afb15 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:19:31.526892 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5eb33-95c3-43ca-b828-73cc1c2afb15 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:19:31.527957 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 21 12:19:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:19:31.535144 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004b5a9-93a1-4258-ac9e-a01094dbeaf4 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:19:31.535775 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004b5a9-93a1-4258-ac9e-a01094dbeaf4 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:19:31.535775 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8004b5a9-93a1-4258-ac9e-a01094dbeaf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:19:31.557245 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-8004b5a9-93a1-4258-ac9e-a01094dbeaf4 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:19:31.558534 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-8004b5a9-93a1-4258-ac9e-a01094dbeaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:19:31.567749 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 21 12:19:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:19:31.729633 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5eb33-95c3-43ca-b828-73cc1c2afb15 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:19:31.745253 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5eb33-95c3-43ca-b828-73cc1c2afb15 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:19:31.751746 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab1e0e-bfc6-45b3-a3f4-34fcf36e5911 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:19:31.752374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab1e0e-bfc6-45b3-a3f4-34fcf36e5911 service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:19:31.752653 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab1e0e-bfc6-45b3-a3f4-34fcf36e5911 service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:19:31.752925 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab1e0e-bfc6-45b3-a3f4-34fcf36e5911 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:19:31.762898 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab1e0e-bfc6-45b3-a3f4-34fcf36e5911 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:19:31.765089 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab1e0e-bfc6-45b3-a3f4-34fcf36e5911 service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:19:31.776408 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 766/1527] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:19:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:19:36.316580 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e43553-9452-440c-a8ae-eba4dccbc76c None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:19:36.317227 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e43553-9452-440c-a8ae-eba4dccbc76c None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:19:36.317641 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e43553-9452-440c-a8ae-eba4dccbc76c None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:19:36.320411 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 12:19:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:19:36.327150 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6f31c-f9d8-4957-b1b9-5ca3c61ecaab None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:19:36.327877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6f31c-f9d8-4957-b1b9-5ca3c61ecaab None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:19:36.327877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6f31c-f9d8-4957-b1b9-5ca3c61ecaab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:19:36.349732 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-77e6f31c-f9d8-4957-b1b9-5ca3c61ecaab None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:19:36.351173 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-77e6f31c-f9d8-4957-b1b9-5ca3c61ecaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:19:36.359730 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 12:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:19:36.661738 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e43553-9452-440c-a8ae-eba4dccbc76c None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:19:36.664577 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-13e43553-9452-440c-a8ae-eba4dccbc76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:19:36.768960 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e43553-9452-440c-a8ae-eba4dccbc76c None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:19:36.773235 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61e2a3-83a1-4cde-afce-44e160b6b975 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:19:36.773954 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61e2a3-83a1-4cde-afce-44e160b6b975 service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:19:36.774343 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61e2a3-83a1-4cde-afce-44e160b6b975 service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:19:36.774690 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61e2a3-83a1-4cde-afce-44e160b6b975 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:19:36.787425 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a61e2a3-83a1-4cde-afce-44e160b6b975 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:19:36.789257 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a61e2a3-83a1-4cde-afce-44e160b6b975 service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:19:36.800775 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 763/1530] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:19:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:19:39.090198 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f888f-8e6c-4b32-8ae5-3f7023722384 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:19:39.090884 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f888f-8e6c-4b32-8ae5-3f7023722384 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:19:39.091078 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f888f-8e6c-4b32-8ae5-3f7023722384 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:19:39.093157 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 12:19:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:19:39.099817 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288733f5-80af-4226-b431-e41c17d2c16e None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:19:39.100544 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288733f5-80af-4226-b431-e41c17d2c16e None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:19:39.100544 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288733f5-80af-4226-b431-e41c17d2c16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:19:39.123363 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-288733f5-80af-4226-b431-e41c17d2c16e None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:19:39.125265 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-288733f5-80af-4226-b431-e41c17d2c16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:19:39.133629 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 12:19:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:19:39.432643 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f888f-8e6c-4b32-8ae5-3f7023722384 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:19:39.445198 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f888f-8e6c-4b32-8ae5-3f7023722384 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:19:39.449154 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a649c7-7507-42ce-9bca-afc40f0c2a19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:19:39.449791 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a649c7-7507-42ce-9bca-afc40f0c2a19 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:19:39.450045 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a649c7-7507-42ce-9bca-afc40f0c2a19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:19:39.450313 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a649c7-7507-42ce-9bca-afc40f0c2a19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:19:39.462753 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a649c7-7507-42ce-9bca-afc40f0c2a19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:19:39.464466 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a649c7-7507-42ce-9bca-afc40f0c2a19 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:19:39.476961 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 769/1533] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:19:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:19:43.202394 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc56d3f-eef7-4209-bc43-256cb68584fa None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:19:43.202980 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc56d3f-eef7-4209-bc43-256cb68584fa None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:19:43.202980 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc56d3f-eef7-4209-bc43-256cb68584fa None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:19:43.204295 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 12:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:19:43.210201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cce5af-6f9d-4927-b07c-c66827e4dbf9 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:19:43.211116 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cce5af-6f9d-4927-b07c-c66827e4dbf9 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:19:43.211116 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cce5af-6f9d-4927-b07c-c66827e4dbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:19:43.234252 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-33cce5af-6f9d-4927-b07c-c66827e4dbf9 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:19:43.235531 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-33cce5af-6f9d-4927-b07c-c66827e4dbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:19:43.243927 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 12:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:19:43.550275 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc56d3f-eef7-4209-bc43-256cb68584fa None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:19:43.552099 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-8bc56d3f-eef7-4209-bc43-256cb68584fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:19:43.619853 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc56d3f-eef7-4209-bc43-256cb68584fa None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:19:43.624210 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a19c06-e4b3-471b-900e-f3004e4fdca7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:19:43.624884 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a19c06-e4b3-471b-900e-f3004e4fdca7 service cinder] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:19:43.625163 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a19c06-e4b3-471b-900e-f3004e4fdca7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:19:43.625444 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a19c06-e4b3-471b-900e-f3004e4fdca7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:19:43.635751 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a19c06-e4b3-471b-900e-f3004e4fdca7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:19:43.637224 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a19c06-e4b3-471b-900e-f3004e4fdca7 service cinder] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:19:43.648678 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 766/1536] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:19:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:19:45.915986 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3af04e-3357-40e0-9a76-c939c6fed94c None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:19:45.916582 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3af04e-3357-40e0-9a76-c939c6fed94c None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:19:45.916823 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3af04e-3357-40e0-9a76-c939c6fed94c None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:19:45.918256 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 21 12:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:19:45.925088 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5af42-1b03-4a21-979a-c0e791ae7ee3 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:19:45.925668 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5af42-1b03-4a21-979a-c0e791ae7ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:19:45.925668 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5af42-1b03-4a21-979a-c0e791ae7ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:19:45.953558 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-30c5af42-1b03-4a21-979a-c0e791ae7ee3 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:19:45.955738 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-30c5af42-1b03-4a21-979a-c0e791ae7ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:19:45.969107 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 21 12:19:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:19:46.355269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3af04e-3357-40e0-9a76-c939c6fed94c None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:19:46.357389 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ad3af04e-3357-40e0-9a76-c939c6fed94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:19:46.371638 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3af04e-3357-40e0-9a76-c939c6fed94c None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:19:46.376411 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569f9d0-7e62-4c82-a288-8c5c444b87e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:19:46.377023 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569f9d0-7e62-4c82-a288-8c5c444b87e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:19:46.377302 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569f9d0-7e62-4c82-a288-8c5c444b87e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:19:46.377575 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569f9d0-7e62-4c82-a288-8c5c444b87e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:19:46.387524 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7569f9d0-7e62-4c82-a288-8c5c444b87e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:19:46.389595 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7569f9d0-7e62-4c82-a288-8c5c444b87e6 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:19:46.400643 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 772/1539] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:19:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:19:55.944490 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=70 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:19:56.395772 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=33 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:25.948413 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0b458-96e1-4466-8c9f-8d393fab306f None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:25.950620 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0b458-96e1-4466-8c9f-8d393fab306f None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:25.951406 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0b458-96e1-4466-8c9f-8d393fab306f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:25.970829 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fc255-2bc9-4922-9db2-6afe13120fe9 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:25.971724 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fc255-2bc9-4922-9db2-6afe13120fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:25.972055 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fc255-2bc9-4922-9db2-6afe13120fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:25.985204 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-a6b0b458-96e1-4466-8c9f-8d393fab306f None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:25.989458 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-a6b0b458-96e1-4466-8c9f-8d393fab306f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:26.005545 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 768/1540] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:21:26.020248 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc55db-aeb0-40c6-a2ae-64eb140a919a None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:26.021154 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc55db-aeb0-40c6-a2ae-64eb140a919a None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:26.021871 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc55db-aeb0-40c6-a2ae-64eb140a919a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:26.024703 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-4f9fc255-2bc9-4922-9db2-6afe13120fe9 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:26.026011 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-4f9fc255-2bc9-4922-9db2-6afe13120fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:26.053029 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 773/1541] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:21:26.054659 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19952d8-748f-4f7e-90c2-cbd20f64a1b2 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:26.055140 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19952d8-748f-4f7e-90c2-cbd20f64a1b2 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:26.055329 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19952d8-748f-4f7e-90c2-cbd20f64a1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:26.075278 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-a9dc55db-aeb0-40c6-a2ae-64eb140a919a None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:26.078910 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-a9dc55db-aeb0-40c6-a2ae-64eb140a919a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:26.098441 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 769/1542] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:21:26.099514 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae763953-94ad-4703-99c8-f2c76d6a0d3b None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:26.099796 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae763953-94ad-4703-99c8-f2c76d6a0d3b None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:26.100069 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae763953-94ad-4703-99c8-f2c76d6a0d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:26.101900 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-f19952d8-748f-4f7e-90c2-cbd20f64a1b2 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:26.103200 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f19952d8-748f-4f7e-90c2-cbd20f64a1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:26.135473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 774/1543] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:21:26.137552 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa9992-5839-45f9-845d-4871bfdecea1 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:26.137861 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa9992-5839-45f9-845d-4871bfdecea1 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:26.138155 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa9992-5839-45f9-845d-4871bfdecea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:26.152690 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-ae763953-94ad-4703-99c8-f2c76d6a0d3b None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:26.154134 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-ae763953-94ad-4703-99c8-f2c76d6a0d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:26.163203 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 770/1544] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:21:26.163843 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae763953-94ad-4703-99c8-f2c76d6a0d3b None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:26.174839 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae763953-94ad-4703-99c8-f2c76d6a0d3b None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:26.180797 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ddcc5e-ef23-4ad8-b95b-889f6d2aebcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:26.181505 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ddcc5e-ef23-4ad8-b95b-889f6d2aebcb admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:26.181796 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ddcc5e-ef23-4ad8-b95b-889f6d2aebcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:26.182061 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ddcc5e-ef23-4ad8-b95b-889f6d2aebcb admin admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:26.185554 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ddcc5e-ef23-4ad8-b95b-889f6d2aebcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:21:26.185554 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ddcc5e-ef23-4ad8-b95b-889f6d2aebcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:26.185554 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ddcc5e-ef23-4ad8-b95b-889f6d2aebcb admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:26.196141 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-a1aa9992-5839-45f9-845d-4871bfdecea1 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:26.198268 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a1aa9992-5839-45f9-845d-4871bfdecea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:26.200050 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 771/1545] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:21:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:21:26.200866 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ddcc5e-ef23-4ad8-b95b-889f6d2aebcb admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:26.212709 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ddcc5e-ef23-4ad8-b95b-889f6d2aebcb admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:26.218770 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c7337-7830-4af6-aa3f-d1e23eda6afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:26.219406 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c7337-7830-4af6-aa3f-d1e23eda6afb admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:26.219805 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c7337-7830-4af6-aa3f-d1e23eda6afb admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:26.220136 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c7337-7830-4af6-aa3f-d1e23eda6afb admin admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:26.224455 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c7337-7830-4af6-aa3f-d1e23eda6afb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:21:26.224455 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c7337-7830-4af6-aa3f-d1e23eda6afb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:26.224455 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c7337-7830-4af6-aa3f-d1e23eda6afb admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:26.233782 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 775/1546] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:21:26.235244 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa9992-5839-45f9-845d-4871bfdecea1 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:26.243015 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 772/1547] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:21:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:21:26.244021 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c7337-7830-4af6-aa3f-d1e23eda6afb admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:26.260825 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c7337-7830-4af6-aa3f-d1e23eda6afb admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:26.265642 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa9992-5839-45f9-845d-4871bfdecea1 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:26.271606 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3226e35-5358-4a83-a6f5-02c08885bc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:26.272435 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3226e35-5358-4a83-a6f5-02c08885bc8a admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:26.272724 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3226e35-5358-4a83-a6f5-02c08885bc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:26.272990 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3226e35-5358-4a83-a6f5-02c08885bc8a admin admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:26.274486 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3226e35-5358-4a83-a6f5-02c08885bc8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:21:26.274836 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3226e35-5358-4a83-a6f5-02c08885bc8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:26.277617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3226e35-5358-4a83-a6f5-02c08885bc8a admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:26.302667 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437baeaf-a22a-449b-9135-d9c1a7454259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:26.303728 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437baeaf-a22a-449b-9135-d9c1a7454259 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:26.304222 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437baeaf-a22a-449b-9135-d9c1a7454259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:26.304682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437baeaf-a22a-449b-9135-d9c1a7454259 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:26.305822 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437baeaf-a22a-449b-9135-d9c1a7454259 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:26.310203 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437baeaf-a22a-449b-9135-d9c1a7454259 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:26.314522 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 773/1548] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:21:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:21:26.316337 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3226e35-5358-4a83-a6f5-02c08885bc8a admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:26.346523 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3226e35-5358-4a83-a6f5-02c08885bc8a admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:26.372596 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6056e9-6995-4d5f-87bd-0e4ec5415cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:26.373612 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6056e9-6995-4d5f-87bd-0e4ec5415cba admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:26.374086 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6056e9-6995-4d5f-87bd-0e4ec5415cba admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:26.374596 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6056e9-6995-4d5f-87bd-0e4ec5415cba admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:26.375767 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6056e9-6995-4d5f-87bd-0e4ec5415cba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:26.377684 dv-cinder-858678-1-smb devstack@keystone.service[81377]: WARNING py.warnings [None req-8e6056e9-6995-4d5f-87bd-0e4ec5415cba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 12:21:26.377684 dv-cinder-858678-1-smb devstack@keystone.service[81377]: warnings.warn(msg) Sep 21 12:21:26.377684 dv-cinder-858678-1-smb devstack@keystone.service[81377]: Sep 21 12:21:26.380083 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6056e9-6995-4d5f-87bd-0e4ec5415cba admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:26.404003 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 776/1549] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:21:26 2022] POST /identity/v3/projects => generated 365 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:21:26.405541 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437baeaf-a22a-449b-9135-d9c1a7454259 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:26.472879 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 774/1550] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:21:26 2022] POST /identity/v3/projects => generated 365 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:21:26.474253 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6056e9-6995-4d5f-87bd-0e4ec5415cba admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:26.577313 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437baeaf-a22a-449b-9135-d9c1a7454259 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:26.703702 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa4e23-97c0-492e-be29-39d57f3fe93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:26.704329 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa4e23-97c0-492e-be29-39d57f3fe93b admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:26.704602 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa4e23-97c0-492e-be29-39d57f3fe93b admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:26.704856 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa4e23-97c0-492e-be29-39d57f3fe93b admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:26.705501 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa4e23-97c0-492e-be29-39d57f3fe93b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:26.707495 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa4e23-97c0-492e-be29-39d57f3fe93b admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:26.753932 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6056e9-6995-4d5f-87bd-0e4ec5415cba admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:26.771767 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d116d9-e605-48d0-8b07-47537a939630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:26.772411 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d116d9-e605-48d0-8b07-47537a939630 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:26.774479 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d116d9-e605-48d0-8b07-47537a939630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:26.775221 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d116d9-e605-48d0-8b07-47537a939630 admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:26.775908 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d116d9-e605-48d0-8b07-47537a939630 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:26.780259 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d116d9-e605-48d0-8b07-47537a939630 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:26.784516 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 777/1551] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:21:26 2022] POST /identity/v3/projects => generated 393 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:21:26.787714 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa4e23-97c0-492e-be29-39d57f3fe93b admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:26.843776 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 775/1552] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:21:26 2022] POST /identity/v3/users => generated 283 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:21:26.849994 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19f090-e684-4900-b0e0-25ccd1e0ae17 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:26.850266 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19f090-e684-4900-b0e0-25ccd1e0ae17 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:26.850720 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19f090-e684-4900-b0e0-25ccd1e0ae17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:26.911520 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-4e19f090-e684-4900-b0e0-25ccd1e0ae17 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:26.922980 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-4e19f090-e684-4900-b0e0-25ccd1e0ae17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:26.945137 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:26.983048 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa4e23-97c0-492e-be29-39d57f3fe93b admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:26.997236 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99930b-1acf-4bd4-b4c4-4aa87c3e378e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:26.998667 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99930b-1acf-4bd4-b4c4-4aa87c3e378e admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:26.998943 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99930b-1acf-4bd4-b4c4-4aa87c3e378e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:26.999214 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99930b-1acf-4bd4-b4c4-4aa87c3e378e admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:26.999883 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99930b-1acf-4bd4-b4c4-4aa87c3e378e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:27.001523 dv-cinder-858678-1-smb devstack@keystone.service[81378]: WARNING py.warnings [None req-1c99930b-1acf-4bd4-b4c4-4aa87c3e378e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 12:21:27.001523 dv-cinder-858678-1-smb devstack@keystone.service[81378]: warnings.warn(msg) Sep 21 12:21:27.001523 dv-cinder-858678-1-smb devstack@keystone.service[81378]: Sep 21 12:21:27.003128 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99930b-1acf-4bd4-b4c4-4aa87c3e378e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:27.030794 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 776/1553] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:21:27.033058 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38a9e6-d6ac-4713-a180-9ca6f32e3f53 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:27.033612 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38a9e6-d6ac-4713-a180-9ca6f32e3f53 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:27.034048 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38a9e6-d6ac-4713-a180-9ca6f32e3f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:27.036012 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 778/1554] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:21:26 2022] POST /identity/v3/users => generated 283 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:21:27.039349 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99930b-1acf-4bd4-b4c4-4aa87c3e378e admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:27.062617 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99930b-1acf-4bd4-b4c4-4aa87c3e378e admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:27.069367 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-7f38a9e6-d6ac-4713-a180-9ca6f32e3f53 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:27.069596 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedadceb-7662-477e-8242-7fae5ddabd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:27.070681 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedadceb-7662-477e-8242-7fae5ddabd9c admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:27.071028 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedadceb-7662-477e-8242-7fae5ddabd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:27.071409 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-7f38a9e6-d6ac-4713-a180-9ca6f32e3f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:27.071647 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedadceb-7662-477e-8242-7fae5ddabd9c admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:27.072370 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedadceb-7662-477e-8242-7fae5ddabd9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:27.078936 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedadceb-7662-477e-8242-7fae5ddabd9c admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:27.090074 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 777/1555] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:21:27.091915 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38a9e6-d6ac-4713-a180-9ca6f32e3f53 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:27.098508 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:27.105921 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38a9e6-d6ac-4713-a180-9ca6f32e3f53 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:27.106718 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 779/1556] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:21:27 2022] POST /identity/v3/users => generated 297 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:21:27.108042 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a918936-7047-489b-9fa1-49af6b1d38de None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:27.108423 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a918936-7047-489b-9fa1-49af6b1d38de None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:27.108694 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a918936-7047-489b-9fa1-49af6b1d38de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:27.117930 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e84c8-5ecb-411f-9821-ae21871c0c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:27.118695 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e84c8-5ecb-411f-9821-ae21871c0c79 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:27.119137 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e84c8-5ecb-411f-9821-ae21871c0c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:27.119383 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e84c8-5ecb-411f-9821-ae21871c0c79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:27.120304 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e84c8-5ecb-411f-9821-ae21871c0c79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:27.122257 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e84c8-5ecb-411f-9821-ae21871c0c79 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:27.131941 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-4a918936-7047-489b-9fa1-49af6b1d38de None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:27.133172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-4a918936-7047-489b-9fa1-49af6b1d38de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:27.138634 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 778/1557] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:21:27.138634 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1db9a5-d285-4744-ab9e-d6314e121edd None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:27.138634 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1db9a5-d285-4744-ab9e-d6314e121edd None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:27.138634 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1db9a5-d285-4744-ab9e-d6314e121edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:27.146320 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 780/1558] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:21:27.147848 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a918936-7047-489b-9fa1-49af6b1d38de None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:27.161096 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-ba1db9a5-d285-4744-ab9e-d6314e121edd None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:27.162139 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a918936-7047-489b-9fa1-49af6b1d38de None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:27.162700 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-ba1db9a5-d285-4744-ab9e-d6314e121edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:27.167318 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43bd5b-06ae-4ea9-b752-536fed7505ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:27.168795 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43bd5b-06ae-4ea9-b752-536fed7505ee admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:27.169144 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43bd5b-06ae-4ea9-b752-536fed7505ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:27.169144 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43bd5b-06ae-4ea9-b752-536fed7505ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:27.170503 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43bd5b-06ae-4ea9-b752-536fed7505ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:27.172190 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43bd5b-06ae-4ea9-b752-536fed7505ee admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:27.181470 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 779/1559] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:21:27.181470 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f9115-602d-4630-84a9-983096410f57 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:27.181470 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f9115-602d-4630-84a9-983096410f57 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:27.181470 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f9115-602d-4630-84a9-983096410f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:27.186614 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 781/1560] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:21:27.187771 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8427a1-99d5-4a0a-812b-04256e03169c None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:27.188058 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8427a1-99d5-4a0a-812b-04256e03169c None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:27.188330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8427a1-99d5-4a0a-812b-04256e03169c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:27.200788 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-5b6f9115-602d-4630-84a9-983096410f57 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:27.202028 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-5b6f9115-602d-4630-84a9-983096410f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:27.209608 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-6c8427a1-99d5-4a0a-812b-04256e03169c None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:27.210336 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 780/1561] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:21:27.210901 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-6c8427a1-99d5-4a0a-812b-04256e03169c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:27.211257 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f9115-602d-4630-84a9-983096410f57 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:27.222047 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f9115-602d-4630-84a9-983096410f57 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:27.223865 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 782/1562] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:21:27.224781 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8427a1-99d5-4a0a-812b-04256e03169c None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:27.227036 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ef588-ecd4-44f7-90ad-3f8c7abdd75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:27.227888 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ef588-ecd4-44f7-90ad-3f8c7abdd75f admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:27.228170 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ef588-ecd4-44f7-90ad-3f8c7abdd75f admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:27.228445 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ef588-ecd4-44f7-90ad-3f8c7abdd75f admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:27.229097 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ef588-ecd4-44f7-90ad-3f8c7abdd75f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:27.231347 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ef588-ecd4-44f7-90ad-3f8c7abdd75f admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:27.235939 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8427a1-99d5-4a0a-812b-04256e03169c None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:27.241390 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f692d85f-0d3f-4747-a0ac-c39502413baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:27.242031 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692d85f-0d3f-4747-a0ac-c39502413baa admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:27.242309 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692d85f-0d3f-4747-a0ac-c39502413baa admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:27.242888 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692d85f-0d3f-4747-a0ac-c39502413baa admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:27.243066 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 781/1563] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:21:27.243942 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f8231-8a63-4a23-92b0-cbb2cca0fc01 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:27.244233 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f8231-8a63-4a23-92b0-cbb2cca0fc01 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:27.244511 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f8231-8a63-4a23-92b0-cbb2cca0fc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:27.246926 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f692d85f-0d3f-4747-a0ac-c39502413baa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:27.248558 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f692d85f-0d3f-4747-a0ac-c39502413baa admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:27.259601 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 783/1564] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:21:27.260920 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e218684-1383-4e80-9127-be857328d3c1 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:27.261274 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e218684-1383-4e80-9127-be857328d3c1 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:27.262037 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e218684-1383-4e80-9127-be857328d3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:27.267751 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-8c1f8231-8a63-4a23-92b0-cbb2cca0fc01 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:27.269088 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-8c1f8231-8a63-4a23-92b0-cbb2cca0fc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:27.279118 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 782/1565] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:21:27.281306 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f8231-8a63-4a23-92b0-cbb2cca0fc01 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:27.286349 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-7e218684-1383-4e80-9127-be857328d3c1 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:27.287626 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7e218684-1383-4e80-9127-be857328d3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:27.293991 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f8231-8a63-4a23-92b0-cbb2cca0fc01 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:27.297321 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 784/1566] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:21:27.298318 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e218684-1383-4e80-9127-be857328d3c1 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:27.299207 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e04fb3-7f87-4978-912d-c773997d0b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:27.299835 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e04fb3-7f87-4978-912d-c773997d0b6f admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:27.300113 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e04fb3-7f87-4978-912d-c773997d0b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:27.300387 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e04fb3-7f87-4978-912d-c773997d0b6f admin admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:27.301074 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e04fb3-7f87-4978-912d-c773997d0b6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:21:27.301356 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e04fb3-7f87-4978-912d-c773997d0b6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:27.303033 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e04fb3-7f87-4978-912d-c773997d0b6f admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:27.310144 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e218684-1383-4e80-9127-be857328d3c1 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:27.320104 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 783/1567] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:21:27.320104 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f15ae3-5adb-4049-b4fb-7e0816d63c3d None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:27.320104 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f15ae3-5adb-4049-b4fb-7e0816d63c3d None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:27.320104 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f15ae3-5adb-4049-b4fb-7e0816d63c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:27.321133 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed5519-a52f-4639-80b1-775d0e8a94d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:27.322246 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed5519-a52f-4639-80b1-775d0e8a94d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:27.322737 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed5519-a52f-4639-80b1-775d0e8a94d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:27.323028 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed5519-a52f-4639-80b1-775d0e8a94d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:27.324006 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed5519-a52f-4639-80b1-775d0e8a94d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:27.326281 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed5519-a52f-4639-80b1-775d0e8a94d8 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:27.340335 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 785/1568] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:21:27.341999 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed5519-a52f-4639-80b1-775d0e8a94d8 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:27.343845 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-c7f15ae3-5adb-4049-b4fb-7e0816d63c3d None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:27.345152 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-c7f15ae3-5adb-4049-b4fb-7e0816d63c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:27.355734 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed5519-a52f-4639-80b1-775d0e8a94d8 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:27.357536 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 784/1569] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:21:27.358789 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f15ae3-5adb-4049-b4fb-7e0816d63c3d None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:27.362081 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220138f5-3f6b-4f0f-a165-4ebc59128ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:27.362753 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220138f5-3f6b-4f0f-a165-4ebc59128ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:27.363033 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220138f5-3f6b-4f0f-a165-4ebc59128ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:27.363301 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220138f5-3f6b-4f0f-a165-4ebc59128ac1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:27.363947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220138f5-3f6b-4f0f-a165-4ebc59128ac1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:21:27.364244 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220138f5-3f6b-4f0f-a165-4ebc59128ac1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:27.365264 dv-cinder-858678-1-smb devstack@keystone.service[81378]: WARNING py.warnings [None req-220138f5-3f6b-4f0f-a165-4ebc59128ac1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 21 12:21:27.365264 dv-cinder-858678-1-smb devstack@keystone.service[81378]: warnings.warn(msg) Sep 21 12:21:27.365264 dv-cinder-858678-1-smb devstack@keystone.service[81378]: Sep 21 12:21:27.366150 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220138f5-3f6b-4f0f-a165-4ebc59128ac1 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:27.372747 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f15ae3-5adb-4049-b4fb-7e0816d63c3d None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:27.379235 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e375b7a-2992-49fd-90e9-2c22b61559d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:27.381265 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e375b7a-2992-49fd-90e9-2c22b61559d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:27.381904 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 786/1570] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:21:27.382076 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e375b7a-2992-49fd-90e9-2c22b61559d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:27.382279 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e375b7a-2992-49fd-90e9-2c22b61559d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:27.382557 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220138f5-3f6b-4f0f-a165-4ebc59128ac1 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:27.383217 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e375b7a-2992-49fd-90e9-2c22b61559d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:27.385767 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e375b7a-2992-49fd-90e9-2c22b61559d1 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:27.395806 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220138f5-3f6b-4f0f-a165-4ebc59128ac1 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:27.400640 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc4482-5707-458f-83e9-d58df007534e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:27.401307 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc4482-5707-458f-83e9-d58df007534e admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:27.401585 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc4482-5707-458f-83e9-d58df007534e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:27.402474 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc4482-5707-458f-83e9-d58df007534e admin admin] PATH_INFO: `/v3/projects/04c4f423da0a468ab0cee01330ba9e8f/users/a3d381f3e0244896bb1945fc19376e4c/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:27.406546 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 785/1571] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:21:27.406546 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e375b7a-2992-49fd-90e9-2c22b61559d1 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:27.415398 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e375b7a-2992-49fd-90e9-2c22b61559d1 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:27.421662 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f181e5f-e80f-4634-b21c-e0ee1eee065a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:27.422307 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f181e5f-e80f-4634-b21c-e0ee1eee065a admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:27.422620 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f181e5f-e80f-4634-b21c-e0ee1eee065a admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:27.422896 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f181e5f-e80f-4634-b21c-e0ee1eee065a admin admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:27.423554 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f181e5f-e80f-4634-b21c-e0ee1eee065a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:21:27.423928 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f181e5f-e80f-4634-b21c-e0ee1eee065a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:27.425567 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbc4482-5707-458f-83e9-d58df007534e admin admin] RBAC: Authorizing `identity:create_grant(project_id=04c4f423da0a468ab0cee01330ba9e8f, user_id=a3d381f3e0244896bb1945fc19376e4c, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:27.425701 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f181e5f-e80f-4634-b21c-e0ee1eee065a admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:27.429921 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbc4482-5707-458f-83e9-d58df007534e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:27.452405 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 786/1572] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:21:27.452405 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0cab7d-6cfb-458c-9587-e33285461b21 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:27.452405 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0cab7d-6cfb-458c-9587-e33285461b21 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:27.452405 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0cab7d-6cfb-458c-9587-e33285461b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:27.458940 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 787/1573] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:21:27 2022] PUT /identity/v3/projects/04c4f423da0a468ab0cee01330ba9e8f/users/a3d381f3e0244896bb1945fc19376e4c/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:21:27.467066 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-7b0cab7d-6cfb-458c-9587-e33285461b21 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:27.467886 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc4482-5707-458f-83e9-d58df007534e admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:27.468482 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-7b0cab7d-6cfb-458c-9587-e33285461b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:27.556836 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc4482-5707-458f-83e9-d58df007534e admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:27.558935 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 787/1574] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:21:27.559869 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0cab7d-6cfb-458c-9587-e33285461b21 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:27.568045 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389dcc2-988e-4e1b-8d4c-076903892f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:27.569086 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389dcc2-988e-4e1b-8d4c-076903892f74 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:27.569619 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389dcc2-988e-4e1b-8d4c-076903892f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:27.574183 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389dcc2-988e-4e1b-8d4c-076903892f74 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:27.574505 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0cab7d-6cfb-458c-9587-e33285461b21 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:27.574599 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389dcc2-988e-4e1b-8d4c-076903892f74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:27.575694 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389dcc2-988e-4e1b-8d4c-076903892f74 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:27.576824 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355cb4b-9591-4024-8587-5b80bb38bfad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:27.577511 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355cb4b-9591-4024-8587-5b80bb38bfad admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:27.577788 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355cb4b-9591-4024-8587-5b80bb38bfad admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:27.578112 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355cb4b-9591-4024-8587-5b80bb38bfad admin admin] PATH_INFO: `/v3/projects/30ba5048068440d899bfc8216e3967ce/users/1e0dadb0488146148e6c8b5b242722ef/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:27.599915 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355cb4b-9591-4024-8587-5b80bb38bfad admin admin] RBAC: Authorizing `identity:create_grant(project_id=30ba5048068440d899bfc8216e3967ce, user_id=1e0dadb0488146148e6c8b5b242722ef, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:27.601859 dv-cinder-858678-1-smb devstack@keystone.service[81377]: WARNING py.warnings [None req-c355cb4b-9591-4024-8587-5b80bb38bfad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 12:21:27.601859 dv-cinder-858678-1-smb devstack@keystone.service[81377]: warnings.warn(msg) Sep 21 12:21:27.601859 dv-cinder-858678-1-smb devstack@keystone.service[81377]: Sep 21 12:21:27.606250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355cb4b-9591-4024-8587-5b80bb38bfad admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:27.625787 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 788/1575] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:21:27 2022] POST /identity/v3/projects => generated 371 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:21:27.627220 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389dcc2-988e-4e1b-8d4c-076903892f74 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:27.629365 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 788/1576] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:21:27 2022] PUT /identity/v3/projects/30ba5048068440d899bfc8216e3967ce/users/1e0dadb0488146148e6c8b5b242722ef/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:21:27.630953 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355cb4b-9591-4024-8587-5b80bb38bfad admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:27.673545 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:27.718963 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:27.732894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355cb4b-9591-4024-8587-5b80bb38bfad admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:27.759545 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389dcc2-988e-4e1b-8d4c-076903892f74 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:27.768771 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db107af-8daf-4a06-8c50-6989ba9d1a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:27.769803 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db107af-8daf-4a06-8c50-6989ba9d1a67 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:27.770284 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db107af-8daf-4a06-8c50-6989ba9d1a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:27.770806 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db107af-8daf-4a06-8c50-6989ba9d1a67 admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:27.771990 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db107af-8daf-4a06-8c50-6989ba9d1a67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:21:27.772529 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db107af-8daf-4a06-8c50-6989ba9d1a67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:27.775691 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db107af-8daf-4a06-8c50-6989ba9d1a67 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:27.810249 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 789/1577] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:21:27.810249 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db107af-8daf-4a06-8c50-6989ba9d1a67 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:27.810740 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed2ab1-c679-40d8-8328-cb7523dbc83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:27.810740 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed2ab1-c679-40d8-8328-cb7523dbc83d admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:27.810740 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed2ab1-c679-40d8-8328-cb7523dbc83d admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:27.810740 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed2ab1-c679-40d8-8328-cb7523dbc83d admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:27.811357 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ed2ab1-c679-40d8-8328-cb7523dbc83d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:27.811357 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ed2ab1-c679-40d8-8328-cb7523dbc83d admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:27.815852 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db107af-8daf-4a06-8c50-6989ba9d1a67 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:27.822195 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc6bc43-d5c2-497b-8a35-c33b9acfabda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:27.823054 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6bc43-d5c2-497b-8a35-c33b9acfabda admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:27.823517 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6bc43-d5c2-497b-8a35-c33b9acfabda admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:27.824526 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6bc43-d5c2-497b-8a35-c33b9acfabda admin admin] PATH_INFO: `/v3/projects/7b259e7393694c4e8f88a6f0590ce393/users/6fd7dcb531994f118c09e661ae3c3526/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:27.852296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 789/1578] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:21:27 2022] POST /identity/v3/projects => generated 377 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:21:27.852606 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc6bc43-d5c2-497b-8a35-c33b9acfabda admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b259e7393694c4e8f88a6f0590ce393, user_id=6fd7dcb531994f118c09e661ae3c3526, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:27.852813 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed2ab1-c679-40d8-8328-cb7523dbc83d admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:27.853008 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc6bc43-d5c2-497b-8a35-c33b9acfabda admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:27.874943 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 790/1579] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:21:27 2022] PUT /identity/v3/projects/7b259e7393694c4e8f88a6f0590ce393/users/6fd7dcb531994f118c09e661ae3c3526/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:21:27.874943 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078924ad-55a2-4efe-b159-c5856e295b0d None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:27.875315 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078924ad-55a2-4efe-b159-c5856e295b0d None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:27.875597 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078924ad-55a2-4efe-b159-c5856e295b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:27.921730 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-078924ad-55a2-4efe-b159-c5856e295b0d None None] MFA Rules not processed for user `a3d381f3e0244896bb1945fc19376e4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:27.923526 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-078924ad-55a2-4efe-b159-c5856e295b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:27.950847 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed2ab1-c679-40d8-8328-cb7523dbc83d admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:28.008586 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 791/1580] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:21:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:21:28.009641 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078924ad-55a2-4efe-b159-c5856e295b0d None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:28.028665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f1d274-05ab-4481-9fb9-70ac7480ce4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:28.029288 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1d274-05ab-4481-9fb9-70ac7480ce4b admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:28.029564 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1d274-05ab-4481-9fb9-70ac7480ce4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:28.029833 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1d274-05ab-4481-9fb9-70ac7480ce4b admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:28.030518 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f1d274-05ab-4481-9fb9-70ac7480ce4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:28.032443 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f1d274-05ab-4481-9fb9-70ac7480ce4b admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:28.064756 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 790/1581] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:21:27 2022] POST /identity/v3/projects => generated 389 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:21:28.065395 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f1d274-05ab-4481-9fb9-70ac7480ce4b admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:28.087827 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:28.110702 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078924ad-55a2-4efe-b159-c5856e295b0d None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:28.136458 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:28.156085 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f1d274-05ab-4481-9fb9-70ac7480ce4b admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:28.161790 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c37acf-8a85-4f05-8c4b-38f86d765144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:28.162471 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c37acf-8a85-4f05-8c4b-38f86d765144 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:28.162747 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c37acf-8a85-4f05-8c4b-38f86d765144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:28.163017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c37acf-8a85-4f05-8c4b-38f86d765144 admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:28.163673 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c37acf-8a85-4f05-8c4b-38f86d765144 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:28.165663 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c37acf-8a85-4f05-8c4b-38f86d765144 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:28.192789 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 791/1582] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:21:28 2022] POST /identity/v3/users => generated 286 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:21:28.194181 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df2164-298d-456e-9c3c-e4872f09052f None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:28.194573 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df2164-298d-456e-9c3c-e4872f09052f None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:28.194947 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df2164-298d-456e-9c3c-e4872f09052f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:28.204376 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd21d7-5c98-462f-9b87-a2118a4c1b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:28.205393 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd21d7-5c98-462f-9b87-a2118a4c1b3e admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:28.205817 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd21d7-5c98-462f-9b87-a2118a4c1b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:28.206329 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd21d7-5c98-462f-9b87-a2118a4c1b3e admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:28.207124 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd21d7-5c98-462f-9b87-a2118a4c1b3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:21:28.207487 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd21d7-5c98-462f-9b87-a2118a4c1b3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:28.209255 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd21d7-5c98-462f-9b87-a2118a4c1b3e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:28.225259 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 792/1583] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:21:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:21:28.226695 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd21d7-5c98-462f-9b87-a2118a4c1b3e admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:28.230611 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-50df2164-298d-456e-9c3c-e4872f09052f None None] MFA Rules not processed for user `1e0dadb0488146148e6c8b5b242722ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:28.232130 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-50df2164-298d-456e-9c3c-e4872f09052f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:28.238849 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd21d7-5c98-462f-9b87-a2118a4c1b3e admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:28.246791 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07494f49-22ce-4c9f-ae61-9664c53e1508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:28.247711 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07494f49-22ce-4c9f-ae61-9664c53e1508 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:28.248140 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07494f49-22ce-4c9f-ae61-9664c53e1508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:28.248525 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07494f49-22ce-4c9f-ae61-9664c53e1508 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:28.249391 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07494f49-22ce-4c9f-ae61-9664c53e1508 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:28.252033 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07494f49-22ce-4c9f-ae61-9664c53e1508 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:28.294290 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 793/1584] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:21:28 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:21:28.294290 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07494f49-22ce-4c9f-ae61-9664c53e1508 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:28.349752 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 792/1585] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:21:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:21:28.349752 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245ce49-8bea-40ca-9455-be76ab6a61ca None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:28.349752 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245ce49-8bea-40ca-9455-be76ab6a61ca None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:28.349752 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245ce49-8bea-40ca-9455-be76ab6a61ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:28.384434 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-d245ce49-8bea-40ca-9455-be76ab6a61ca None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:28.384815 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07494f49-22ce-4c9f-ae61-9664c53e1508 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:28.386613 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-d245ce49-8bea-40ca-9455-be76ab6a61ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:28.389929 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd7c9e-5151-4a19-aad3-c3e013b818d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:28.390810 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd7c9e-5151-4a19-aad3-c3e013b818d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:28.391176 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd7c9e-5151-4a19-aad3-c3e013b818d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:28.391553 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd7c9e-5151-4a19-aad3-c3e013b818d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:28.392593 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd7c9e-5151-4a19-aad3-c3e013b818d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:28.394819 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd7c9e-5151-4a19-aad3-c3e013b818d7 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:28.400242 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 793/1586] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:21:28.401729 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245ce49-8bea-40ca-9455-be76ab6a61ca None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:28.425193 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 794/1587] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:21:28 2022] POST /identity/v3/users => generated 289 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:21:28.425439 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245ce49-8bea-40ca-9455-be76ab6a61ca None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:28.425552 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd7c9e-5151-4a19-aad3-c3e013b818d7 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:28.432213 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a990e04-e01d-4415-8846-28afe0e9c041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:28.432801 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd7c9e-5151-4a19-aad3-c3e013b818d7 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:28.433329 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a990e04-e01d-4415-8846-28afe0e9c041 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:28.434012 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a990e04-e01d-4415-8846-28afe0e9c041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:28.434541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a990e04-e01d-4415-8846-28afe0e9c041 admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:28.435723 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a990e04-e01d-4415-8846-28afe0e9c041 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:28.438296 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583b701-9773-460c-97bc-b25e0a4f0790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:28.438943 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583b701-9773-460c-97bc-b25e0a4f0790 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:28.439224 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583b701-9773-460c-97bc-b25e0a4f0790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:28.439507 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583b701-9773-460c-97bc-b25e0a4f0790 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:28.439654 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a990e04-e01d-4415-8846-28afe0e9c041 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:28.440181 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e583b701-9773-460c-97bc-b25e0a4f0790 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:28.442156 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e583b701-9773-460c-97bc-b25e0a4f0790 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:28.468404 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 795/1588] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:21:28 2022] POST /identity/v3/users => generated 295 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:21:28.469784 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583b701-9773-460c-97bc-b25e0a4f0790 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:28.483592 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583b701-9773-460c-97bc-b25e0a4f0790 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:28.489355 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200fe7b-722e-4fa3-893f-371ba572bcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:28.490114 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200fe7b-722e-4fa3-893f-371ba572bcba admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:28.490533 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200fe7b-722e-4fa3-893f-371ba572bcba admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:28.491044 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200fe7b-722e-4fa3-893f-371ba572bcba admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:28.491834 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2200fe7b-722e-4fa3-893f-371ba572bcba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:28.493686 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2200fe7b-722e-4fa3-893f-371ba572bcba admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:28.496916 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 794/1589] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:21:28 2022] POST /identity/v3/projects => generated 365 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:21:28.498476 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a990e04-e01d-4415-8846-28afe0e9c041 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:28.510214 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 796/1590] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:21:28.511629 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200fe7b-722e-4fa3-893f-371ba572bcba admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:28.523456 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200fe7b-722e-4fa3-893f-371ba572bcba admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:28.597390 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a990e04-e01d-4415-8846-28afe0e9c041 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:28.601566 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:28.604181 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b2c74-4eea-4eda-b200-31a27142abfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:28.606062 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b2c74-4eea-4eda-b200-31a27142abfb admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:28.606594 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b2c74-4eea-4eda-b200-31a27142abfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:28.607041 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b2c74-4eea-4eda-b200-31a27142abfb admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:28.608173 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b2c74-4eea-4eda-b200-31a27142abfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:28.612242 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b2c74-4eea-4eda-b200-31a27142abfb admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:28.613322 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ae42f-b4ba-4a49-b739-905ecd83e2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:28.614401 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ae42f-b4ba-4a49-b739-905ecd83e2f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:28.614891 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ae42f-b4ba-4a49-b739-905ecd83e2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:28.615324 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ae42f-b4ba-4a49-b739-905ecd83e2f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:28.616407 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ae42f-b4ba-4a49-b739-905ecd83e2f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:28.620018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ae42f-b4ba-4a49-b739-905ecd83e2f6 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:28.638524 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:28.655401 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 797/1591] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:21:28 2022] POST /identity/v3/users => generated 288 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:21:28.656993 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ae42f-b4ba-4a49-b739-905ecd83e2f6 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:28.660717 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 795/1592] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:21:28 2022] POST /identity/v3/projects => generated 385 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:21:28.662182 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b2c74-4eea-4eda-b200-31a27142abfb admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:28.743258 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ae42f-b4ba-4a49-b739-905ecd83e2f6 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:28.752880 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b2c74-4eea-4eda-b200-31a27142abfb admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:28.757570 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3992e8b-72a0-4af5-b8e9-38ad61f24258 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:28.758280 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3992e8b-72a0-4af5-b8e9-38ad61f24258 service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:28.758612 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3992e8b-72a0-4af5-b8e9-38ad61f24258 service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:28.758915 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3992e8b-72a0-4af5-b8e9-38ad61f24258 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:28.812416 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3111d-ce71-4dc5-9e12-d272166c6b79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:28.813070 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3111d-ce71-4dc5-9e12-d272166c6b79 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:28.813347 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3111d-ce71-4dc5-9e12-d272166c6b79 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:28.813617 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3111d-ce71-4dc5-9e12-d272166c6b79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:28.847531 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3992e8b-72a0-4af5-b8e9-38ad61f24258 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:28.850603 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3992e8b-72a0-4af5-b8e9-38ad61f24258 service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:28.864453 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 796/1593] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:21:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:21:28.865220 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3992e8b-72a0-4af5-b8e9-38ad61f24258 service neutron] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:28.877754 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3992e8b-72a0-4af5-b8e9-38ad61f24258 service neutron] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:28.884207 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874ce67-aaef-4fac-ad43-9ec6e77c5376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:28.884829 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874ce67-aaef-4fac-ad43-9ec6e77c5376 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:28.885115 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874ce67-aaef-4fac-ad43-9ec6e77c5376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:28.885380 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874ce67-aaef-4fac-ad43-9ec6e77c5376 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:28.886769 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874ce67-aaef-4fac-ad43-9ec6e77c5376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:28.887965 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874ce67-aaef-4fac-ad43-9ec6e77c5376 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:28.895934 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3111d-ce71-4dc5-9e12-d272166c6b79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:28.897419 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3111d-ce71-4dc5-9e12-d272166c6b79 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:28.900293 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 797/1594] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:21:28.901425 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874ce67-aaef-4fac-ad43-9ec6e77c5376 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:28.910020 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 798/1595] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:21:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:21:28.911084 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3111d-ce71-4dc5-9e12-d272166c6b79 service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:28.914225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874ce67-aaef-4fac-ad43-9ec6e77c5376 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:28.921093 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6720334-3950-40db-af46-7ec0c1d77ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:28.921796 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6720334-3950-40db-af46-7ec0c1d77ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:28.922227 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6720334-3950-40db-af46-7ec0c1d77ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:28.922515 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6720334-3950-40db-af46-7ec0c1d77ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:28.923258 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6720334-3950-40db-af46-7ec0c1d77ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:28.925068 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6720334-3950-40db-af46-7ec0c1d77ee8 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:28.930142 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3111d-ce71-4dc5-9e12-d272166c6b79 service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:28.937785 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb73aa-a156-4569-a11a-aee58f270274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:28.938458 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb73aa-a156-4569-a11a-aee58f270274 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:28.938741 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb73aa-a156-4569-a11a-aee58f270274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:28.939014 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb73aa-a156-4569-a11a-aee58f270274 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:28.939654 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb73aa-a156-4569-a11a-aee58f270274 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:28.941663 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb73aa-a156-4569-a11a-aee58f270274 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:28.943375 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 798/1596] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:21:28.945066 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6720334-3950-40db-af46-7ec0c1d77ee8 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:28.962572 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6720334-3950-40db-af46-7ec0c1d77ee8 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:28.970254 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 799/1597] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:21:28 2022] POST /identity/v3/users => generated 289 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:21:28.971077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5d7ef-5499-4829-90c1-26dd1b593a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:28.971225 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb73aa-a156-4569-a11a-aee58f270274 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:28.972256 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5d7ef-5499-4829-90c1-26dd1b593a1c admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:28.972918 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5d7ef-5499-4829-90c1-26dd1b593a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:28.973553 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5d7ef-5499-4829-90c1-26dd1b593a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:28.974738 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5d7ef-5499-4829-90c1-26dd1b593a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:28.976745 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5d7ef-5499-4829-90c1-26dd1b593a1c admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:28.991059 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb73aa-a156-4569-a11a-aee58f270274 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:28.991351 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 799/1598] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:21:28.992523 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5d7ef-5499-4829-90c1-26dd1b593a1c admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:29.003186 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120368d-8441-4924-a4a2-7007169a293c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:29.004573 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120368d-8441-4924-a4a2-7007169a293c admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:29.005073 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120368d-8441-4924-a4a2-7007169a293c admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:29.005554 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120368d-8441-4924-a4a2-7007169a293c admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:29.006121 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5d7ef-5499-4829-90c1-26dd1b593a1c admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:29.007228 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0120368d-8441-4924-a4a2-7007169a293c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:29.010262 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0120368d-8441-4924-a4a2-7007169a293c admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:29.012428 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b54cb-ee1f-434d-b4cc-e89229514fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:29.013323 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b54cb-ee1f-434d-b4cc-e89229514fdd admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:29.013746 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b54cb-ee1f-434d-b4cc-e89229514fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:29.014445 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b54cb-ee1f-434d-b4cc-e89229514fdd admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:29.015280 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b54cb-ee1f-434d-b4cc-e89229514fdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:29.018225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b54cb-ee1f-434d-b4cc-e89229514fdd admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:29.038265 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 800/1599] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:21:29.039446 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120368d-8441-4924-a4a2-7007169a293c admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:29.054047 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120368d-8441-4924-a4a2-7007169a293c admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:29.058824 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 800/1600] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:21:28 2022] POST /identity/v3/users => generated 293 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:21:29.058824 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b54cb-ee1f-434d-b4cc-e89229514fdd admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:29.069266 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64cca9-4df1-4056-8ab4-f9605799f0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:29.070536 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64cca9-4df1-4056-8ab4-f9605799f0b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:29.071117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64cca9-4df1-4056-8ab4-f9605799f0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:29.071871 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64cca9-4df1-4056-8ab4-f9605799f0b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:29.073314 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa64cca9-4df1-4056-8ab4-f9605799f0b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:29.078228 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa64cca9-4df1-4056-8ab4-f9605799f0b0 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:29.087013 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b54cb-ee1f-434d-b4cc-e89229514fdd admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:29.092691 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b07212-ea7d-4be3-8f13-d9f44682827b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:29.093373 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b07212-ea7d-4be3-8f13-d9f44682827b admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:29.093841 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b07212-ea7d-4be3-8f13-d9f44682827b admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:29.094120 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b07212-ea7d-4be3-8f13-d9f44682827b admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:29.095239 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b07212-ea7d-4be3-8f13-d9f44682827b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:29.097474 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b07212-ea7d-4be3-8f13-d9f44682827b admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:29.104011 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 801/1601] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:21:29.107079 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64cca9-4df1-4056-8ab4-f9605799f0b0 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:29.115531 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 801/1602] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:21:29.116270 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b07212-ea7d-4be3-8f13-d9f44682827b admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:29.132105 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64cca9-4df1-4056-8ab4-f9605799f0b0 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:29.132754 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b07212-ea7d-4be3-8f13-d9f44682827b admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:29.139119 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c94b7-3e28-449e-af75-bf5fbfeb6efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:29.139918 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c94b7-3e28-449e-af75-bf5fbfeb6efa admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:29.140445 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c94b7-3e28-449e-af75-bf5fbfeb6efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:29.140828 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c94b7-3e28-449e-af75-bf5fbfeb6efa admin admin] PATH_INFO: `/v3/projects/a0b828c869f24714903b303a32fd2ffc/users/41c6be7d7eb34e2b99d04a5adbb1fc7e/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:29.143217 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd4c20-a213-4869-ab24-f53a3143f716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:29.144309 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd4c20-a213-4869-ab24-f53a3143f716 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:29.145618 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd4c20-a213-4869-ab24-f53a3143f716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:29.145618 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd4c20-a213-4869-ab24-f53a3143f716 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:29.146578 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd4c20-a213-4869-ab24-f53a3143f716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:29.149910 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd4c20-a213-4869-ab24-f53a3143f716 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:29.173597 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c94b7-3e28-449e-af75-bf5fbfeb6efa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0b828c869f24714903b303a32fd2ffc, user_id=41c6be7d7eb34e2b99d04a5adbb1fc7e, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:29.177455 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 802/1603] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:21:29.177455 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd4c20-a213-4869-ab24-f53a3143f716 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:29.179033 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c94b7-3e28-449e-af75-bf5fbfeb6efa admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:29.196494 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd4c20-a213-4869-ab24-f53a3143f716 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:29.202523 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:29.214571 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 802/1604] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:21:29 2022] PUT /identity/v3/projects/a0b828c869f24714903b303a32fd2ffc/users/41c6be7d7eb34e2b99d04a5adbb1fc7e/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:21:29.217887 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c94b7-3e28-449e-af75-bf5fbfeb6efa admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:29.266670 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:29.337437 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b5630-e50e-416c-a9f5-108a668aad90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:29.338836 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b5630-e50e-416c-a9f5-108a668aad90 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:29.339313 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b5630-e50e-416c-a9f5-108a668aad90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:29.339770 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b5630-e50e-416c-a9f5-108a668aad90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:29.341376 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b5630-e50e-416c-a9f5-108a668aad90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:29.351564 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b5630-e50e-416c-a9f5-108a668aad90 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:29.390028 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 803/1605] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:21:29.391856 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b5630-e50e-416c-a9f5-108a668aad90 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:29.392341 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c94b7-3e28-449e-af75-bf5fbfeb6efa admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:29.402743 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25e4a4-a94b-40f7-bc4e-e0d306d50725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:29.403387 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25e4a4-a94b-40f7-bc4e-e0d306d50725 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:29.403728 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25e4a4-a94b-40f7-bc4e-e0d306d50725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:29.404014 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25e4a4-a94b-40f7-bc4e-e0d306d50725 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:29.404894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25e4a4-a94b-40f7-bc4e-e0d306d50725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:29.411394 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25e4a4-a94b-40f7-bc4e-e0d306d50725 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:29.418551 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b5630-e50e-416c-a9f5-108a668aad90 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:29.433575 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419115a-6f96-4f38-a58c-c6a01b2c763d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:29.435339 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419115a-6f96-4f38-a58c-c6a01b2c763d admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:29.436053 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419115a-6f96-4f38-a58c-c6a01b2c763d admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:29.436573 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419115a-6f96-4f38-a58c-c6a01b2c763d admin admin] PATH_INFO: `/v3/projects/92b1992487614a7f80a0acbd67a4050a/users/d71346f5c4fd4fefa706b1c66873e903/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:29.445691 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 803/1606] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:21:29.447581 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25e4a4-a94b-40f7-bc4e-e0d306d50725 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:29.472612 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25e4a4-a94b-40f7-bc4e-e0d306d50725 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:29.476224 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6419115a-6f96-4f38-a58c-c6a01b2c763d admin admin] RBAC: Authorizing `identity:create_grant(project_id=92b1992487614a7f80a0acbd67a4050a, user_id=d71346f5c4fd4fefa706b1c66873e903, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:29.482496 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de28d4-edfb-4bb7-ad8d-d9107f047a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:29.483841 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de28d4-edfb-4bb7-ad8d-d9107f047a3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:29.484578 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de28d4-edfb-4bb7-ad8d-d9107f047a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:29.485057 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de28d4-edfb-4bb7-ad8d-d9107f047a3f admin admin] PATH_INFO: `/v3/projects/2bb52cc7397e4539a89fe5a831c85894/users/e82cb48b04eb42b99160934b1c8b1f7f/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:29.485886 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6419115a-6f96-4f38-a58c-c6a01b2c763d admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:29.530333 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4de28d4-edfb-4bb7-ad8d-d9107f047a3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bb52cc7397e4539a89fe5a831c85894, user_id=e82cb48b04eb42b99160934b1c8b1f7f, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:29.532405 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 804/1607] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:21:29 2022] PUT /identity/v3/projects/92b1992487614a7f80a0acbd67a4050a/users/d71346f5c4fd4fefa706b1c66873e903/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:21:29.534730 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419115a-6f96-4f38-a58c-c6a01b2c763d admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:29.536363 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4de28d4-edfb-4bb7-ad8d-d9107f047a3f admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:29.593712 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 804/1608] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:21:29 2022] PUT /identity/v3/projects/2bb52cc7397e4539a89fe5a831c85894/users/e82cb48b04eb42b99160934b1c8b1f7f/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:21:29.596819 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e235538-2cb8-4c17-8de6-ea3807730a2c None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:29.597587 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e235538-2cb8-4c17-8de6-ea3807730a2c None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:29.598830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e235538-2cb8-4c17-8de6-ea3807730a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:29.687012 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-1e235538-2cb8-4c17-8de6-ea3807730a2c None None] MFA Rules not processed for user `41c6be7d7eb34e2b99d04a5adbb1fc7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:29.696609 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-1e235538-2cb8-4c17-8de6-ea3807730a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:29.749007 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419115a-6f96-4f38-a58c-c6a01b2c763d admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:29.812637 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 805/1609] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:21:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:21:29.814329 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e235538-2cb8-4c17-8de6-ea3807730a2c None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:29.845442 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd933336-ea0c-4956-90de-de860914bf20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:29.847672 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd933336-ea0c-4956-90de-de860914bf20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:29.848187 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd933336-ea0c-4956-90de-de860914bf20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:29.848668 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd933336-ea0c-4956-90de-de860914bf20 admin admin] PATH_INFO: `/v3/projects/7aa30de1e34044c6951255dde971f2f2/users/98f26d402d9d4c6abd609e8b7418d274/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:29.882577 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd933336-ea0c-4956-90de-de860914bf20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aa30de1e34044c6951255dde971f2f2, user_id=98f26d402d9d4c6abd609e8b7418d274, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:29.890572 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd933336-ea0c-4956-90de-de860914bf20 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:29.949723 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 805/1610] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:21:29 2022] PUT /identity/v3/projects/7aa30de1e34044c6951255dde971f2f2/users/98f26d402d9d4c6abd609e8b7418d274/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:21:29.958993 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd933336-ea0c-4956-90de-de860914bf20 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:29.969479 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e235538-2cb8-4c17-8de6-ea3807730a2c None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:29.997362 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:30.056249 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:30.112813 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044e49d-e876-4805-b13d-94bb40052ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:30.114768 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044e49d-e876-4805-b13d-94bb40052ebc admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:30.115679 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044e49d-e876-4805-b13d-94bb40052ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:30.116130 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044e49d-e876-4805-b13d-94bb40052ebc admin admin] PATH_INFO: `/v3/projects/280996f37cda406ab3d23f5cb0911dd1/users/a55997792b7843439d62ef7d5245382b/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:30.138041 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044e49d-e876-4805-b13d-94bb40052ebc admin admin] RBAC: Authorizing `identity:create_grant(project_id=280996f37cda406ab3d23f5cb0911dd1, user_id=a55997792b7843439d62ef7d5245382b, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:30.138820 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd933336-ea0c-4956-90de-de860914bf20 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:30.142266 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044e49d-e876-4805-b13d-94bb40052ebc admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:30.145221 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f076b-3477-4a9c-956e-bbd0702e8db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:30.146226 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f076b-3477-4a9c-956e-bbd0702e8db7 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:30.146734 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f076b-3477-4a9c-956e-bbd0702e8db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:30.147346 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f076b-3477-4a9c-956e-bbd0702e8db7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:30.148511 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f076b-3477-4a9c-956e-bbd0702e8db7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:30.150618 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f076b-3477-4a9c-956e-bbd0702e8db7 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:30.168262 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 806/1611] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:21:29 2022] PUT /identity/v3/projects/280996f37cda406ab3d23f5cb0911dd1/users/a55997792b7843439d62ef7d5245382b/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:21:30.169032 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 806/1612] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:21:30.170704 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7ccd5-ea9d-4b06-ae8a-a16d5348561a None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:30.170975 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6575e-32b0-44b9-ad86-37227855bed7 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:30.171217 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7ccd5-ea9d-4b06-ae8a-a16d5348561a None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:30.171677 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6575e-32b0-44b9-ad86-37227855bed7 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:30.171790 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7ccd5-ea9d-4b06-ae8a-a16d5348561a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:30.172247 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6575e-32b0-44b9-ad86-37227855bed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:30.201373 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-93e7ccd5-ea9d-4b06-ae8a-a16d5348561a None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:30.202952 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-93e7ccd5-ea9d-4b06-ae8a-a16d5348561a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:30.213397 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-aec6575e-32b0-44b9-ad86-37227855bed7 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:30.215812 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-aec6575e-32b0-44b9-ad86-37227855bed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:30.311485 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 807/1613] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:21:30.312768 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7ccd5-ea9d-4b06-ae8a-a16d5348561a None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:30.324835 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 807/1614] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:21:30.326313 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6575e-32b0-44b9-ad86-37227855bed7 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:30.332093 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7ccd5-ea9d-4b06-ae8a-a16d5348561a None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:30.339237 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6575e-32b0-44b9-ad86-37227855bed7 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:30.345637 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b0737-a741-4230-a8a1-ec34d06eedd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:30.346458 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b0737-a741-4230-a8a1-ec34d06eedd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:30.346655 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050832c0-00c7-4ab4-b96a-39b977cf2970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:30.347083 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b0737-a741-4230-a8a1-ec34d06eedd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:30.347287 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050832c0-00c7-4ab4-b96a-39b977cf2970 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:30.347550 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b0737-a741-4230-a8a1-ec34d06eedd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:30.347661 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050832c0-00c7-4ab4-b96a-39b977cf2970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:30.347834 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050832c0-00c7-4ab4-b96a-39b977cf2970 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:30.348459 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b0737-a741-4230-a8a1-ec34d06eedd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:30.348567 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050832c0-00c7-4ab4-b96a-39b977cf2970 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:30.350482 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050832c0-00c7-4ab4-b96a-39b977cf2970 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:30.350630 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b0737-a741-4230-a8a1-ec34d06eedd2 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:30.364146 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 808/1615] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:21:30.365760 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac9294-f0f6-4fbc-94b6-955d71c61be2 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:30.366168 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac9294-f0f6-4fbc-94b6-955d71c61be2 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:30.366567 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac9294-f0f6-4fbc-94b6-955d71c61be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:30.389943 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-73ac9294-f0f6-4fbc-94b6-955d71c61be2 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:30.391620 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-73ac9294-f0f6-4fbc-94b6-955d71c61be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:30.400233 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 808/1616] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:21:30 2022] POST /identity/v3/projects => generated 373 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:21:30.400233 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050832c0-00c7-4ab4-b96a-39b977cf2970 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:30.406401 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 809/1617] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:21:30.407702 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac9294-f0f6-4fbc-94b6-955d71c61be2 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:30.499358 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac9294-f0f6-4fbc-94b6-955d71c61be2 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:30.510437 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050832c0-00c7-4ab4-b96a-39b977cf2970 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:30.516449 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d90588-7d45-417a-ab8c-a1a9cb97328e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:30.517856 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d90588-7d45-417a-ab8c-a1a9cb97328e admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:30.518117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d90588-7d45-417a-ab8c-a1a9cb97328e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:30.518491 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d90588-7d45-417a-ab8c-a1a9cb97328e admin admin] PATH_INFO: `/v3/projects/6aac7fa433e54b0989e78322432d20f7/users/cf20489fb7624e34b71ed9f03c2f50d7/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:30.545579 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d90588-7d45-417a-ab8c-a1a9cb97328e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aac7fa433e54b0989e78322432d20f7, user_id=cf20489fb7624e34b71ed9f03c2f50d7, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:30.549521 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d90588-7d45-417a-ab8c-a1a9cb97328e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:30.578140 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 809/1618] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:21:30 2022] PUT /identity/v3/projects/6aac7fa433e54b0989e78322432d20f7/users/cf20489fb7624e34b71ed9f03c2f50d7/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:21:30.579283 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d90588-7d45-417a-ab8c-a1a9cb97328e admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:30.590295 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:30.623358 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:30.634089 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182d37e-b93d-4b80-a5b9-2877207f8778 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:30.635648 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182d37e-b93d-4b80-a5b9-2877207f8778 service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:30.636426 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182d37e-b93d-4b80-a5b9-2877207f8778 service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:30.636975 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182d37e-b93d-4b80-a5b9-2877207f8778 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:30.657602 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1182d37e-b93d-4b80-a5b9-2877207f8778 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:30.662129 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1182d37e-b93d-4b80-a5b9-2877207f8778 service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:30.666647 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d90588-7d45-417a-ab8c-a1a9cb97328e admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:30.672636 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fd0fa-9967-4ac2-8dff-ce693d692635 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:30.673487 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fd0fa-9967-4ac2-8dff-ce693d692635 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:30.673956 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fd0fa-9967-4ac2-8dff-ce693d692635 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:30.674467 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fd0fa-9967-4ac2-8dff-ce693d692635 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:30.686179 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 810/1619] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:21:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:21:30.688341 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182d37e-b93d-4b80-a5b9-2877207f8778 service neutron] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:30.716753 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182d37e-b93d-4b80-a5b9-2877207f8778 service neutron] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:30.877915 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0fd0fa-9967-4ac2-8dff-ce693d692635 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:30.879896 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0fd0fa-9967-4ac2-8dff-ce693d692635 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:30.896303 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 810/1620] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:21:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:21:30.897454 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fd0fa-9967-4ac2-8dff-ce693d692635 service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:30.912328 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fd0fa-9967-4ac2-8dff-ce693d692635 service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:30.920457 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82900333-1b0a-466a-a9c2-7854cc7c4f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:30.921124 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82900333-1b0a-466a-a9c2-7854cc7c4f8f admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:30.921527 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82900333-1b0a-466a-a9c2-7854cc7c4f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:30.921911 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82900333-1b0a-466a-a9c2-7854cc7c4f8f admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:30.922856 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82900333-1b0a-466a-a9c2-7854cc7c4f8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:30.925312 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82900333-1b0a-466a-a9c2-7854cc7c4f8f admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:30.935082 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebbb15-eab6-4779-ae1a-ea3062029671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:30.937047 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebbb15-eab6-4779-ae1a-ea3062029671 admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:30.937826 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebbb15-eab6-4779-ae1a-ea3062029671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:30.938599 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebbb15-eab6-4779-ae1a-ea3062029671 admin admin] PATH_INFO: `/v3/projects/7aa30de1e34044c6951255dde971f2f2/users/98f26d402d9d4c6abd609e8b7418d274/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:30.943474 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ebbb15-eab6-4779-ae1a-ea3062029671 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aa30de1e34044c6951255dde971f2f2, user_id=98f26d402d9d4c6abd609e8b7418d274, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:30.951556 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ebbb15-eab6-4779-ae1a-ea3062029671 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:30.967488 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 811/1621] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:21:30 2022] POST /identity/v3/users => generated 293 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:21:30.969775 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82900333-1b0a-466a-a9c2-7854cc7c4f8f admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:31.000796 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82900333-1b0a-466a-a9c2-7854cc7c4f8f admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:31.015506 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 811/1622] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:21:30 2022] PUT /identity/v3/projects/7aa30de1e34044c6951255dde971f2f2/users/98f26d402d9d4c6abd609e8b7418d274/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:21:31.021620 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c3ba6-e503-4c81-a93b-292472eee939 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:31.022311 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c3ba6-e503-4c81-a93b-292472eee939 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:31.022832 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c3ba6-e503-4c81-a93b-292472eee939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:31.075023 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-be2c3ba6-e503-4c81-a93b-292472eee939 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:31.081405 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-be2c3ba6-e503-4c81-a93b-292472eee939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:31.198465 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ae12a-f081-455e-aa0a-9d3077223a72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:31.201000 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ae12a-f081-455e-aa0a-9d3077223a72 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:31.201496 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ae12a-f081-455e-aa0a-9d3077223a72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:31.201885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ae12a-f081-455e-aa0a-9d3077223a72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:31.304135 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 812/1623] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:21:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:21:31.310958 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c3ba6-e503-4c81-a93b-292472eee939 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:31.329237 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c3ba6-e503-4c81-a93b-292472eee939 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:31.338586 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad99fcb-0aea-45c1-9669-10f306e44400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:31.340208 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad99fcb-0aea-45c1-9669-10f306e44400 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:31.341083 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad99fcb-0aea-45c1-9669-10f306e44400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:31.341553 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad99fcb-0aea-45c1-9669-10f306e44400 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:31.343085 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad99fcb-0aea-45c1-9669-10f306e44400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:31.346289 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad99fcb-0aea-45c1-9669-10f306e44400 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:31.381546 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 813/1624] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:21:31.385118 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f906ed4-9284-468d-9397-54f8882d50cb None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:31.386767 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f906ed4-9284-468d-9397-54f8882d50cb None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:31.387339 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f906ed4-9284-468d-9397-54f8882d50cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:31.430130 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:31.459608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-7f906ed4-9284-468d-9397-54f8882d50cb None None] MFA Rules not processed for user `98f26d402d9d4c6abd609e8b7418d274`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:31.461802 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-7f906ed4-9284-468d-9397-54f8882d50cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:31.473347 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ae12a-f081-455e-aa0a-9d3077223a72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:31.476183 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ae12a-f081-455e-aa0a-9d3077223a72 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:31.494976 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 812/1625] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:21:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:21:31.497700 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ae12a-f081-455e-aa0a-9d3077223a72 service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:31.501090 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-425ae12a-f081-455e-aa0a-9d3077223a72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:31.524011 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ae12a-f081-455e-aa0a-9d3077223a72 service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:31.530698 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef89d5-aeec-4e52-8919-0e1aade6f174 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:31.532134 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef89d5-aeec-4e52-8919-0e1aade6f174 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:31.532346 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef89d5-aeec-4e52-8919-0e1aade6f174 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:31.532819 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef89d5-aeec-4e52-8919-0e1aade6f174 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:31.553529 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef89d5-aeec-4e52-8919-0e1aade6f174 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:31.564988 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef89d5-aeec-4e52-8919-0e1aade6f174 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:31.587622 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 813/1626] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:21:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:21:31.589764 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef89d5-aeec-4e52-8919-0e1aade6f174 service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:31.680789 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef89d5-aeec-4e52-8919-0e1aade6f174 service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:31.680789 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b4c75-722a-47b5-b18e-2bab1b3f943a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:31.680789 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b4c75-722a-47b5-b18e-2bab1b3f943a admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:31.680789 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b4c75-722a-47b5-b18e-2bab1b3f943a admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:31.683772 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b4c75-722a-47b5-b18e-2bab1b3f943a admin admin] PATH_INFO: `/v3/projects/b0917bbb960647c1b9d1122751e561b0/users/1590f4ad3c154a03aa2b44cc3950978b/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:31.684982 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:31.685175 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b4c75-722a-47b5-b18e-2bab1b3f943a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0917bbb960647c1b9d1122751e561b0, user_id=1590f4ad3c154a03aa2b44cc3950978b, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:31.685175 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b4c75-722a-47b5-b18e-2bab1b3f943a admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:31.685490 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 814/1627] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:21:31 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:21:31.705363 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f906ed4-9284-468d-9397-54f8882d50cb None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:31.720675 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 814/1628] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:21:31 2022] PUT /identity/v3/projects/b0917bbb960647c1b9d1122751e561b0/users/1590f4ad3c154a03aa2b44cc3950978b/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:21:31.727058 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b4c75-722a-47b5-b18e-2bab1b3f943a admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:31.848765 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f906ed4-9284-468d-9397-54f8882d50cb None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:31.872196 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b4c75-722a-47b5-b18e-2bab1b3f943a admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:31.878727 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dcac48-b6da-4796-8b4a-8cd33b00c98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:31.879593 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dcac48-b6da-4796-8b4a-8cd33b00c98c admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:31.880031 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dcac48-b6da-4796-8b4a-8cd33b00c98c admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:31.880413 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dcac48-b6da-4796-8b4a-8cd33b00c98c admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:31.881883 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dcac48-b6da-4796-8b4a-8cd33b00c98c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:31.883731 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dcac48-b6da-4796-8b4a-8cd33b00c98c admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:31.905068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 815/1629] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:21:31.906089 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dcac48-b6da-4796-8b4a-8cd33b00c98c admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:31.925819 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dcac48-b6da-4796-8b4a-8cd33b00c98c admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:31.936617 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e8441-e7ed-45b2-974c-8e9dfc21d5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:31.939487 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e8441-e7ed-45b2-974c-8e9dfc21d5f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:31.940114 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e8441-e7ed-45b2-974c-8e9dfc21d5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:31.940744 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e8441-e7ed-45b2-974c-8e9dfc21d5f4 admin admin] PATH_INFO: `/v3/projects/b0917bbb960647c1b9d1122751e561b0/users/1590f4ad3c154a03aa2b44cc3950978b/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:31.943513 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e8441-e7ed-45b2-974c-8e9dfc21d5f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0917bbb960647c1b9d1122751e561b0, user_id=1590f4ad3c154a03aa2b44cc3950978b, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:31.948746 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e8441-e7ed-45b2-974c-8e9dfc21d5f4 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:31.992443 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 816/1630] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:21:31 2022] PUT /identity/v3/projects/b0917bbb960647c1b9d1122751e561b0/users/1590f4ad3c154a03aa2b44cc3950978b/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:21:31.997287 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e9c02-49b5-4822-98b9-67533ee97d0c None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:31.997874 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e9c02-49b5-4822-98b9-67533ee97d0c None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:31.998393 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e9c02-49b5-4822-98b9-67533ee97d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:32.001809 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32486f2c-3e59-43d1-bb65-237a705988dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:32.005229 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32486f2c-3e59-43d1-bb65-237a705988dd service cinder] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:32.006141 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32486f2c-3e59-43d1-bb65-237a705988dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:32.006887 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32486f2c-3e59-43d1-bb65-237a705988dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:32.090212 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-b28e9c02-49b5-4822-98b9-67533ee97d0c None None] MFA Rules not processed for user `1590f4ad3c154a03aa2b44cc3950978b`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:32.091828 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b28e9c02-49b5-4822-98b9-67533ee97d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:32.229359 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32486f2c-3e59-43d1-bb65-237a705988dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:32.234135 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32486f2c-3e59-43d1-bb65-237a705988dd service cinder] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:32.265129 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 815/1631] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:21:31 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:21:32.267913 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596896d6-cbd8-4e4a-9eeb-545b4d1aaf12 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:32.272920 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596896d6-cbd8-4e4a-9eeb-545b4d1aaf12 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:32.273296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596896d6-cbd8-4e4a-9eeb-545b4d1aaf12 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:32.277515 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 816/1632] 10.222.0.60 () {54 vars in 965 bytes} [Wed Sep 21 12:21:32 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:21:32.287139 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 817/1633] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:21:31 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:21:32.295377 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb46c1-d475-41c2-82bf-49f026324a22 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:32.295704 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb46c1-d475-41c2-82bf-49f026324a22 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:32.296022 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb46c1-d475-41c2-82bf-49f026324a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:32.310309 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e9c02-49b5-4822-98b9-67533ee97d0c None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:32.389721 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:32.392905 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-0ccb46c1-d475-41c2-82bf-49f026324a22 None None] MFA Rules not processed for user `6cb4001f94b8439180ca2a93d3b279b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:32.394262 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-0ccb46c1-d475-41c2-82bf-49f026324a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:32.589646 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e9c02-49b5-4822-98b9-67533ee97d0c None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:32.609288 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd734cb-4baf-4ea8-b8c3-5eb859a6f1a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:32.610400 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd734cb-4baf-4ea8-b8c3-5eb859a6f1a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:32.610913 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd734cb-4baf-4ea8-b8c3-5eb859a6f1a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:32.611420 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd734cb-4baf-4ea8-b8c3-5eb859a6f1a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:32.654402 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd734cb-4baf-4ea8-b8c3-5eb859a6f1a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:32.657343 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd734cb-4baf-4ea8-b8c3-5eb859a6f1a5 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:32.670439 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:32.718488 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 818/1634] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:21:32 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:21:32.721020 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd734cb-4baf-4ea8-b8c3-5eb859a6f1a5 service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:32.754486 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd734cb-4baf-4ea8-b8c3-5eb859a6f1a5 service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:32.768577 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 817/1635] 10.222.0.60 () {58 vars in 1062 bytes} [Wed Sep 21 12:21:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:21:32.771011 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93f693-9e9e-400a-9351-e78fe384a0b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:32.771998 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93f693-9e9e-400a-9351-e78fe384a0b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:32.772481 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93f693-9e9e-400a-9351-e78fe384a0b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:32.773168 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93f693-9e9e-400a-9351-e78fe384a0b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:32.778742 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a3fe1-99b5-4c74-a3e5-b92553249266 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:32.778742 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a3fe1-99b5-4c74-a3e5-b92553249266 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:32.778742 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a3fe1-99b5-4c74-a3e5-b92553249266 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:32.781920 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 818/1636] 10.222.0.60 () {54 vars in 912 bytes} [Wed Sep 21 12:21:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:21:32.788959 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a9dae-9175-4c3b-8b11-d3cb24bcd96e None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:32.789458 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a9dae-9175-4c3b-8b11-d3cb24bcd96e None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:32.789898 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a9dae-9175-4c3b-8b11-d3cb24bcd96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:32.857971 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-132a9dae-9175-4c3b-8b11-d3cb24bcd96e None None] MFA Rules not processed for user `6cb4001f94b8439180ca2a93d3b279b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:32.860410 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-132a9dae-9175-4c3b-8b11-d3cb24bcd96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:32.881819 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 819/1637] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Sep 21 12:21:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:21:32.905545 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad93f693-9e9e-400a-9351-e78fe384a0b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:32.910269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad93f693-9e9e-400a-9351-e78fe384a0b1 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:32.922926 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a9dae-9175-4c3b-8b11-d3cb24bcd96e None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:32.929045 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 819/1638] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:21:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:21:32.942999 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a9dae-9175-4c3b-8b11-d3cb24bcd96e None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:32.952827 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47ab89-b77b-4407-88c8-7dbd17f024e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:32.954040 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47ab89-b77b-4407-88c8-7dbd17f024e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:32.954579 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47ab89-b77b-4407-88c8-7dbd17f024e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:32.955141 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47ab89-b77b-4407-88c8-7dbd17f024e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:32.981658 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47ab89-b77b-4407-88c8-7dbd17f024e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:32.988620 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47ab89-b77b-4407-88c8-7dbd17f024e1 service cinder] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:33.033359 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 820/1639] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:21:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:21:33.121912 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93f693-9e9e-400a-9351-e78fe384a0b1 service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:33.134991 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93f693-9e9e-400a-9351-e78fe384a0b1 service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:33.153395 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ffa6b6-2b00-4eae-9211-1f08838ee887 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:33.154033 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffa6b6-2b00-4eae-9211-1f08838ee887 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:33.154334 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffa6b6-2b00-4eae-9211-1f08838ee887 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:33.154638 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffa6b6-2b00-4eae-9211-1f08838ee887 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:33.257041 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ffa6b6-2b00-4eae-9211-1f08838ee887 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:33.258872 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ffa6b6-2b00-4eae-9211-1f08838ee887 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:33.274541 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 820/1640] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:21:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:21:35.877486 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a2af4-165c-4191-81f6-eebe19606a1e None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:35.878112 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a2af4-165c-4191-81f6-eebe19606a1e None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:35.878779 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a2af4-165c-4191-81f6-eebe19606a1e None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:35.880989 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 821/1641] 10.222.0.60 () {54 vars in 965 bytes} [Wed Sep 21 12:21:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:21:35.893106 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62bd49-d09b-4f2e-b9e1-9f46195485ad None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:35.894382 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62bd49-d09b-4f2e-b9e1-9f46195485ad None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:35.894908 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62bd49-d09b-4f2e-b9e1-9f46195485ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:35.932023 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-8c62bd49-d09b-4f2e-b9e1-9f46195485ad None None] MFA Rules not processed for user `6cb4001f94b8439180ca2a93d3b279b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:35.935097 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-8c62bd49-d09b-4f2e-b9e1-9f46195485ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:35.953834 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d9663-36dd-4ac9-ac1e-93dbf31aafd2 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:35.966414 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d9663-36dd-4ac9-ac1e-93dbf31aafd2 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:35.966414 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d9663-36dd-4ac9-ac1e-93dbf31aafd2 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:35.966414 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 822/1642] 10.222.0.60 () {54 vars in 912 bytes} [Wed Sep 21 12:21:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:21:35.966414 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c0079-6062-4a70-88cb-abf90f43b3fb None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:35.967706 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c0079-6062-4a70-88cb-abf90f43b3fb None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:35.967706 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c0079-6062-4a70-88cb-abf90f43b3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:35.972545 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 821/1643] 10.222.0.60 () {58 vars in 1062 bytes} [Wed Sep 21 12:21:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:21:36.036911 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-3c7c0079-6062-4a70-88cb-abf90f43b3fb None None] MFA Rules not processed for user `6cb4001f94b8439180ca2a93d3b279b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:36.043101 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-3c7c0079-6062-4a70-88cb-abf90f43b3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:36.073321 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 823/1644] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Sep 21 12:21:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:21:36.102702 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c62bd49-d09b-4f2e-b9e1-9f46195485ad None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:36.128176 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c62bd49-d09b-4f2e-b9e1-9f46195485ad None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:36.155666 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29e014-2c9e-46f8-b3c9-a89cb1c6e30d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:36.159786 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29e014-2c9e-46f8-b3c9-a89cb1c6e30d service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:36.160577 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29e014-2c9e-46f8-b3c9-a89cb1c6e30d service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:36.162179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29e014-2c9e-46f8-b3c9-a89cb1c6e30d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:36.208037 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29e014-2c9e-46f8-b3c9-a89cb1c6e30d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:36.211450 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29e014-2c9e-46f8-b3c9-a89cb1c6e30d service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:36.253293 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 822/1645] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:21:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:21:36.581271 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c0079-6062-4a70-88cb-abf90f43b3fb None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:36.785529 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c0079-6062-4a70-88cb-abf90f43b3fb None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:36.799457 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7dd607-1906-4597-965a-f15ac1f950e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:36.800308 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7dd607-1906-4597-965a-f15ac1f950e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:36.800753 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7dd607-1906-4597-965a-f15ac1f950e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:36.801205 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7dd607-1906-4597-965a-f15ac1f950e0 admin admin] PATH_INFO: `/v3/users/a3d381f3e0244896bb1945fc19376e4c` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:36.806047 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7dd607-1906-4597-965a-f15ac1f950e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3d381f3e0244896bb1945fc19376e4c)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:36.809070 dv-cinder-858678-1-smb devstack@keystone.service[81377]: WARNING py.warnings [None req-9c7dd607-1906-4597-965a-f15ac1f950e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 12:21:36.809070 dv-cinder-858678-1-smb devstack@keystone.service[81377]: warnings.warn(msg) Sep 21 12:21:36.809070 dv-cinder-858678-1-smb devstack@keystone.service[81377]: Sep 21 12:21:36.814199 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7dd607-1906-4597-965a-f15ac1f950e0 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:37.090299 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-9c7dd607-1906-4597-965a-f15ac1f950e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3d381f3e0244896bb1945fc19376e4c'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:21:37.147992 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-9c7dd607-1906-4597-965a-f15ac1f950e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3d381f3e0244896bb1945fc19376e4c'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:21:37.172543 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-9c7dd607-1906-4597-965a-f15ac1f950e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3d381f3e0244896bb1945fc19376e4c'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:21:37.176758 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-9c7dd607-1906-4597-965a-f15ac1f950e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3d381f3e0244896bb1945fc19376e4c'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:21:37.272443 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-9c7dd607-1906-4597-965a-f15ac1f950e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3d381f3e0244896bb1945fc19376e4c'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:21:37.295553 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 824/1646] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:21:36 2022] DELETE /identity/v3/users/a3d381f3e0244896bb1945fc19376e4c => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:21:37.298793 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7c794-07ca-4600-b3e5-7dcabb3942ac None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:37.300403 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7c794-07ca-4600-b3e5-7dcabb3942ac None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:37.301357 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7c794-07ca-4600-b3e5-7dcabb3942ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:37.463951 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-94d7c794-07ca-4600-b3e5-7dcabb3942ac None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:37.475863 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-94d7c794-07ca-4600-b3e5-7dcabb3942ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:37.677132 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:37.795435 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 823/1647] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:21:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 499 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:21:37.841965 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7dd607-1906-4597-965a-f15ac1f950e0 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:37.847629 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-9c7dd607-1906-4597-965a-f15ac1f950e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:37.976774 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:38.042897 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7dd607-1906-4597-965a-f15ac1f950e0 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:38.059795 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f968a-3227-46b0-acf8-1d97d9f9eeaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:38.061043 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f968a-3227-46b0-acf8-1d97d9f9eeaf service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:38.061660 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f968a-3227-46b0-acf8-1d97d9f9eeaf service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:38.062297 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f968a-3227-46b0-acf8-1d97d9f9eeaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:38.103279 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4f968a-3227-46b0-acf8-1d97d9f9eeaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:38.107184 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4f968a-3227-46b0-acf8-1d97d9f9eeaf service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:38.128415 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 825/1648] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:21:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:21:42.229605 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7c794-07ca-4600-b3e5-7dcabb3942ac None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:42.232433 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-94d7c794-07ca-4600-b3e5-7dcabb3942ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:42.265574 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7c794-07ca-4600-b3e5-7dcabb3942ac None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:42.286936 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa76fa-bda8-4abd-855e-6fb9175c8052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:42.287778 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa76fa-bda8-4abd-855e-6fb9175c8052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:42.288178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa76fa-bda8-4abd-855e-6fb9175c8052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:42.288563 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa76fa-bda8-4abd-855e-6fb9175c8052 admin admin] PATH_INFO: `/v3/projects/04c4f423da0a468ab0cee01330ba9e8f` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:42.293919 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa76fa-bda8-4abd-855e-6fb9175c8052 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04c4f423da0a468ab0cee01330ba9e8f)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:42.296189 dv-cinder-858678-1-smb devstack@keystone.service[81378]: WARNING py.warnings [None req-22fa76fa-bda8-4abd-855e-6fb9175c8052 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 21 12:21:42.296189 dv-cinder-858678-1-smb devstack@keystone.service[81378]: warnings.warn(msg) Sep 21 12:21:42.296189 dv-cinder-858678-1-smb devstack@keystone.service[81378]: Sep 21 12:21:42.298597 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa76fa-bda8-4abd-855e-6fb9175c8052 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:42.418122 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-22fa76fa-bda8-4abd-855e-6fb9175c8052 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04c4f423da0a468ab0cee01330ba9e8f', 'request_id': 'req-22fa76fa-bda8-4abd-855e-6fb9175c8052'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:21:42.432847 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-22fa76fa-bda8-4abd-855e-6fb9175c8052 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04c4f423da0a468ab0cee01330ba9e8f', 'request_id': 'req-22fa76fa-bda8-4abd-855e-6fb9175c8052'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:21:42.453102 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-22fa76fa-bda8-4abd-855e-6fb9175c8052 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04c4f423da0a468ab0cee01330ba9e8f', 'request_id': 'req-22fa76fa-bda8-4abd-855e-6fb9175c8052'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:21:42.496686 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-22fa76fa-bda8-4abd-855e-6fb9175c8052 admin admin] The token cache is being invalidate because project 04c4f423da0a468ab0cee01330ba9e8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:21:42.497345 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-22fa76fa-bda8-4abd-855e-6fb9175c8052 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:21:42.498385 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-22fa76fa-bda8-4abd-855e-6fb9175c8052 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:21:42.503527 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 824/1649] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:21:42 2022] DELETE /identity/v3/projects/04c4f423da0a468ab0cee01330ba9e8f => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:21:42.505112 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f968a-3227-46b0-acf8-1d97d9f9eeaf service neutron] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:42.551090 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f968a-3227-46b0-acf8-1d97d9f9eeaf service neutron] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:42.939515 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0eed0-a588-4c46-8d21-8c01af3a6791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:42.940642 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0eed0-a588-4c46-8d21-8c01af3a6791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:42.941458 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0eed0-a588-4c46-8d21-8c01af3a6791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:42.941649 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0eed0-a588-4c46-8d21-8c01af3a6791 admin admin] PATH_INFO: `/v3/users/98f26d402d9d4c6abd609e8b7418d274` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:42.961494 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b0eed0-a588-4c46-8d21-8c01af3a6791 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98f26d402d9d4c6abd609e8b7418d274)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:42.972378 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b0eed0-a588-4c46-8d21-8c01af3a6791 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:43.241715 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-53b0eed0-a588-4c46-8d21-8c01af3a6791 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98f26d402d9d4c6abd609e8b7418d274'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:21:43.306305 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-53b0eed0-a588-4c46-8d21-8c01af3a6791 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98f26d402d9d4c6abd609e8b7418d274'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:21:43.332309 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-53b0eed0-a588-4c46-8d21-8c01af3a6791 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98f26d402d9d4c6abd609e8b7418d274'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:21:43.333198 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-53b0eed0-a588-4c46-8d21-8c01af3a6791 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98f26d402d9d4c6abd609e8b7418d274'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:21:43.352846 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-53b0eed0-a588-4c46-8d21-8c01af3a6791 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98f26d402d9d4c6abd609e8b7418d274'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:21:43.369872 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 826/1650] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:21:42 2022] DELETE /identity/v3/users/98f26d402d9d4c6abd609e8b7418d274 => generated 0 bytes in 866 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:21:45.667897 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa76fa-bda8-4abd-855e-6fb9175c8052 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:45.669672 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-22fa76fa-bda8-4abd-855e-6fb9175c8052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:45.702157 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa76fa-bda8-4abd-855e-6fb9175c8052 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:45.905746 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198d5ee-0bf2-4dc2-a599-70d1fbda14e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:45.906484 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198d5ee-0bf2-4dc2-a599-70d1fbda14e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:45.906770 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198d5ee-0bf2-4dc2-a599-70d1fbda14e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:45.907773 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198d5ee-0bf2-4dc2-a599-70d1fbda14e9 admin admin] PATH_INFO: `/v3/users/1e0dadb0488146148e6c8b5b242722ef` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:45.909628 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198d5ee-0bf2-4dc2-a599-70d1fbda14e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e0dadb0488146148e6c8b5b242722ef)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:45.916114 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198d5ee-0bf2-4dc2-a599-70d1fbda14e9 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:46.080705 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-7198d5ee-0bf2-4dc2-a599-70d1fbda14e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e0dadb0488146148e6c8b5b242722ef'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:21:46.097749 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-7198d5ee-0bf2-4dc2-a599-70d1fbda14e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e0dadb0488146148e6c8b5b242722ef'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:21:46.133348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:46.159001 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-7198d5ee-0bf2-4dc2-a599-70d1fbda14e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e0dadb0488146148e6c8b5b242722ef'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:21:46.160115 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-7198d5ee-0bf2-4dc2-a599-70d1fbda14e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e0dadb0488146148e6c8b5b242722ef'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:21:46.171311 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-7198d5ee-0bf2-4dc2-a599-70d1fbda14e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e0dadb0488146148e6c8b5b242722ef'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:21:46.193591 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 825/1651] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:21:45 2022] DELETE /identity/v3/users/1e0dadb0488146148e6c8b5b242722ef => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:21:46.194887 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdaceb-8ad7-414b-bd5a-bbbea172543f None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:46.195392 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdaceb-8ad7-414b-bd5a-bbbea172543f None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:46.195467 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdaceb-8ad7-414b-bd5a-bbbea172543f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:46.264877 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-3bfdaceb-8ad7-414b-bd5a-bbbea172543f None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:46.268417 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-3bfdaceb-8ad7-414b-bd5a-bbbea172543f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:46.436506 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:46.461993 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 827/1652] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:21:46.512096 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198d5ee-0bf2-4dc2-a599-70d1fbda14e9 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:46.514019 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7198d5ee-0bf2-4dc2-a599-70d1fbda14e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:46.771971 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198d5ee-0bf2-4dc2-a599-70d1fbda14e9 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:46.782397 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c04681-fee8-4e1c-a8e3-d39d8c81efa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:46.783557 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c04681-fee8-4e1c-a8e3-d39d8c81efa0 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:46.784052 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c04681-fee8-4e1c-a8e3-d39d8c81efa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:46.784568 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c04681-fee8-4e1c-a8e3-d39d8c81efa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:46.810931 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c04681-fee8-4e1c-a8e3-d39d8c81efa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:46.816293 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c04681-fee8-4e1c-a8e3-d39d8c81efa0 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:46.853044 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 826/1653] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:21:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:21:46.937723 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfdaceb-8ad7-414b-bd5a-bbbea172543f None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:46.939400 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-3bfdaceb-8ad7-414b-bd5a-bbbea172543f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:46.974202 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfdaceb-8ad7-414b-bd5a-bbbea172543f None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:46.990686 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439085b-8fab-4e04-8834-4e32a61e83e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:46.991859 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439085b-8fab-4e04-8834-4e32a61e83e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:46.993414 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439085b-8fab-4e04-8834-4e32a61e83e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:46.993883 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439085b-8fab-4e04-8834-4e32a61e83e4 admin admin] PATH_INFO: `/v3/projects/7aa30de1e34044c6951255dde971f2f2` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:46.997229 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d439085b-8fab-4e04-8834-4e32a61e83e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7aa30de1e34044c6951255dde971f2f2)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:47.006642 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d439085b-8fab-4e04-8834-4e32a61e83e4 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:47.148502 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-d439085b-8fab-4e04-8834-4e32a61e83e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aa30de1e34044c6951255dde971f2f2', 'request_id': 'req-d439085b-8fab-4e04-8834-4e32a61e83e4'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:21:47.161604 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-d439085b-8fab-4e04-8834-4e32a61e83e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aa30de1e34044c6951255dde971f2f2', 'request_id': 'req-d439085b-8fab-4e04-8834-4e32a61e83e4'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:21:47.180154 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-d439085b-8fab-4e04-8834-4e32a61e83e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aa30de1e34044c6951255dde971f2f2', 'request_id': 'req-d439085b-8fab-4e04-8834-4e32a61e83e4'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:21:47.197256 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-d439085b-8fab-4e04-8834-4e32a61e83e4 admin admin] The token cache is being invalidate because project 7aa30de1e34044c6951255dde971f2f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:21:47.198822 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-d439085b-8fab-4e04-8834-4e32a61e83e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:21:47.199927 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-d439085b-8fab-4e04-8834-4e32a61e83e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:21:47.207277 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 828/1654] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:21:46 2022] DELETE /identity/v3/projects/7aa30de1e34044c6951255dde971f2f2 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:21:47.210607 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d4088-cbe7-4d49-9292-bb8655d48d9c None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:47.211973 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d4088-cbe7-4d49-9292-bb8655d48d9c None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:47.212701 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d4088-cbe7-4d49-9292-bb8655d48d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:47.320170 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-367d4088-cbe7-4d49-9292-bb8655d48d9c None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:47.325929 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-367d4088-cbe7-4d49-9292-bb8655d48d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:47.594198 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 827/1655] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:21:47.603909 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31938475-ded9-4c15-9868-4523a35ca906 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:47.604179 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31938475-ded9-4c15-9868-4523a35ca906 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:47.604549 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31938475-ded9-4c15-9868-4523a35ca906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:47.654922 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-31938475-ded9-4c15-9868-4523a35ca906 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:47.656541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-31938475-ded9-4c15-9868-4523a35ca906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:47.681033 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 829/1656] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:21:47.699066 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d4088-cbe7-4d49-9292-bb8655d48d9c None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:47.725802 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d4088-cbe7-4d49-9292-bb8655d48d9c None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:47.739130 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01fa3a-84bd-43e5-8196-b4913285fe73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:47.740184 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01fa3a-84bd-43e5-8196-b4913285fe73 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:47.740624 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01fa3a-84bd-43e5-8196-b4913285fe73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:47.742078 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01fa3a-84bd-43e5-8196-b4913285fe73 admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:47.743362 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b01fa3a-84bd-43e5-8196-b4913285fe73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:21:47.743891 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b01fa3a-84bd-43e5-8196-b4913285fe73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:47.747481 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b01fa3a-84bd-43e5-8196-b4913285fe73 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:47.783441 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 828/1657] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:21:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:21:47.792863 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31938475-ded9-4c15-9868-4523a35ca906 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:47.806152 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31938475-ded9-4c15-9868-4523a35ca906 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:47.813496 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e09255-7a95-4929-a623-2106a6a4400d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:47.814279 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e09255-7a95-4929-a623-2106a6a4400d admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:47.815917 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e09255-7a95-4929-a623-2106a6a4400d admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:47.816225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e09255-7a95-4929-a623-2106a6a4400d admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:47.816994 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e09255-7a95-4929-a623-2106a6a4400d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:47.819253 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e09255-7a95-4929-a623-2106a6a4400d admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:47.892941 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01fa3a-84bd-43e5-8196-b4913285fe73 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:47.903786 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 830/1658] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:21:47 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:21:47.912720 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01fa3a-84bd-43e5-8196-b4913285fe73 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:48.207628 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d445b-250f-4247-b6aa-d834cd73be20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:48.208624 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d445b-250f-4247-b6aa-d834cd73be20 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:48.209199 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d445b-250f-4247-b6aa-d834cd73be20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:48.209581 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d445b-250f-4247-b6aa-d834cd73be20 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:48.210731 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d445b-250f-4247-b6aa-d834cd73be20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:48.250172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d445b-250f-4247-b6aa-d834cd73be20 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:48.350043 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 829/1659] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:21:47 2022] POST /identity/v3/users => generated 289 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:21:48.356575 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e09255-7a95-4929-a623-2106a6a4400d admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:48.392751 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e09255-7a95-4929-a623-2106a6a4400d admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:48.414136 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c2811-42c0-47b7-b2fd-ffbe85905c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:48.415319 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c2811-42c0-47b7-b2fd-ffbe85905c0a admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:48.415841 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c2811-42c0-47b7-b2fd-ffbe85905c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:48.417609 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c2811-42c0-47b7-b2fd-ffbe85905c0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:48.418330 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c2811-42c0-47b7-b2fd-ffbe85905c0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:48.423119 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c2811-42c0-47b7-b2fd-ffbe85905c0a admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:48.440087 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d445b-250f-4247-b6aa-d834cd73be20 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:48.442173 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-c05d445b-250f-4247-b6aa-d834cd73be20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:48.457490 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 831/1660] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:21:48.458780 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c2811-42c0-47b7-b2fd-ffbe85905c0a admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:48.472295 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:48.485731 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c2811-42c0-47b7-b2fd-ffbe85905c0a admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:48.497918 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb190d8-0c77-475e-ae4d-6370cfe29c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:48.498864 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d445b-250f-4247-b6aa-d834cd73be20 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:48.499515 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb190d8-0c77-475e-ae4d-6370cfe29c79 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:48.500361 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb190d8-0c77-475e-ae4d-6370cfe29c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:48.500933 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb190d8-0c77-475e-ae4d-6370cfe29c79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:48.502133 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb190d8-0c77-475e-ae4d-6370cfe29c79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:48.505910 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb190d8-0c77-475e-ae4d-6370cfe29c79 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:48.513267 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df6c6f-e08d-4a0c-a4db-ef305a9fd3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:48.517654 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df6c6f-e08d-4a0c-a4db-ef305a9fd3d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:48.518140 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df6c6f-e08d-4a0c-a4db-ef305a9fd3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:48.518285 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df6c6f-e08d-4a0c-a4db-ef305a9fd3d3 admin admin] PATH_INFO: `/v3/projects/30ba5048068440d899bfc8216e3967ce` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:48.523800 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df6c6f-e08d-4a0c-a4db-ef305a9fd3d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30ba5048068440d899bfc8216e3967ce)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:48.525880 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df6c6f-e08d-4a0c-a4db-ef305a9fd3d3 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:48.540499 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 832/1661] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:21:48.545510 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb190d8-0c77-475e-ae4d-6370cfe29c79 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:48.575908 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb190d8-0c77-475e-ae4d-6370cfe29c79 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:48.590178 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c414b6-6b42-4ded-bc95-2697abca6504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:48.592309 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c414b6-6b42-4ded-bc95-2697abca6504 admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:48.593439 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c414b6-6b42-4ded-bc95-2697abca6504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:48.594011 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c414b6-6b42-4ded-bc95-2697abca6504 admin admin] PATH_INFO: `/v3/projects/55bc4e9160814cd0a7523caae5a0fbcc/users/5a64b9b9a28148fcaf25b6117ac75cae/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:48.635128 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-31df6c6f-e08d-4a0c-a4db-ef305a9fd3d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30ba5048068440d899bfc8216e3967ce', 'request_id': 'req-31df6c6f-e08d-4a0c-a4db-ef305a9fd3d3'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:21:48.638225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c414b6-6b42-4ded-bc95-2697abca6504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55bc4e9160814cd0a7523caae5a0fbcc, user_id=5a64b9b9a28148fcaf25b6117ac75cae, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:48.646258 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c414b6-6b42-4ded-bc95-2697abca6504 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:48.658050 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-31df6c6f-e08d-4a0c-a4db-ef305a9fd3d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30ba5048068440d899bfc8216e3967ce', 'request_id': 'req-31df6c6f-e08d-4a0c-a4db-ef305a9fd3d3'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:21:48.691504 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-31df6c6f-e08d-4a0c-a4db-ef305a9fd3d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30ba5048068440d899bfc8216e3967ce', 'request_id': 'req-31df6c6f-e08d-4a0c-a4db-ef305a9fd3d3'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:21:48.704079 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 833/1662] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:21:48 2022] PUT /identity/v3/projects/55bc4e9160814cd0a7523caae5a0fbcc/users/5a64b9b9a28148fcaf25b6117ac75cae/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:21:48.722179 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3928af9-2a27-40a8-8b96-21ae4bb352e0 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:48.722728 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3928af9-2a27-40a8-8b96-21ae4bb352e0 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:48.723212 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3928af9-2a27-40a8-8b96-21ae4bb352e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:48.769997 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-31df6c6f-e08d-4a0c-a4db-ef305a9fd3d3 admin admin] The token cache is being invalidate because project 30ba5048068440d899bfc8216e3967ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:21:48.771118 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-31df6c6f-e08d-4a0c-a4db-ef305a9fd3d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:21:48.776362 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-31df6c6f-e08d-4a0c-a4db-ef305a9fd3d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:21:48.789952 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 830/1663] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:21:48 2022] DELETE /identity/v3/projects/30ba5048068440d899bfc8216e3967ce => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:21:48.799794 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca16f3-266a-49ef-8e94-2082cfcbdf75 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:48.800949 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca16f3-266a-49ef-8e94-2082cfcbdf75 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:48.806557 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca16f3-266a-49ef-8e94-2082cfcbdf75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:48.807000 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-a3928af9-2a27-40a8-8b96-21ae4bb352e0 None None] MFA Rules not processed for user `5a64b9b9a28148fcaf25b6117ac75cae`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:48.813619 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-a3928af9-2a27-40a8-8b96-21ae4bb352e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:48.897261 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-edca16f3-266a-49ef-8e94-2082cfcbdf75 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:48.901768 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-edca16f3-266a-49ef-8e94-2082cfcbdf75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:49.149051 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:49.192195 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 834/1664] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:21:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:21:49.204298 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 831/1665] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:21:49.204553 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3928af9-2a27-40a8-8b96-21ae4bb352e0 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:49.206989 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-a3928af9-2a27-40a8-8b96-21ae4bb352e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:49.207189 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c6f35-080b-4f2e-beec-28de47838322 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:49.207189 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c6f35-080b-4f2e-beec-28de47838322 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:49.207189 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c6f35-080b-4f2e-beec-28de47838322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:49.243885 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3928af9-2a27-40a8-8b96-21ae4bb352e0 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:49.252468 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-d61c6f35-080b-4f2e-beec-28de47838322 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:49.259196 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d61c6f35-080b-4f2e-beec-28de47838322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:49.262859 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b282d7-70bd-43f3-8811-f27e9d6e4e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:49.263915 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b282d7-70bd-43f3-8811-f27e9d6e4e5c admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:49.265829 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b282d7-70bd-43f3-8811-f27e9d6e4e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:49.267964 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b282d7-70bd-43f3-8811-f27e9d6e4e5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:49.272871 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b282d7-70bd-43f3-8811-f27e9d6e4e5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:49.278409 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b282d7-70bd-43f3-8811-f27e9d6e4e5c admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:49.297461 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 832/1666] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:21:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:21:49.299580 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c6f35-080b-4f2e-beec-28de47838322 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:49.322483 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c6f35-080b-4f2e-beec-28de47838322 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:49.342683 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5752a5-1138-452a-bb75-dbb51030e4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:49.344057 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5752a5-1138-452a-bb75-dbb51030e4f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:49.344758 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5752a5-1138-452a-bb75-dbb51030e4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:49.345396 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5752a5-1138-452a-bb75-dbb51030e4f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:49.347014 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5752a5-1138-452a-bb75-dbb51030e4f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:21:49.347833 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5752a5-1138-452a-bb75-dbb51030e4f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:49.352270 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5752a5-1138-452a-bb75-dbb51030e4f9 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:49.365700 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 835/1667] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:21:49 2022] POST /identity/v3/projects => generated 375 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:21:49.372233 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b282d7-70bd-43f3-8811-f27e9d6e4e5c admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:49.428682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 833/1668] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:21:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:21:49.435910 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5752a5-1138-452a-bb75-dbb51030e4f9 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:49.460889 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5752a5-1138-452a-bb75-dbb51030e4f9 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:49.630110 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5d8cb-809c-4d1d-a61b-6586fd21a84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:49.631526 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5d8cb-809c-4d1d-a61b-6586fd21a84a admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:49.631874 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5d8cb-809c-4d1d-a61b-6586fd21a84a admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:49.632112 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5d8cb-809c-4d1d-a61b-6586fd21a84a admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:49.634844 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5d8cb-809c-4d1d-a61b-6586fd21a84a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:49.637706 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5d8cb-809c-4d1d-a61b-6586fd21a84a admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:49.651208 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b282d7-70bd-43f3-8811-f27e9d6e4e5c admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:49.658644 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ce218-b050-4211-9acc-fb35bb21ea97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:49.659102 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ce218-b050-4211-9acc-fb35bb21ea97 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:49.659529 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ce218-b050-4211-9acc-fb35bb21ea97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:49.659883 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ce218-b050-4211-9acc-fb35bb21ea97 admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:49.660631 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ce218-b050-4211-9acc-fb35bb21ea97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:49.663489 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ce218-b050-4211-9acc-fb35bb21ea97 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:49.669209 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:49.700993 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 834/1669] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:21:49 2022] POST /identity/v3/projects => generated 403 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:21:49.705179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5d8cb-809c-4d1d-a61b-6586fd21a84a admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:49.721499 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 836/1670] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:21:49 2022] POST /identity/v3/users => generated 294 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:21:49.728003 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ce218-b050-4211-9acc-fb35bb21ea97 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:49.743089 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ce218-b050-4211-9acc-fb35bb21ea97 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:49.832462 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5d8cb-809c-4d1d-a61b-6586fd21a84a admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:49.839699 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6dffb-b64f-40e5-9b23-82274c48bda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:49.840341 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6dffb-b64f-40e5-9b23-82274c48bda3 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:49.840622 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6dffb-b64f-40e5-9b23-82274c48bda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:49.840902 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6dffb-b64f-40e5-9b23-82274c48bda3 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:49.841602 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6dffb-b64f-40e5-9b23-82274c48bda3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:49.841851 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4687df-1703-4155-b8f6-16834a757e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:49.843360 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4687df-1703-4155-b8f6-16834a757e97 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:49.843768 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f6dffb-b64f-40e5-9b23-82274c48bda3 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:49.844711 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4687df-1703-4155-b8f6-16834a757e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:49.845538 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4687df-1703-4155-b8f6-16834a757e97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:49.848713 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4687df-1703-4155-b8f6-16834a757e97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:49.852513 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4687df-1703-4155-b8f6-16834a757e97 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:49.875870 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 837/1671] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:21:49.879099 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4687df-1703-4155-b8f6-16834a757e97 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:49.894058 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4687df-1703-4155-b8f6-16834a757e97 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:49.896075 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 835/1672] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:21:49 2022] POST /identity/v3/users => generated 302 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:21:49.900311 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6dffb-b64f-40e5-9b23-82274c48bda3 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:49.900795 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cec490-4fe9-47b1-8898-89147ab76c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:49.901839 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cec490-4fe9-47b1-8898-89147ab76c08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:49.902234 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cec490-4fe9-47b1-8898-89147ab76c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:49.902690 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cec490-4fe9-47b1-8898-89147ab76c08 admin admin] PATH_INFO: `/v3/projects/649205b557af4a6fb0f68f82c3c48131/users/cc7a3827c56f4b0a8dcedc88a06491a2/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:49.929247 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6dffb-b64f-40e5-9b23-82274c48bda3 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:49.953556 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cec490-4fe9-47b1-8898-89147ab76c08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=649205b557af4a6fb0f68f82c3c48131, user_id=cc7a3827c56f4b0a8dcedc88a06491a2, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:49.963502 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00c92f-71f3-406f-b9bb-5d1989f7d0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:49.965208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00c92f-71f3-406f-b9bb-5d1989f7d0a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:49.966290 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00c92f-71f3-406f-b9bb-5d1989f7d0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:49.967186 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cec490-4fe9-47b1-8898-89147ab76c08 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:49.967344 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00c92f-71f3-406f-b9bb-5d1989f7d0a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:49.968771 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f00c92f-71f3-406f-b9bb-5d1989f7d0a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:49.997433 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f00c92f-71f3-406f-b9bb-5d1989f7d0a5 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:50.021939 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 838/1673] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:21:49 2022] PUT /identity/v3/projects/649205b557af4a6fb0f68f82c3c48131/users/cc7a3827c56f4b0a8dcedc88a06491a2/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:21:50.023444 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388812a4-4ae9-4974-bd03-d47079ec17f3 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:50.023735 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388812a4-4ae9-4974-bd03-d47079ec17f3 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:50.023996 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388812a4-4ae9-4974-bd03-d47079ec17f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:50.060849 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 836/1674] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:21:50.063720 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00c92f-71f3-406f-b9bb-5d1989f7d0a5 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:50.098309 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00c92f-71f3-406f-b9bb-5d1989f7d0a5 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:50.106261 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-388812a4-4ae9-4974-bd03-d47079ec17f3 None None] MFA Rules not processed for user `d71346f5c4fd4fefa706b1c66873e903`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:50.119609 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-388812a4-4ae9-4974-bd03-d47079ec17f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:50.209505 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:50.278231 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8f665-74e6-4ab9-bc6b-13e843ca0267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:50.280132 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8f665-74e6-4ab9-bc6b-13e843ca0267 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:50.280132 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8f665-74e6-4ab9-bc6b-13e843ca0267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:50.280418 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8f665-74e6-4ab9-bc6b-13e843ca0267 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:50.281099 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d8f665-74e6-4ab9-bc6b-13e843ca0267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:50.288740 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d8f665-74e6-4ab9-bc6b-13e843ca0267 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:50.323093 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 837/1675] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:21:50.324715 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8f665-74e6-4ab9-bc6b-13e843ca0267 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:50.329409 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 839/1676] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:21:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:21:50.340868 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388812a4-4ae9-4974-bd03-d47079ec17f3 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:50.352373 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8f665-74e6-4ab9-bc6b-13e843ca0267 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:50.358176 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388812a4-4ae9-4974-bd03-d47079ec17f3 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:50.366604 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fde598-18dd-4e65-a6f9-27af7b607e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:50.367760 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fde598-18dd-4e65-a6f9-27af7b607e72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:50.367760 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fde598-18dd-4e65-a6f9-27af7b607e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:50.367996 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fde598-18dd-4e65-a6f9-27af7b607e72 admin admin] PATH_INFO: `/v3/projects/649205b557af4a6fb0f68f82c3c48131/users/cc7a3827c56f4b0a8dcedc88a06491a2/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:50.370776 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac1d04-23ba-43b0-9fd7-d503600e7fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:50.371613 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac1d04-23ba-43b0-9fd7-d503600e7fbe admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:50.371927 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac1d04-23ba-43b0-9fd7-d503600e7fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:50.372228 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac1d04-23ba-43b0-9fd7-d503600e7fbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:50.372700 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fde598-18dd-4e65-a6f9-27af7b607e72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=649205b557af4a6fb0f68f82c3c48131, user_id=cc7a3827c56f4b0a8dcedc88a06491a2, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:50.373027 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ac1d04-23ba-43b0-9fd7-d503600e7fbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:50.376593 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fde598-18dd-4e65-a6f9-27af7b607e72 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:50.377345 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ac1d04-23ba-43b0-9fd7-d503600e7fbe admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:50.394137 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 840/1677] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:21:50 2022] PUT /identity/v3/projects/649205b557af4a6fb0f68f82c3c48131/users/cc7a3827c56f4b0a8dcedc88a06491a2/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:21:50.396535 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa94de-7382-4039-aa61-aea12bc1a5c5 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:50.396939 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa94de-7382-4039-aa61-aea12bc1a5c5 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:50.397253 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa94de-7382-4039-aa61-aea12bc1a5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:50.421503 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 838/1678] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:21:50.424636 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46653e78-71c2-481e-9023-bd1f3945c4fe None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:50.425140 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46653e78-71c2-481e-9023-bd1f3945c4fe None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:50.425562 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46653e78-71c2-481e-9023-bd1f3945c4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:50.446231 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-a8aa94de-7382-4039-aa61-aea12bc1a5c5 None None] MFA Rules not processed for user `d71346f5c4fd4fefa706b1c66873e903`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:50.449550 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-a8aa94de-7382-4039-aa61-aea12bc1a5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:50.519370 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-46653e78-71c2-481e-9023-bd1f3945c4fe None None] MFA Rules not processed for user `cc7a3827c56f4b0a8dcedc88a06491a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:50.524435 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-46653e78-71c2-481e-9023-bd1f3945c4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:50.700144 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:50.722806 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 841/1679] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:21:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:21:50.723294 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa94de-7382-4039-aa61-aea12bc1a5c5 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:50.857200 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 839/1680] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:21:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 434 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:21:50.859023 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46653e78-71c2-481e-9023-bd1f3945c4fe None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:50.861451 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-46653e78-71c2-481e-9023-bd1f3945c4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:51.011879 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa94de-7382-4039-aa61-aea12bc1a5c5 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:51.021212 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac8942-3777-4fb9-a0d9-0230fc6e9270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:51.022398 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac8942-3777-4fb9-a0d9-0230fc6e9270 admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:51.022880 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac8942-3777-4fb9-a0d9-0230fc6e9270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:51.023433 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac8942-3777-4fb9-a0d9-0230fc6e9270 admin admin] PATH_INFO: `/v3/projects/2fbcbe1a2b754b6cb2ac04f1a9ab40a4/users/1623416f330444a49fa819d157169fcc/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:51.052258 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac8942-3777-4fb9-a0d9-0230fc6e9270 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fbcbe1a2b754b6cb2ac04f1a9ab40a4, user_id=1623416f330444a49fa819d157169fcc, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:51.059524 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac8942-3777-4fb9-a0d9-0230fc6e9270 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:51.097375 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46653e78-71c2-481e-9023-bd1f3945c4fe None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:51.117554 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 842/1681] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:21:50 2022] PUT /identity/v3/projects/2fbcbe1a2b754b6cb2ac04f1a9ab40a4/users/1623416f330444a49fa819d157169fcc/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:21:51.118976 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac8942-3777-4fb9-a0d9-0230fc6e9270 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:51.125152 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-89ac8942-3777-4fb9-a0d9-0230fc6e9270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:51.255063 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:51.259383 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1644ad-994b-43f0-93be-5144df633e55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:51.260257 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1644ad-994b-43f0-93be-5144df633e55 service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:51.260368 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1644ad-994b-43f0-93be-5144df633e55 service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:51.260629 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1644ad-994b-43f0-93be-5144df633e55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:51.275329 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac8942-3777-4fb9-a0d9-0230fc6e9270 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:51.282558 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83222c9-4ed3-480e-a811-45c6e4f21b8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:51.283912 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83222c9-4ed3-480e-a811-45c6e4f21b8a service cinder] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:51.284431 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83222c9-4ed3-480e-a811-45c6e4f21b8a service cinder] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:51.284948 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83222c9-4ed3-480e-a811-45c6e4f21b8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:51.406189 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1644ad-994b-43f0-93be-5144df633e55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:51.408662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1644ad-994b-43f0-93be-5144df633e55 service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:51.419015 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83222c9-4ed3-480e-a811-45c6e4f21b8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:51.422400 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83222c9-4ed3-480e-a811-45c6e4f21b8a service cinder] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:51.440515 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 843/1682] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:21:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:21:51.442455 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e19ea2-3654-4c55-800a-dddf55cbb71f None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:51.443262 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e19ea2-3654-4c55-800a-dddf55cbb71f None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:51.443756 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e19ea2-3654-4c55-800a-dddf55cbb71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:51.445085 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 840/1683] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:21:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:21:51.472824 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c4c4c-9117-4e2c-8ce1-47134cc15a6d None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:51.473265 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c4c4c-9117-4e2c-8ce1-47134cc15a6d None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:51.473657 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c4c4c-9117-4e2c-8ce1-47134cc15a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:51.520471 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-d46c4c4c-9117-4e2c-8ce1-47134cc15a6d None None] MFA Rules not processed for user `6fd7dcb531994f118c09e661ae3c3526`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:51.522922 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d46c4c4c-9117-4e2c-8ce1-47134cc15a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:51.529394 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:51.543163 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-46e19ea2-3654-4c55-800a-dddf55cbb71f None None] MFA Rules not processed for user `1623416f330444a49fa819d157169fcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:51.545400 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-46e19ea2-3654-4c55-800a-dddf55cbb71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:51.644114 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 841/1684] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:21:51 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:21:51.657751 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f7ec1-268d-41c0-9a2b-1d992f334fe2 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:51.658208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f7ec1-268d-41c0-9a2b-1d992f334fe2 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:51.658684 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f7ec1-268d-41c0-9a2b-1d992f334fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:51.728155 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-041f7ec1-268d-41c0-9a2b-1d992f334fe2 None None] MFA Rules not processed for user `6fd7dcb531994f118c09e661ae3c3526`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:51.730289 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-041f7ec1-268d-41c0-9a2b-1d992f334fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:51.759301 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 842/1685] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:21:51 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:21:51.776013 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f7ec1-268d-41c0-9a2b-1d992f334fe2 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:51.781895 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-041f7ec1-268d-41c0-9a2b-1d992f334fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:51.827267 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 844/1686] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:21:51 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:21:51.842843 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e19ea2-3654-4c55-800a-dddf55cbb71f None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:51.845229 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f7ec1-268d-41c0-9a2b-1d992f334fe2 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:51.871756 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73842ed4-ada3-4b19-bf8c-225d5180e1a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:51.872760 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73842ed4-ada3-4b19-bf8c-225d5180e1a0 service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:51.872760 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73842ed4-ada3-4b19-bf8c-225d5180e1a0 service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:51.873058 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73842ed4-ada3-4b19-bf8c-225d5180e1a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:51.894050 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73842ed4-ada3-4b19-bf8c-225d5180e1a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:51.895726 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73842ed4-ada3-4b19-bf8c-225d5180e1a0 service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:51.921557 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 843/1687] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:21:51 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:21:52.080422 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e19ea2-3654-4c55-800a-dddf55cbb71f None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:52.103183 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee01efa-1002-44e8-b5dd-ec041fa636f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:52.104307 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee01efa-1002-44e8-b5dd-ec041fa636f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:52.107401 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee01efa-1002-44e8-b5dd-ec041fa636f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:52.109822 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee01efa-1002-44e8-b5dd-ec041fa636f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:52.112668 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee01efa-1002-44e8-b5dd-ec041fa636f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:52.127420 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee01efa-1002-44e8-b5dd-ec041fa636f6 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:52.324879 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 845/1688] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:21:51 2022] POST /identity/v3/projects => generated 405 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:21:52.327695 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73842ed4-ada3-4b19-bf8c-225d5180e1a0 service nova] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:52.345138 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73842ed4-ada3-4b19-bf8c-225d5180e1a0 service nova] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:52.619262 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f5c13-a9af-431d-84d7-07d301ce1c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:52.621675 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f5c13-a9af-431d-84d7-07d301ce1c97 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:52.622309 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f5c13-a9af-431d-84d7-07d301ce1c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:52.623220 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f5c13-a9af-431d-84d7-07d301ce1c97 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:52.624545 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f5c13-a9af-431d-84d7-07d301ce1c97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:52.629601 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f5c13-a9af-431d-84d7-07d301ce1c97 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:52.682330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 844/1689] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:21:52 2022] POST /identity/v3/users => generated 309 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:21:52.683856 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee01efa-1002-44e8-b5dd-ec041fa636f6 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:52.760304 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee01efa-1002-44e8-b5dd-ec041fa636f6 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:52.817404 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9383cb0-b37e-48d4-ada1-723f77428fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:52.824409 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9383cb0-b37e-48d4-ada1-723f77428fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:52.825127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9383cb0-b37e-48d4-ada1-723f77428fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:52.825803 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9383cb0-b37e-48d4-ada1-723f77428fd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:52.827285 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9383cb0-b37e-48d4-ada1-723f77428fd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:52.831892 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9383cb0-b37e-48d4-ada1-723f77428fd9 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:52.858717 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:52.896795 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 846/1690] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:21:52.905544 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f5c13-a9af-431d-84d7-07d301ce1c97 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:52.939208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f5c13-a9af-431d-84d7-07d301ce1c97 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:52.953632 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82e5e2-f5e7-4b26-b8b4-42743acaed01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:52.961965 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82e5e2-f5e7-4b26-b8b4-42743acaed01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:52.962484 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82e5e2-f5e7-4b26-b8b4-42743acaed01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:52.965092 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82e5e2-f5e7-4b26-b8b4-42743acaed01 admin admin] PATH_INFO: `/v3/projects/4755c1a9cd1d4caa9189a2aaa591c92b/users/132651ca187b4a8eaa8bf45170729efa/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:53.039630 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f82e5e2-f5e7-4b26-b8b4-42743acaed01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4755c1a9cd1d4caa9189a2aaa591c92b, user_id=132651ca187b4a8eaa8bf45170729efa, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:53.067249 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f82e5e2-f5e7-4b26-b8b4-42743acaed01 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:53.147189 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 845/1691] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:21:52 2022] PUT /identity/v3/projects/4755c1a9cd1d4caa9189a2aaa591c92b/users/132651ca187b4a8eaa8bf45170729efa/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:21:53.153564 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9383cb0-b37e-48d4-ada1-723f77428fd9 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:53.207125 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9383cb0-b37e-48d4-ada1-723f77428fd9 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:53.286870 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805beaad-c009-4e3b-ba28-d7e3e9fc0101 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:53.287543 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805beaad-c009-4e3b-ba28-d7e3e9fc0101 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:53.288119 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805beaad-c009-4e3b-ba28-d7e3e9fc0101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:53.405114 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-805beaad-c009-4e3b-ba28-d7e3e9fc0101 None None] MFA Rules not processed for user `e82cb48b04eb42b99160934b1c8b1f7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:53.407561 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-805beaad-c009-4e3b-ba28-d7e3e9fc0101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:53.467948 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd84d9-24db-4e55-8823-8dadd17ccfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:53.470277 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd84d9-24db-4e55-8823-8dadd17ccfff admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:53.470646 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd84d9-24db-4e55-8823-8dadd17ccfff admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:53.470878 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd84d9-24db-4e55-8823-8dadd17ccfff admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:53.471602 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd84d9-24db-4e55-8823-8dadd17ccfff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:53.488362 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd84d9-24db-4e55-8823-8dadd17ccfff admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:53.540173 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:53.551326 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 847/1692] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:21:53.568019 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd84d9-24db-4e55-8823-8dadd17ccfff admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:53.601570 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd84d9-24db-4e55-8823-8dadd17ccfff admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:53.616403 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e0d5e7-757b-4e3e-9abe-c3bb13f7e21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:53.617099 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0d5e7-757b-4e3e-9abe-c3bb13f7e21a admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:53.617505 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0d5e7-757b-4e3e-9abe-c3bb13f7e21a admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:53.617792 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0d5e7-757b-4e3e-9abe-c3bb13f7e21a admin admin] PATH_INFO: `/v3/projects/4755c1a9cd1d4caa9189a2aaa591c92b/users/132651ca187b4a8eaa8bf45170729efa/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:53.624764 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e0d5e7-757b-4e3e-9abe-c3bb13f7e21a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4755c1a9cd1d4caa9189a2aaa591c92b, user_id=132651ca187b4a8eaa8bf45170729efa, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:53.642438 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e0d5e7-757b-4e3e-9abe-c3bb13f7e21a admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:53.656975 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 846/1693] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:21:53 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:21:53.658440 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854cc81-4c35-4607-9205-0c369b500f0c None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:53.658734 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854cc81-4c35-4607-9205-0c369b500f0c None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:53.659019 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854cc81-4c35-4607-9205-0c369b500f0c None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:53.660696 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 847/1694] 10.222.0.60 () {54 vars in 912 bytes} [Wed Sep 21 12:21:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:21:53.671883 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d7ea2-2b6d-4755-b713-a93fee0ad37a None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:53.672429 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d7ea2-2b6d-4755-b713-a93fee0ad37a None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:53.672725 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d7ea2-2b6d-4755-b713-a93fee0ad37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:53.705834 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 848/1695] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:21:53 2022] PUT /identity/v3/projects/4755c1a9cd1d4caa9189a2aaa591c92b/users/132651ca187b4a8eaa8bf45170729efa/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:21:53.713614 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d1aa8-2d91-4008-a3ab-4e063d7aa58e None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:53.714659 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d1aa8-2d91-4008-a3ab-4e063d7aa58e None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:53.715479 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d1aa8-2d91-4008-a3ab-4e063d7aa58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:53.810538 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-284d7ea2-2b6d-4755-b713-a93fee0ad37a None None] MFA Rules not processed for user `ab0521c25c2d4417944efa4745588f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:53.818349 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-284d7ea2-2b6d-4755-b713-a93fee0ad37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:53.831047 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-0b4d1aa8-2d91-4008-a3ab-4e063d7aa58e None None] MFA Rules not processed for user `132651ca187b4a8eaa8bf45170729efa`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:53.834713 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-0b4d1aa8-2d91-4008-a3ab-4e063d7aa58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:54.070063 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 848/1696] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Sep 21 12:21:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:21:54.081676 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 849/1697] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:21:53 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:21:54.092130 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d7ea2-2b6d-4755-b713-a93fee0ad37a None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:54.093551 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-284d7ea2-2b6d-4755-b713-a93fee0ad37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:54.108511 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f54839-b301-436c-84fe-99de34fd940b None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:54.109109 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f54839-b301-436c-84fe-99de34fd940b None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:54.109390 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f54839-b301-436c-84fe-99de34fd940b None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:54.111810 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 850/1698] 10.222.0.60 () {54 vars in 912 bytes} [Wed Sep 21 12:21:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:21:54.121028 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f54839-b301-436c-84fe-99de34fd940b None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:54.131722 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-96f54839-b301-436c-84fe-99de34fd940b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:54.202458 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f54839-b301-436c-84fe-99de34fd940b None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:54.226615 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf624b-ba64-456d-b0b8-eb58630a8813 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:54.227468 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf624b-ba64-456d-b0b8-eb58630a8813 service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:54.227679 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf624b-ba64-456d-b0b8-eb58630a8813 service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:54.228001 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf624b-ba64-456d-b0b8-eb58630a8813 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:54.260936 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf624b-ba64-456d-b0b8-eb58630a8813 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:54.270541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf624b-ba64-456d-b0b8-eb58630a8813 service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:54.287863 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 851/1699] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:21:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:21:54.288475 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3685e5-0a71-4be2-9414-80d505d8fb42 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:54.288765 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3685e5-0a71-4be2-9414-80d505d8fb42 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:54.289036 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3685e5-0a71-4be2-9414-80d505d8fb42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:54.323985 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-9b3685e5-0a71-4be2-9414-80d505d8fb42 None None] MFA Rules not processed for user `ab0521c25c2d4417944efa4745588f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:54.324186 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-9b3685e5-0a71-4be2-9414-80d505d8fb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:54.333552 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 852/1700] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Sep 21 12:21:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:21:54.338107 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d7ea2-2b6d-4755-b713-a93fee0ad37a None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:54.349095 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece24482-ae85-4ce7-9003-2bbbb28b4364 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:54.351025 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece24482-ae85-4ce7-9003-2bbbb28b4364 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:54.351747 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece24482-ae85-4ce7-9003-2bbbb28b4364 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:54.352390 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece24482-ae85-4ce7-9003-2bbbb28b4364 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:54.377926 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece24482-ae85-4ce7-9003-2bbbb28b4364 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:54.381886 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece24482-ae85-4ce7-9003-2bbbb28b4364 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:54.419599 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 849/1701] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:21:54 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:21:54.423528 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3685e5-0a71-4be2-9414-80d505d8fb42 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:54.448547 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3685e5-0a71-4be2-9414-80d505d8fb42 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:54.472256 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb4a09-f93e-4da1-9152-ea8a43d0dd9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:54.473909 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb4a09-f93e-4da1-9152-ea8a43d0dd9f service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:54.476174 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb4a09-f93e-4da1-9152-ea8a43d0dd9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:54.477153 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb4a09-f93e-4da1-9152-ea8a43d0dd9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:54.566055 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb4a09-f93e-4da1-9152-ea8a43d0dd9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:54.571081 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb4a09-f93e-4da1-9152-ea8a43d0dd9f service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:54.574517 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f311285-9767-423b-94a9-fef71ebf9548 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:54.575991 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f311285-9767-423b-94a9-fef71ebf9548 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:54.576589 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f311285-9767-423b-94a9-fef71ebf9548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:54.610375 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 853/1702] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:21:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:21:54.771635 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-6f311285-9767-423b-94a9-fef71ebf9548 None None] MFA Rules not processed for user `a55997792b7843439d62ef7d5245382b`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:54.775446 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-6f311285-9767-423b-94a9-fef71ebf9548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:54.898342 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb4a09-f93e-4da1-9152-ea8a43d0dd9f service neutron] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:55.015050 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:55.101412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb4a09-f93e-4da1-9152-ea8a43d0dd9f service neutron] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:55.116128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d9cb0-0904-40b4-a559-38d8ba9dd4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:55.117314 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d9cb0-0904-40b4-a559-38d8ba9dd4fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:55.117837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d9cb0-0904-40b4-a559-38d8ba9dd4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:55.118490 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d9cb0-0904-40b4-a559-38d8ba9dd4fa admin admin] PATH_INFO: `/v3/users/1623416f330444a49fa819d157169fcc` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:55.121322 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d9cb0-0904-40b4-a559-38d8ba9dd4fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=1623416f330444a49fa819d157169fcc)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:55.123910 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d9cb0-0904-40b4-a559-38d8ba9dd4fa admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:55.190838 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 850/1703] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:21:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 618 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:21:55.276750 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-a91d9cb0-0904-40b4-a559-38d8ba9dd4fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1623416f330444a49fa819d157169fcc'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:21:55.406000 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-a91d9cb0-0904-40b4-a559-38d8ba9dd4fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1623416f330444a49fa819d157169fcc'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:21:55.463316 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-a91d9cb0-0904-40b4-a559-38d8ba9dd4fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1623416f330444a49fa819d157169fcc'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:21:55.466493 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-a91d9cb0-0904-40b4-a559-38d8ba9dd4fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1623416f330444a49fa819d157169fcc'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:21:55.488988 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f311285-9767-423b-94a9-fef71ebf9548 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:55.515634 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-a91d9cb0-0904-40b4-a559-38d8ba9dd4fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1623416f330444a49fa819d157169fcc'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:21:55.540182 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f311285-9767-423b-94a9-fef71ebf9548 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:55.569895 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 854/1704] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:21:54 2022] DELETE /identity/v3/users/1623416f330444a49fa819d157169fcc => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:21:55.571409 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a68c62-af9f-4020-9120-8fc40784f459 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:55.571706 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a68c62-af9f-4020-9120-8fc40784f459 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:55.572187 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a68c62-af9f-4020-9120-8fc40784f459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:55.589399 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:55.626132 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-f1a68c62-af9f-4020-9120-8fc40784f459 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:55.630220 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-f1a68c62-af9f-4020-9120-8fc40784f459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:55.821520 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 855/1705] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:21:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:21:55.838127 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ed050-56e1-4a3d-8380-142a6c4e5710 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:55.839119 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a68c62-af9f-4020-9120-8fc40784f459 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:55.840847 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-f1a68c62-af9f-4020-9120-8fc40784f459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:55.843498 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ed050-56e1-4a3d-8380-142a6c4e5710 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:55.843937 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ed050-56e1-4a3d-8380-142a6c4e5710 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:55.846087 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ed050-56e1-4a3d-8380-142a6c4e5710 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:55.858600 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-434ed050-56e1-4a3d-8380-142a6c4e5710 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:56.082876 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a68c62-af9f-4020-9120-8fc40784f459 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:56.101466 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fed581-b339-46d3-a485-a8b6635e82ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:56.102196 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fed581-b339-46d3-a485-a8b6635e82ac service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:56.102517 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fed581-b339-46d3-a485-a8b6635e82ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:56.102819 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fed581-b339-46d3-a485-a8b6635e82ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:56.140455 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fed581-b339-46d3-a485-a8b6635e82ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:56.142190 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fed581-b339-46d3-a485-a8b6635e82ac service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:56.147612 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:56.165493 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 856/1706] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:21:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:21:56.191767 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fed581-b339-46d3-a485-a8b6635e82ac service neutron] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:56.199180 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-b4fed581-b339-46d3-a485-a8b6635e82ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:56.270404 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434ed050-56e1-4a3d-8380-142a6c4e5710 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:56.275338 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434ed050-56e1-4a3d-8380-142a6c4e5710 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:56.331760 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 851/1707] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:21:55 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 844 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:21:56.434631 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ed050-56e1-4a3d-8380-142a6c4e5710 service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:56.438105 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-434ed050-56e1-4a3d-8380-142a6c4e5710 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:56.515337 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fed581-b339-46d3-a485-a8b6635e82ac service neutron] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:56.538355 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cfc8de-d551-4460-ae35-fe4afed39f2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:56.539158 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfc8de-d551-4460-ae35-fe4afed39f2e service nova] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:56.539497 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfc8de-d551-4460-ae35-fe4afed39f2e service nova] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:56.539775 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfc8de-d551-4460-ae35-fe4afed39f2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:56.551171 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-e3cfc8de-d551-4460-ae35-fe4afed39f2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:56.855849 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ed050-56e1-4a3d-8380-142a6c4e5710 service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:56.884562 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cfc8de-d551-4460-ae35-fe4afed39f2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:56.892734 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cfc8de-d551-4460-ae35-fe4afed39f2e service nova] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:56.917041 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06062404-4bc6-49ca-9e7e-fdf5ca9708de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e866f134f64644bf33e3adecf207c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:56.919464 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06062404-4bc6-49ca-9e7e-fdf5ca9708de service placement] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:56.919951 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06062404-4bc6-49ca-9e7e-fdf5ca9708de service placement] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:56.920438 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06062404-4bc6-49ca-9e7e-fdf5ca9708de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:56.939236 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-06062404-4bc6-49ca-9e7e-fdf5ca9708de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:56.958508 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 857/1708] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:21:56 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 770 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:21:56.960581 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cfc8de-d551-4460-ae35-fe4afed39f2e service nova] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:56.976129 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-e3cfc8de-d551-4460-ae35-fe4afed39f2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:57.052240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06062404-4bc6-49ca-9e7e-fdf5ca9708de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:57.052581 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cfc8de-d551-4460-ae35-fe4afed39f2e service nova] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:57.056214 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06062404-4bc6-49ca-9e7e-fdf5ca9708de service placement] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:57.090388 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00bb6b6-1884-4491-b0fb-d2dbb8b5cc7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:57.091754 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bb6b6-1884-4491-b0fb-d2dbb8b5cc7a service nova] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:57.093865 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bb6b6-1884-4491-b0fb-d2dbb8b5cc7a service nova] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:57.094402 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bb6b6-1884-4491-b0fb-d2dbb8b5cc7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:57.105086 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-f00bb6b6-1884-4491-b0fb-d2dbb8b5cc7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:57.132534 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 852/1709] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:21:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 696 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:21:57.135105 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8fcad-b51b-43bd-b099-7eed93973323 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:57.135688 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8fcad-b51b-43bd-b099-7eed93973323 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:57.136169 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8fcad-b51b-43bd-b099-7eed93973323 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:57.155091 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 853/1710] 10.222.0.60 () {54 vars in 961 bytes} [Wed Sep 21 12:21:57 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:21:57.157285 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a774f7-72ae-4301-afd2-9c60696ca4ba None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:57.157814 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a774f7-72ae-4301-afd2-9c60696ca4ba None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:57.158291 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a774f7-72ae-4301-afd2-9c60696ca4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:57.302457 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-b7a774f7-72ae-4301-afd2-9c60696ca4ba None None] MFA Rules not processed for user `74e866f134f64644bf33e3adecf207c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:57.318391 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b7a774f7-72ae-4301-afd2-9c60696ca4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:57.385531 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 854/1711] 10.222.0.60 () {58 vars in 1058 bytes} [Wed Sep 21 12:21:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:21:57.389492 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb15fe4-c800-44e8-b652-fc0678d4bddd None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:57.389974 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb15fe4-c800-44e8-b652-fc0678d4bddd None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:57.390502 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb15fe4-c800-44e8-b652-fc0678d4bddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:57.597387 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00bb6b6-1884-4491-b0fb-d2dbb8b5cc7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:57.600680 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00bb6b6-1884-4491-b0fb-d2dbb8b5cc7a service nova] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:57.603762 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-6fb15fe4-c800-44e8-b652-fc0678d4bddd None None] MFA Rules not processed for user `cf20489fb7624e34b71ed9f03c2f50d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:57.611644 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-6fb15fe4-c800-44e8-b652-fc0678d4bddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:57.652420 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 858/1712] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:21:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 693 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:21:57.661287 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00bb6b6-1884-4491-b0fb-d2dbb8b5cc7a service nova] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:57.720334 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00bb6b6-1884-4491-b0fb-d2dbb8b5cc7a service nova] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:57.747867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5243f07-b381-43c0-a288-86be3e6b710a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e866f134f64644bf33e3adecf207c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:57.750879 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5243f07-b381-43c0-a288-86be3e6b710a service placement] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:57.755751 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5243f07-b381-43c0-a288-86be3e6b710a service placement] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:57.756716 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5243f07-b381-43c0-a288-86be3e6b710a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:57.802880 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5243f07-b381-43c0-a288-86be3e6b710a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:57.807148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5243f07-b381-43c0-a288-86be3e6b710a service placement] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:57.862789 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:57.864622 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 859/1713] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:21:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:21:57.985846 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5243f07-b381-43c0-a288-86be3e6b710a service placement] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:57.988464 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-e5243f07-b381-43c0-a288-86be3e6b710a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:58.060117 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5243f07-b381-43c0-a288-86be3e6b710a service placement] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:58.106107 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0b498-4f43-44d0-bc78-7bd807ca8fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:58.108180 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0b498-4f43-44d0-bc78-7bd807ca8fcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:58.108489 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0b498-4f43-44d0-bc78-7bd807ca8fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:58.108996 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0b498-4f43-44d0-bc78-7bd807ca8fcd admin admin] PATH_INFO: `/v3/projects/2fbcbe1a2b754b6cb2ac04f1a9ab40a4` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:58.111609 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d0b498-4f43-44d0-bc78-7bd807ca8fcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fbcbe1a2b754b6cb2ac04f1a9ab40a4)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:58.118514 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 855/1714] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:21:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 732 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:21:58.121477 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f390b-df03-4570-9058-d80274596575 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:58.121990 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f390b-df03-4570-9058-d80274596575 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:58.122517 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f390b-df03-4570-9058-d80274596575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:58.127230 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d0b498-4f43-44d0-bc78-7bd807ca8fcd admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:58.240648 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-f04f390b-df03-4570-9058-d80274596575 None None] MFA Rules not processed for user `6fd7dcb531994f118c09e661ae3c3526`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:21:58.241956 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f04f390b-df03-4570-9058-d80274596575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:58.298555 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:21:58.411298 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 856/1715] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:21:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:21:58.427004 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f390b-df03-4570-9058-d80274596575 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:58.462141 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f390b-df03-4570-9058-d80274596575 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:58.473052 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-f6d0b498-4f43-44d0-bc78-7bd807ca8fcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fbcbe1a2b754b6cb2ac04f1a9ab40a4', 'request_id': 'req-f6d0b498-4f43-44d0-bc78-7bd807ca8fcd'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:21:58.514932 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-f6d0b498-4f43-44d0-bc78-7bd807ca8fcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fbcbe1a2b754b6cb2ac04f1a9ab40a4', 'request_id': 'req-f6d0b498-4f43-44d0-bc78-7bd807ca8fcd'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:21:58.543159 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-f6d0b498-4f43-44d0-bc78-7bd807ca8fcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fbcbe1a2b754b6cb2ac04f1a9ab40a4', 'request_id': 'req-f6d0b498-4f43-44d0-bc78-7bd807ca8fcd'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:21:58.576162 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-f6d0b498-4f43-44d0-bc78-7bd807ca8fcd admin admin] The token cache is being invalidate because project 2fbcbe1a2b754b6cb2ac04f1a9ab40a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:21:58.576757 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-f6d0b498-4f43-44d0-bc78-7bd807ca8fcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:21:58.580419 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-f6d0b498-4f43-44d0-bc78-7bd807ca8fcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:21:58.582273 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 860/1716] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:21:57 2022] DELETE /identity/v3/projects/2fbcbe1a2b754b6cb2ac04f1a9ab40a4 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:21:58.587900 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0b498-4f43-44d0-bc78-7bd807ca8fcd admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:21:58.595593 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-f6d0b498-4f43-44d0-bc78-7bd807ca8fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:58.779731 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0b498-4f43-44d0-bc78-7bd807ca8fcd admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:21:58.790995 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee9730a-9716-4597-af0a-9f086a0d6da5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:58.793851 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabaa82b-d735-478f-93df-bc258101d405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:21:58.794767 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabaa82b-d735-478f-93df-bc258101d405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:58.795280 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabaa82b-d735-478f-93df-bc258101d405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:58.797667 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabaa82b-d735-478f-93df-bc258101d405 admin admin] PATH_INFO: `/v3/users/132651ca187b4a8eaa8bf45170729efa` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:58.797805 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9730a-9716-4597-af0a-9f086a0d6da5 service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:21:58.798056 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9730a-9716-4597-af0a-9f086a0d6da5 service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:21:58.798337 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9730a-9716-4597-af0a-9f086a0d6da5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:21:58.801246 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabaa82b-d735-478f-93df-bc258101d405 admin admin] RBAC: Authorizing `identity:delete_user(user_id=132651ca187b4a8eaa8bf45170729efa)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:58.807057 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-aee9730a-9716-4597-af0a-9f086a0d6da5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:21:58.807579 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabaa82b-d735-478f-93df-bc258101d405 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:58.991123 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-aabaa82b-d735-478f-93df-bc258101d405 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '132651ca187b4a8eaa8bf45170729efa'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:21:59.037624 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-aabaa82b-d735-478f-93df-bc258101d405 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '132651ca187b4a8eaa8bf45170729efa'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:21:59.053567 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-aabaa82b-d735-478f-93df-bc258101d405 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '132651ca187b4a8eaa8bf45170729efa'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:21:59.054602 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-aabaa82b-d735-478f-93df-bc258101d405 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '132651ca187b4a8eaa8bf45170729efa'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:21:59.083974 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-aabaa82b-d735-478f-93df-bc258101d405 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '132651ca187b4a8eaa8bf45170729efa'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:21:59.098466 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 861/1717] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:21:58 2022] DELETE /identity/v3/users/132651ca187b4a8eaa8bf45170729efa => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:21:59.236106 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee9730a-9716-4597-af0a-9f086a0d6da5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:21:59.252919 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee9730a-9716-4597-af0a-9f086a0d6da5 service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:21:59.319086 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 857/1718] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:21:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 907 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:22:00.802046 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabaa82b-d735-478f-93df-bc258101d405 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:00.805064 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-aabaa82b-d735-478f-93df-bc258101d405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:00.959422 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:01.091834 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabaa82b-d735-478f-93df-bc258101d405 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:01.098416 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb45311-ee42-49b7-98c8-966058cd709b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:01.099950 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb45311-ee42-49b7-98c8-966058cd709b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:01.100459 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb45311-ee42-49b7-98c8-966058cd709b admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:01.101033 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb45311-ee42-49b7-98c8-966058cd709b admin admin] PATH_INFO: `/v3/projects/4755c1a9cd1d4caa9189a2aaa591c92b` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:01.105073 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb45311-ee42-49b7-98c8-966058cd709b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4755c1a9cd1d4caa9189a2aaa591c92b)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:01.112581 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb45311-ee42-49b7-98c8-966058cd709b admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:01.587141 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-efb45311-ee42-49b7-98c8-966058cd709b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4755c1a9cd1d4caa9189a2aaa591c92b', 'request_id': 'req-efb45311-ee42-49b7-98c8-966058cd709b'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:01.610601 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-efb45311-ee42-49b7-98c8-966058cd709b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4755c1a9cd1d4caa9189a2aaa591c92b', 'request_id': 'req-efb45311-ee42-49b7-98c8-966058cd709b'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:01.645157 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-efb45311-ee42-49b7-98c8-966058cd709b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4755c1a9cd1d4caa9189a2aaa591c92b', 'request_id': 'req-efb45311-ee42-49b7-98c8-966058cd709b'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:01.769681 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-efb45311-ee42-49b7-98c8-966058cd709b admin admin] The token cache is being invalidate because project 4755c1a9cd1d4caa9189a2aaa591c92b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:22:01.770865 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-efb45311-ee42-49b7-98c8-966058cd709b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:01.773486 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-efb45311-ee42-49b7-98c8-966058cd709b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:01.783633 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 862/1719] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:22:00 2022] DELETE /identity/v3/projects/4755c1a9cd1d4caa9189a2aaa591c92b => generated 0 bytes in 982 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:22:01.791241 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04722787-b041-4408-a314-59acf75d1512 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:01.792675 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04722787-b041-4408-a314-59acf75d1512 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:01.792675 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04722787-b041-4408-a314-59acf75d1512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:01.910543 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-04722787-b041-4408-a314-59acf75d1512 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:01.927951 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-04722787-b041-4408-a314-59acf75d1512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:01.997098 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:02.311179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 858/1720] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 522 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:22:02.313362 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3d97c-f93c-4294-bd00-7cc80b3557ab None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:02.313882 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3d97c-f93c-4294-bd00-7cc80b3557ab None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:02.313992 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3d97c-f93c-4294-bd00-7cc80b3557ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:02.397159 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-c3b3d97c-f93c-4294-bd00-7cc80b3557ab None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:02.400088 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-c3b3d97c-f93c-4294-bd00-7cc80b3557ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:02.478355 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 863/1721] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:22:02.489751 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04722787-b041-4408-a314-59acf75d1512 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:02.506086 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04722787-b041-4408-a314-59acf75d1512 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:02.529690 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e33a9-8a99-48f4-82ed-b7a288c07e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:02.530404 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e33a9-8a99-48f4-82ed-b7a288c07e7d admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:02.530746 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e33a9-8a99-48f4-82ed-b7a288c07e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:02.531055 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e33a9-8a99-48f4-82ed-b7a288c07e7d admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:02.531994 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e33a9-8a99-48f4-82ed-b7a288c07e7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:22:02.532519 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e33a9-8a99-48f4-82ed-b7a288c07e7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:02.547045 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e33a9-8a99-48f4-82ed-b7a288c07e7d admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:02.591964 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 859/1722] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:22:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:22:02.598155 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3d97c-f93c-4294-bd00-7cc80b3557ab None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:02.617719 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3d97c-f93c-4294-bd00-7cc80b3557ab None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:02.651891 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15018da6-66f9-4551-bee6-a65bd3761670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:02.652665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15018da6-66f9-4551-bee6-a65bd3761670 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:02.652978 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15018da6-66f9-4551-bee6-a65bd3761670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:02.653462 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15018da6-66f9-4551-bee6-a65bd3761670 admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:02.654303 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15018da6-66f9-4551-bee6-a65bd3761670 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:02.656669 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15018da6-66f9-4551-bee6-a65bd3761670 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:02.770605 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 864/1723] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:22:02 2022] POST /identity/v3/projects => generated 357 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:22:02.774513 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e33a9-8a99-48f4-82ed-b7a288c07e7d admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:02.811594 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e33a9-8a99-48f4-82ed-b7a288c07e7d admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:03.303675 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9a368-e5b9-4b23-89bc-68d5c0494023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:03.310701 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9a368-e5b9-4b23-89bc-68d5c0494023 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:03.317008 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9a368-e5b9-4b23-89bc-68d5c0494023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:03.317677 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9a368-e5b9-4b23-89bc-68d5c0494023 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:03.321368 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b9a368-e5b9-4b23-89bc-68d5c0494023 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:03.327474 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b9a368-e5b9-4b23-89bc-68d5c0494023 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:03.474114 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 860/1724] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:22:02 2022] POST /identity/v3/users => generated 279 bytes in 700 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:22:03.475523 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15018da6-66f9-4551-bee6-a65bd3761670 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:03.495111 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15018da6-66f9-4551-bee6-a65bd3761670 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:03.518564 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e923d18-cbe9-4304-84b8-b0b235bb95b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:03.519827 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e923d18-cbe9-4304-84b8-b0b235bb95b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:03.520489 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e923d18-cbe9-4304-84b8-b0b235bb95b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:03.520970 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e923d18-cbe9-4304-84b8-b0b235bb95b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:03.521817 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e923d18-cbe9-4304-84b8-b0b235bb95b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:03.530598 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e923d18-cbe9-4304-84b8-b0b235bb95b2 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:03.569314 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 865/1725] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:22:03.598654 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9a368-e5b9-4b23-89bc-68d5c0494023 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:03.629835 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9a368-e5b9-4b23-89bc-68d5c0494023 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:03.646316 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28919578-037b-4b8d-af3c-f303f2119ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:03.647461 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28919578-037b-4b8d-af3c-f303f2119ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:03.648093 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28919578-037b-4b8d-af3c-f303f2119ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:03.648598 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28919578-037b-4b8d-af3c-f303f2119ae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:03.649585 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28919578-037b-4b8d-af3c-f303f2119ae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:03.653067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28919578-037b-4b8d-af3c-f303f2119ae6 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:03.724421 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 861/1726] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:22:03.731606 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e923d18-cbe9-4304-84b8-b0b235bb95b2 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:03.768265 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e923d18-cbe9-4304-84b8-b0b235bb95b2 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:03.797905 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f78e4-5bef-4d55-a709-e38ae9cb78cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:03.798676 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f78e4-5bef-4d55-a709-e38ae9cb78cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:03.798967 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f78e4-5bef-4d55-a709-e38ae9cb78cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:03.799249 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f78e4-5bef-4d55-a709-e38ae9cb78cb admin admin] PATH_INFO: `/v3/projects/f3c1439ddb3149eeb70c6e58f462b6fe/users/19dfb153363641cf98893e4eec4a2879/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:03.898413 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f78e4-5bef-4d55-a709-e38ae9cb78cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3c1439ddb3149eeb70c6e58f462b6fe, user_id=19dfb153363641cf98893e4eec4a2879, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:03.904848 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f78e4-5bef-4d55-a709-e38ae9cb78cb admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:03.960403 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 866/1727] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:22:03 2022] PUT /identity/v3/projects/f3c1439ddb3149eeb70c6e58f462b6fe/users/19dfb153363641cf98893e4eec4a2879/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:22:03.979963 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79edd1-0b1d-4dad-9c74-dfd232818e0c None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:03.980522 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79edd1-0b1d-4dad-9c74-dfd232818e0c None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:03.980805 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79edd1-0b1d-4dad-9c74-dfd232818e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:04.063452 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20e46d-677b-4455-9ea0-cc4d0c7185cc None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:04.063758 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20e46d-677b-4455-9ea0-cc4d0c7185cc None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:04.064340 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20e46d-677b-4455-9ea0-cc4d0c7185cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:04.157929 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-7d79edd1-0b1d-4dad-9c74-dfd232818e0c None None] MFA Rules not processed for user `19dfb153363641cf98893e4eec4a2879`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:04.163155 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7d79edd1-0b1d-4dad-9c74-dfd232818e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:04.202968 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-3b20e46d-677b-4455-9ea0-cc4d0c7185cc None None] MFA Rules not processed for user `bbd7a1d5a8d04e3798ffcab27bad936b`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:04.204355 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-3b20e46d-677b-4455-9ea0-cc4d0c7185cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:04.300990 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:04.475819 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 867/1728] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Sep 21 12:22:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:22:04.735946 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 862/1729] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:03 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 757 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 21 12:22:04.738151 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20e46d-677b-4455-9ea0-cc4d0c7185cc None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:04.944880 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20e46d-677b-4455-9ea0-cc4d0c7185cc None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:04.958080 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79edd1-0b1d-4dad-9c74-dfd232818e0c None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:04.968086 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5da991-e279-4821-a7c0-ed1d6c4e9996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:04.968361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7d79edd1-0b1d-4dad-9c74-dfd232818e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:04.970580 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5da991-e279-4821-a7c0-ed1d6c4e9996 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:04.971601 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5da991-e279-4821-a7c0-ed1d6c4e9996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:04.973317 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5da991-e279-4821-a7c0-ed1d6c4e9996 admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:04.974533 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5da991-e279-4821-a7c0-ed1d6c4e9996 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:04.980880 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5da991-e279-4821-a7c0-ed1d6c4e9996 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:05.045221 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:05.078062 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 868/1730] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:22:04 2022] POST /identity/v3/projects => generated 357 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:22:05.083851 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5da991-e279-4821-a7c0-ed1d6c4e9996 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:05.392641 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5da991-e279-4821-a7c0-ed1d6c4e9996 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:05.414427 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d29100-2643-4d80-aa0a-5d40d109f9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:05.415615 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d29100-2643-4d80-aa0a-5d40d109f9f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:05.417436 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d29100-2643-4d80-aa0a-5d40d109f9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:05.420217 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d29100-2643-4d80-aa0a-5d40d109f9f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:05.426798 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d29100-2643-4d80-aa0a-5d40d109f9f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:05.433989 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d29100-2643-4d80-aa0a-5d40d109f9f3 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:05.509572 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 869/1731] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:22:05 2022] POST /identity/v3/users => generated 285 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:22:05.515316 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d29100-2643-4d80-aa0a-5d40d109f9f3 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:05.532312 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79edd1-0b1d-4dad-9c74-dfd232818e0c None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:05.571268 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d29100-2643-4d80-aa0a-5d40d109f9f3 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:05.597092 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240f79f-fc59-4652-b636-0f83e745e5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:05.598505 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240f79f-fc59-4652-b636-0f83e745e5ec admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:05.599509 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240f79f-fc59-4652-b636-0f83e745e5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:05.602175 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240f79f-fc59-4652-b636-0f83e745e5ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:05.603809 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240f79f-fc59-4652-b636-0f83e745e5ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:05.612395 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240f79f-fc59-4652-b636-0f83e745e5ec admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:05.664855 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 870/1732] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:22:05.667924 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d0c2d-3f45-4921-965b-60d4423b1fb1 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:05.668927 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d0c2d-3f45-4921-965b-60d4423b1fb1 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:05.669590 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d0c2d-3f45-4921-965b-60d4423b1fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:05.804665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-878d0c2d-3f45-4921-965b-60d4423b1fb1 None None] MFA Rules not processed for user `e82cb48b04eb42b99160934b1c8b1f7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:05.810766 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-878d0c2d-3f45-4921-965b-60d4423b1fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:05.882490 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b7ad6-7e93-49d7-911f-804b5bf409d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc2bab11b264196859802907b93ac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:05.886122 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b7ad6-7e93-49d7-911f-804b5bf409d7 service swift] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:05.887162 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b7ad6-7e93-49d7-911f-804b5bf409d7 service swift] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:05.887927 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b7ad6-7e93-49d7-911f-804b5bf409d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:05.943811 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:06.205725 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b7ad6-7e93-49d7-911f-804b5bf409d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:06.210119 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b7ad6-7e93-49d7-911f-804b5bf409d7 service swift] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:06.236228 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 871/1733] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:05 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 562 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:22:06.236228 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d0c2d-3f45-4921-965b-60d4423b1fb1 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:06.296532 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 863/1734] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Sep 21 12:22:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 1344 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 12:22:06.319307 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d0c2d-3f45-4921-965b-60d4423b1fb1 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:06.352506 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc8409-1862-4cbc-a130-6be142512f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:06.357767 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc8409-1862-4cbc-a130-6be142512f67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:06.358292 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc8409-1862-4cbc-a130-6be142512f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:06.358763 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc8409-1862-4cbc-a130-6be142512f67 admin admin] PATH_INFO: `/v3/projects/2d5063b5cd1e40b1bb1bbadc340d9079/users/eb7bb17193dc4e7cb86b8e2cc74e5eb5/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:06.496678 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccc8409-1862-4cbc-a130-6be142512f67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d5063b5cd1e40b1bb1bbadc340d9079, user_id=eb7bb17193dc4e7cb86b8e2cc74e5eb5, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:06.509869 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccc8409-1862-4cbc-a130-6be142512f67 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:06.573840 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 872/1735] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:22:06 2022] PUT /identity/v3/projects/2d5063b5cd1e40b1bb1bbadc340d9079/users/eb7bb17193dc4e7cb86b8e2cc74e5eb5/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:22:06.576519 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b7ad6-7e93-49d7-911f-804b5bf409d7 service swift] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:06.660645 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b7ad6-7e93-49d7-911f-804b5bf409d7 service swift] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:06.820987 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:06.916520 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b0d98-30af-48ba-9810-df15abd39cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:06.917440 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b0d98-30af-48ba-9810-df15abd39cfe admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:06.917735 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b0d98-30af-48ba-9810-df15abd39cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:06.918010 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b0d98-30af-48ba-9810-df15abd39cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:06.919574 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b0d98-30af-48ba-9810-df15abd39cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:06.921283 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b0d98-30af-48ba-9810-df15abd39cfe admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:06.949177 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc8409-1862-4cbc-a130-6be142512f67 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:06.959678 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 864/1736] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:22:06.963253 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc8409-1862-4cbc-a130-6be142512f67 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:06.982546 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888c0b0-a1dc-4ea5-8c0e-fee1648e6362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:06.983530 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888c0b0-a1dc-4ea5-8c0e-fee1648e6362 admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:06.984107 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888c0b0-a1dc-4ea5-8c0e-fee1648e6362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:06.984551 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888c0b0-a1dc-4ea5-8c0e-fee1648e6362 admin admin] PATH_INFO: `/v3/projects/2d5063b5cd1e40b1bb1bbadc340d9079/users/eb7bb17193dc4e7cb86b8e2cc74e5eb5/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:06.990645 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d888c0b0-a1dc-4ea5-8c0e-fee1648e6362 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d5063b5cd1e40b1bb1bbadc340d9079, user_id=eb7bb17193dc4e7cb86b8e2cc74e5eb5, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:07.000716 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d888c0b0-a1dc-4ea5-8c0e-fee1648e6362 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:07.054884 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 873/1737] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:22:06 2022] PUT /identity/v3/projects/2d5063b5cd1e40b1bb1bbadc340d9079/users/eb7bb17193dc4e7cb86b8e2cc74e5eb5/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:22:07.068036 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759de4e-418d-4fd3-bdd8-86e5da3c824f None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:07.068322 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759de4e-418d-4fd3-bdd8-86e5da3c824f None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:07.068853 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759de4e-418d-4fd3-bdd8-86e5da3c824f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:07.193318 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-b759de4e-418d-4fd3-bdd8-86e5da3c824f None None] MFA Rules not processed for user `eb7bb17193dc4e7cb86b8e2cc74e5eb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:07.214221 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b759de4e-418d-4fd3-bdd8-86e5da3c824f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:07.582799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 865/1738] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:07 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 516 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:22:07.698438 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888c0b0-a1dc-4ea5-8c0e-fee1648e6362 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:07.701063 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-d888c0b0-a1dc-4ea5-8c0e-fee1648e6362 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:07.944869 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888c0b0-a1dc-4ea5-8c0e-fee1648e6362 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:07.963109 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6c04d-321b-4e41-9f98-0d0014261ad6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:07.964500 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6c04d-321b-4e41-9f98-0d0014261ad6 service cinder] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:07.964812 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6c04d-321b-4e41-9f98-0d0014261ad6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:07.965091 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6c04d-321b-4e41-9f98-0d0014261ad6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:07.999780 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6c04d-321b-4e41-9f98-0d0014261ad6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:08.001399 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6c04d-321b-4e41-9f98-0d0014261ad6 service cinder] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:08.033658 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 874/1739] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:22:07 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:22:08.443130 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759de4e-418d-4fd3-bdd8-86e5da3c824f None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:08.466272 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759de4e-418d-4fd3-bdd8-86e5da3c824f None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:08.492937 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa339439-a952-42d9-92b1-1624e78d97e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:08.497814 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa339439-a952-42d9-92b1-1624e78d97e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:08.499875 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa339439-a952-42d9-92b1-1624e78d97e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:08.500466 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa339439-a952-42d9-92b1-1624e78d97e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:08.671539 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa339439-a952-42d9-92b1-1624e78d97e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:08.673693 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa339439-a952-42d9-92b1-1624e78d97e1 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:08.717278 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 866/1740] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:22:08 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:22:12.436764 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dc385-31e5-4822-a654-1c902fde4840 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:12.437634 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dc385-31e5-4822-a654-1c902fde4840 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:12.438003 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dc385-31e5-4822-a654-1c902fde4840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:12.518281 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-655dc385-31e5-4822-a654-1c902fde4840 None None] MFA Rules not processed for user `cf20489fb7624e34b71ed9f03c2f50d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:12.519633 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-655dc385-31e5-4822-a654-1c902fde4840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:12.646453 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b290df3-3a33-4a13-9a8d-ecd699992c07 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:12.647322 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b290df3-3a33-4a13-9a8d-ecd699992c07 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:12.647322 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b290df3-3a33-4a13-9a8d-ecd699992c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:12.716844 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-2b290df3-3a33-4a13-9a8d-ecd699992c07 None None] MFA Rules not processed for user `ab0521c25c2d4417944efa4745588f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:12.719295 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2b290df3-3a33-4a13-9a8d-ecd699992c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:12.811301 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 875/1741] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:22:12.968433 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 867/1742] 10.222.0.76 () {58 vars in 1015 bytes} [Wed Sep 21 12:22:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:22:12.991740 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655dc385-31e5-4822-a654-1c902fde4840 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:12.994955 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-655dc385-31e5-4822-a654-1c902fde4840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:13.077934 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655dc385-31e5-4822-a654-1c902fde4840 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:13.095385 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa7abd-0518-41bb-9133-2ffdd4cddecf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:13.096403 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa7abd-0518-41bb-9133-2ffdd4cddecf service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:13.099326 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa7abd-0518-41bb-9133-2ffdd4cddecf service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:13.102121 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa7abd-0518-41bb-9133-2ffdd4cddecf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:13.139797 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fa7abd-0518-41bb-9133-2ffdd4cddecf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:13.147756 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fa7abd-0518-41bb-9133-2ffdd4cddecf service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:13.210891 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 876/1743] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:22:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:22:16.685533 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf0ed4-270f-48d6-8305-d93e5b6d8cf4 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:16.686111 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf0ed4-270f-48d6-8305-d93e5b6d8cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:16.686748 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf0ed4-270f-48d6-8305-d93e5b6d8cf4 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:16.690807 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 868/1744] 10.222.0.60 () {54 vars in 921 bytes} [Wed Sep 21 12:22:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:22:16.798132 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17036751-1953-43c7-bae2-5ed0ca5f7b74 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:16.800249 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17036751-1953-43c7-bae2-5ed0ca5f7b74 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:16.801665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17036751-1953-43c7-bae2-5ed0ca5f7b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:16.917347 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-17036751-1953-43c7-bae2-5ed0ca5f7b74 None None] MFA Rules not processed for user `6cb4001f94b8439180ca2a93d3b279b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:16.922905 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-17036751-1953-43c7-bae2-5ed0ca5f7b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:17.005642 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:17.238299 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 877/1745] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Sep 21 12:22:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:22:20.221339 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf0ed4-270f-48d6-8305-d93e5b6d8cf4 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:20.225300 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-cecf0ed4-270f-48d6-8305-d93e5b6d8cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:20.248884 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:20.422447 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704bf679-858b-467c-a962-fb308f223449 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:20.423620 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704bf679-858b-467c-a962-fb308f223449 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:20.424235 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704bf679-858b-467c-a962-fb308f223449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:20.502622 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-704bf679-858b-467c-a962-fb308f223449 None None] MFA Rules not processed for user `a55997792b7843439d62ef7d5245382b`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:20.505911 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-704bf679-858b-467c-a962-fb308f223449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:20.571196 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf0ed4-270f-48d6-8305-d93e5b6d8cf4 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:20.584903 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db8ed4-6278-4dca-9c25-2cd0ba28e774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:20.585958 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db8ed4-6278-4dca-9c25-2cd0ba28e774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:20.586608 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db8ed4-6278-4dca-9c25-2cd0ba28e774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:20.587108 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db8ed4-6278-4dca-9c25-2cd0ba28e774 admin admin] PATH_INFO: `/v3/users/5a64b9b9a28148fcaf25b6117ac75cae` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:20.591043 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db8ed4-6278-4dca-9c25-2cd0ba28e774 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a64b9b9a28148fcaf25b6117ac75cae)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:20.598576 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db8ed4-6278-4dca-9c25-2cd0ba28e774 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:20.818254 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-63db8ed4-6278-4dca-9c25-2cd0ba28e774 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a64b9b9a28148fcaf25b6117ac75cae'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:20.839993 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-63db8ed4-6278-4dca-9c25-2cd0ba28e774 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a64b9b9a28148fcaf25b6117ac75cae'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:20.939434 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-63db8ed4-6278-4dca-9c25-2cd0ba28e774 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a64b9b9a28148fcaf25b6117ac75cae'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:20.946243 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-63db8ed4-6278-4dca-9c25-2cd0ba28e774 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a64b9b9a28148fcaf25b6117ac75cae'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:20.948518 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 878/1746] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 527 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:22:20.973223 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-63db8ed4-6278-4dca-9c25-2cd0ba28e774 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a64b9b9a28148fcaf25b6117ac75cae'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:20.989885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 869/1747] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:22:20 2022] DELETE /identity/v3/users/5a64b9b9a28148fcaf25b6117ac75cae => generated 0 bytes in 769 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:22:20.996032 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59614327-efb0-4945-a276-91ccf4e04cfb None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:20.996583 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59614327-efb0-4945-a276-91ccf4e04cfb None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:20.997300 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59614327-efb0-4945-a276-91ccf4e04cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:21.071894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-59614327-efb0-4945-a276-91ccf4e04cfb None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:21.074344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-59614327-efb0-4945-a276-91ccf4e04cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:21.292796 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 879/1748] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:22:21.399348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db8ed4-6278-4dca-9c25-2cd0ba28e774 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:21.407301 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-63db8ed4-6278-4dca-9c25-2cd0ba28e774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:21.952708 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59614327-efb0-4945-a276-91ccf4e04cfb None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:21.954663 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-59614327-efb0-4945-a276-91ccf4e04cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:21.991667 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db8ed4-6278-4dca-9c25-2cd0ba28e774 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:21.998868 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f20a2e-de9c-4d0f-a59c-07e9b05d080b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:21.999888 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f20a2e-de9c-4d0f-a59c-07e9b05d080b service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:22.008615 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f20a2e-de9c-4d0f-a59c-07e9b05d080b service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:22.008615 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f20a2e-de9c-4d0f-a59c-07e9b05d080b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:22.010841 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59614327-efb0-4945-a276-91ccf4e04cfb None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:22.019068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f20a2e-de9c-4d0f-a59c-07e9b05d080b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:22.021146 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f20a2e-de9c-4d0f-a59c-07e9b05d080b service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:22.031326 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2fd8a-fed7-48d5-861f-7b153f487bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:22.039287 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2fd8a-fed7-48d5-861f-7b153f487bac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:22.039581 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2fd8a-fed7-48d5-861f-7b153f487bac admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:22.039918 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2fd8a-fed7-48d5-861f-7b153f487bac admin admin] PATH_INFO: `/v3/users/41c6be7d7eb34e2b99d04a5adbb1fc7e` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:22.047900 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2fd8a-fed7-48d5-861f-7b153f487bac admin admin] RBAC: Authorizing `identity:delete_user(user_id=41c6be7d7eb34e2b99d04a5adbb1fc7e)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:22.050222 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2fd8a-fed7-48d5-861f-7b153f487bac admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:22.057735 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 870/1749] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:22:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:22:22.199026 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-d6c2fd8a-fed7-48d5-861f-7b153f487bac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41c6be7d7eb34e2b99d04a5adbb1fc7e'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:22.248565 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:22.272578 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-d6c2fd8a-fed7-48d5-861f-7b153f487bac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41c6be7d7eb34e2b99d04a5adbb1fc7e'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:22.272745 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f20a2e-de9c-4d0f-a59c-07e9b05d080b service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:22.276132 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-46f20a2e-de9c-4d0f-a59c-07e9b05d080b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:22.288580 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-d6c2fd8a-fed7-48d5-861f-7b153f487bac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41c6be7d7eb34e2b99d04a5adbb1fc7e'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:22.290143 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-d6c2fd8a-fed7-48d5-861f-7b153f487bac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41c6be7d7eb34e2b99d04a5adbb1fc7e'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:22.329332 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-d6c2fd8a-fed7-48d5-861f-7b153f487bac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41c6be7d7eb34e2b99d04a5adbb1fc7e'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:22.358989 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 880/1750] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:22:21 2022] DELETE /identity/v3/users/41c6be7d7eb34e2b99d04a5adbb1fc7e => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:22:22.366620 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c2833-5dba-4263-8321-7d9b17540332 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:22.367002 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c2833-5dba-4263-8321-7d9b17540332 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:22.367444 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c2833-5dba-4263-8321-7d9b17540332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:22.410010 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:22.481487 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-308c2833-5dba-4263-8321-7d9b17540332 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:22.493151 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-308c2833-5dba-4263-8321-7d9b17540332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:22.691331 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f20a2e-de9c-4d0f-a59c-07e9b05d080b service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:22.866778 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 881/1751] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 500 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:22:22.918197 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c2833-5dba-4263-8321-7d9b17540332 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:22.921186 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-308c2833-5dba-4263-8321-7d9b17540332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:23.007435 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c41767-eda7-41d2-b346-4cd53bf8c417 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:23.011281 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c41767-eda7-41d2-b346-4cd53bf8c417 service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:23.013198 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c41767-eda7-41d2-b346-4cd53bf8c417 service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:23.013711 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c41767-eda7-41d2-b346-4cd53bf8c417 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:23.022692 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b7c41767-eda7-41d2-b346-4cd53bf8c417 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:23.078156 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c41767-eda7-41d2-b346-4cd53bf8c417 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:23.085725 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c41767-eda7-41d2-b346-4cd53bf8c417 service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:23.138224 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 871/1752] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:22:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 867 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:22:23.170444 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c2833-5dba-4263-8321-7d9b17540332 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:23.202512 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7579ff-6351-4224-9006-c80fe82668d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:23.215283 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7579ff-6351-4224-9006-c80fe82668d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:23.217042 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7579ff-6351-4224-9006-c80fe82668d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:23.217722 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7579ff-6351-4224-9006-c80fe82668d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:23.278182 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7579ff-6351-4224-9006-c80fe82668d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:23.291208 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7579ff-6351-4224-9006-c80fe82668d7 service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:23.317886 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce07ce-7026-4ada-9d3c-4a02a763260f None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:23.319237 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce07ce-7026-4ada-9d3c-4a02a763260f None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:23.319237 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce07ce-7026-4ada-9d3c-4a02a763260f None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:23.326168 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 872/1753] 10.222.0.60 () {54 vars in 921 bytes} [Wed Sep 21 12:22:23 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:22:23.357266 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca5952-854e-46d6-aafb-9bbc676fa3d8 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:23.357861 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca5952-854e-46d6-aafb-9bbc676fa3d8 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:23.358319 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca5952-854e-46d6-aafb-9bbc676fa3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:23.382398 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 882/1754] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:22:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:22:23.407868 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-a4ca5952-854e-46d6-aafb-9bbc676fa3d8 None None] MFA Rules not processed for user `6cb4001f94b8439180ca2a93d3b279b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:23.409631 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a4ca5952-854e-46d6-aafb-9bbc676fa3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:23.458459 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 873/1755] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Sep 21 12:22:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:22:25.919225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7579ff-6351-4224-9006-c80fe82668d7 service neutron] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:25.923716 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-5c7579ff-6351-4224-9006-c80fe82668d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:25.983088 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7579ff-6351-4224-9006-c80fe82668d7 service neutron] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:26.004838 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d70902-df35-4313-8387-9be3d594519a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:26.011944 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d70902-df35-4313-8387-9be3d594519a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:26.013636 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d70902-df35-4313-8387-9be3d594519a admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:26.014451 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d70902-df35-4313-8387-9be3d594519a admin admin] PATH_INFO: `/v3/projects/a0b828c869f24714903b303a32fd2ffc` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:26.017476 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d70902-df35-4313-8387-9be3d594519a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0b828c869f24714903b303a32fd2ffc)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:26.026741 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d70902-df35-4313-8387-9be3d594519a admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:26.215898 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-c3d70902-df35-4313-8387-9be3d594519a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0b828c869f24714903b303a32fd2ffc', 'request_id': 'req-c3d70902-df35-4313-8387-9be3d594519a'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:26.240247 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-c3d70902-df35-4313-8387-9be3d594519a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0b828c869f24714903b303a32fd2ffc', 'request_id': 'req-c3d70902-df35-4313-8387-9be3d594519a'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:26.280901 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-c3d70902-df35-4313-8387-9be3d594519a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0b828c869f24714903b303a32fd2ffc', 'request_id': 'req-c3d70902-df35-4313-8387-9be3d594519a'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:26.320740 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-c3d70902-df35-4313-8387-9be3d594519a admin admin] The token cache is being invalidate because project a0b828c869f24714903b303a32fd2ffc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:22:26.321041 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-c3d70902-df35-4313-8387-9be3d594519a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:26.323822 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-c3d70902-df35-4313-8387-9be3d594519a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:26.333752 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 883/1756] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:22:25 2022] DELETE /identity/v3/projects/a0b828c869f24714903b303a32fd2ffc => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:22:26.334780 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca5952-854e-46d6-aafb-9bbc676fa3d8 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:26.358714 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca5952-854e-46d6-aafb-9bbc676fa3d8 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:26.504276 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d70902-df35-4313-8387-9be3d594519a admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:26.505854 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-c3d70902-df35-4313-8387-9be3d594519a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:26.527397 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:26.549115 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83151f0-3a14-462c-879e-6b2da855b4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:26.551199 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83151f0-3a14-462c-879e-6b2da855b4ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:26.552623 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83151f0-3a14-462c-879e-6b2da855b4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:26.552623 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83151f0-3a14-462c-879e-6b2da855b4ca admin admin] PATH_INFO: `/v3/users/1590f4ad3c154a03aa2b44cc3950978b` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:26.567094 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83151f0-3a14-462c-879e-6b2da855b4ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=1590f4ad3c154a03aa2b44cc3950978b)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:26.606397 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83151f0-3a14-462c-879e-6b2da855b4ca admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:26.755314 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:26.759608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d70902-df35-4313-8387-9be3d594519a admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:26.773834 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-b83151f0-3a14-462c-879e-6b2da855b4ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1590f4ad3c154a03aa2b44cc3950978b'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:26.775662 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c4465-0f58-4039-98e9-2eee2a196ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:26.777359 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c4465-0f58-4039-98e9-2eee2a196ac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:26.778059 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c4465-0f58-4039-98e9-2eee2a196ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:26.778793 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c4465-0f58-4039-98e9-2eee2a196ac1 admin admin] PATH_INFO: `/v3/projects/55bc4e9160814cd0a7523caae5a0fbcc` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:26.782137 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c4465-0f58-4039-98e9-2eee2a196ac1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55bc4e9160814cd0a7523caae5a0fbcc)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:26.790206 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c4465-0f58-4039-98e9-2eee2a196ac1 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:26.804060 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-b83151f0-3a14-462c-879e-6b2da855b4ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1590f4ad3c154a03aa2b44cc3950978b'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:26.867896 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-b83151f0-3a14-462c-879e-6b2da855b4ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1590f4ad3c154a03aa2b44cc3950978b'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:26.883517 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-b83151f0-3a14-462c-879e-6b2da855b4ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1590f4ad3c154a03aa2b44cc3950978b'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:26.930164 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-b83151f0-3a14-462c-879e-6b2da855b4ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1590f4ad3c154a03aa2b44cc3950978b'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:26.959312 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 874/1757] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:22:26 2022] DELETE /identity/v3/users/1590f4ad3c154a03aa2b44cc3950978b => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:22:26.961767 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83151f0-3a14-462c-879e-6b2da855b4ca admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:26.967582 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b83151f0-3a14-462c-879e-6b2da855b4ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:27.047614 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-2c6c4465-0f58-4039-98e9-2eee2a196ac1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55bc4e9160814cd0a7523caae5a0fbcc', 'request_id': 'req-2c6c4465-0f58-4039-98e9-2eee2a196ac1'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:27.081238 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-2c6c4465-0f58-4039-98e9-2eee2a196ac1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55bc4e9160814cd0a7523caae5a0fbcc', 'request_id': 'req-2c6c4465-0f58-4039-98e9-2eee2a196ac1'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:27.116050 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-2c6c4465-0f58-4039-98e9-2eee2a196ac1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55bc4e9160814cd0a7523caae5a0fbcc', 'request_id': 'req-2c6c4465-0f58-4039-98e9-2eee2a196ac1'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:27.187629 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-2c6c4465-0f58-4039-98e9-2eee2a196ac1 admin admin] The token cache is being invalidate because project 55bc4e9160814cd0a7523caae5a0fbcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:22:27.187986 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-2c6c4465-0f58-4039-98e9-2eee2a196ac1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:27.191528 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-2c6c4465-0f58-4039-98e9-2eee2a196ac1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:27.202149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 884/1758] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:22:26 2022] DELETE /identity/v3/projects/55bc4e9160814cd0a7523caae5a0fbcc => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:22:27.204335 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c4465-0f58-4039-98e9-2eee2a196ac1 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:27.210899 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-2c6c4465-0f58-4039-98e9-2eee2a196ac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:27.299751 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83151f0-3a14-462c-879e-6b2da855b4ca admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:27.464781 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd474da-7d42-4b70-9472-3cb57fd8f6ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:27.467074 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd474da-7d42-4b70-9472-3cb57fd8f6ce service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:27.467929 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd474da-7d42-4b70-9472-3cb57fd8f6ce service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:27.468378 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd474da-7d42-4b70-9472-3cb57fd8f6ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:27.473056 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-8cd474da-7d42-4b70-9472-3cb57fd8f6ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:27.509539 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c4465-0f58-4039-98e9-2eee2a196ac1 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:27.518486 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd474da-7d42-4b70-9472-3cb57fd8f6ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:27.520362 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd474da-7d42-4b70-9472-3cb57fd8f6ce service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:27.531183 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ba302-132b-4c35-90cf-cfcbfb86c942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:27.532274 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ba302-132b-4c35-90cf-cfcbfb86c942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:27.532749 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ba302-132b-4c35-90cf-cfcbfb86c942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:27.533230 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ba302-132b-4c35-90cf-cfcbfb86c942 admin admin] PATH_INFO: `/v3/users/cc7a3827c56f4b0a8dcedc88a06491a2` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:27.535776 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 875/1759] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:22:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:22:27.549419 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ba302-132b-4c35-90cf-cfcbfb86c942 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc7a3827c56f4b0a8dcedc88a06491a2)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:27.562195 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ba302-132b-4c35-90cf-cfcbfb86c942 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:27.745984 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:27.782929 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-b22ba302-132b-4c35-90cf-cfcbfb86c942 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc7a3827c56f4b0a8dcedc88a06491a2'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:27.862874 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-b22ba302-132b-4c35-90cf-cfcbfb86c942 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc7a3827c56f4b0a8dcedc88a06491a2'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:27.900803 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-b22ba302-132b-4c35-90cf-cfcbfb86c942 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc7a3827c56f4b0a8dcedc88a06491a2'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:27.902117 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-b22ba302-132b-4c35-90cf-cfcbfb86c942 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc7a3827c56f4b0a8dcedc88a06491a2'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:27.931903 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-b22ba302-132b-4c35-90cf-cfcbfb86c942 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc7a3827c56f4b0a8dcedc88a06491a2'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:27.952710 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 885/1760] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:22:27 2022] DELETE /identity/v3/users/cc7a3827c56f4b0a8dcedc88a06491a2 => generated 0 bytes in 750 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:22:28.236246 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd474da-7d42-4b70-9472-3cb57fd8f6ce service nova] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:28.239340 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-8cd474da-7d42-4b70-9472-3cb57fd8f6ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:28.271758 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd474da-7d42-4b70-9472-3cb57fd8f6ce service nova] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:28.384229 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:28.434285 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae887572-d903-4ef1-85b8-cfb203d89a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:28.435833 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae887572-d903-4ef1-85b8-cfb203d89a3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:28.437093 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae887572-d903-4ef1-85b8-cfb203d89a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:28.438664 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae887572-d903-4ef1-85b8-cfb203d89a3d admin admin] PATH_INFO: `/v3/projects/b0917bbb960647c1b9d1122751e561b0` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:28.442019 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae887572-d903-4ef1-85b8-cfb203d89a3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0917bbb960647c1b9d1122751e561b0)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:28.452843 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae887572-d903-4ef1-85b8-cfb203d89a3d admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:28.648402 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ae887572-d903-4ef1-85b8-cfb203d89a3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0917bbb960647c1b9d1122751e561b0', 'request_id': 'req-ae887572-d903-4ef1-85b8-cfb203d89a3d'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:28.664468 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ae887572-d903-4ef1-85b8-cfb203d89a3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0917bbb960647c1b9d1122751e561b0', 'request_id': 'req-ae887572-d903-4ef1-85b8-cfb203d89a3d'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:28.674069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ae887572-d903-4ef1-85b8-cfb203d89a3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0917bbb960647c1b9d1122751e561b0', 'request_id': 'req-ae887572-d903-4ef1-85b8-cfb203d89a3d'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:28.693347 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ae887572-d903-4ef1-85b8-cfb203d89a3d admin admin] The token cache is being invalidate because project b0917bbb960647c1b9d1122751e561b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:22:28.693960 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ae887572-d903-4ef1-85b8-cfb203d89a3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:28.695010 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ae887572-d903-4ef1-85b8-cfb203d89a3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:28.698907 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 876/1761] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:22:28 2022] DELETE /identity/v3/projects/b0917bbb960647c1b9d1122751e561b0 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:22:28.705769 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41892c8d-7564-4a01-9f38-dc628c235c3c None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:28.707174 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41892c8d-7564-4a01-9f38-dc628c235c3c None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:28.707595 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41892c8d-7564-4a01-9f38-dc628c235c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:28.768851 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-41892c8d-7564-4a01-9f38-dc628c235c3c None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:28.771200 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-41892c8d-7564-4a01-9f38-dc628c235c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:28.820052 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae887572-d903-4ef1-85b8-cfb203d89a3d admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:28.824612 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ae887572-d903-4ef1-85b8-cfb203d89a3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:29.004175 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 886/1762] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:22:29.018569 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffc72a-4316-413a-884d-1be5c67bc455 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:29.019328 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffc72a-4316-413a-884d-1be5c67bc455 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:29.019505 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae887572-d903-4ef1-85b8-cfb203d89a3d admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:29.020196 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffc72a-4316-413a-884d-1be5c67bc455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:29.025568 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f28b61-9497-48b0-adf0-cd5cce8d439c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:29.026561 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f28b61-9497-48b0-adf0-cd5cce8d439c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:29.026948 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f28b61-9497-48b0-adf0-cd5cce8d439c admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:29.027324 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f28b61-9497-48b0-adf0-cd5cce8d439c admin admin] PATH_INFO: `/v3/projects/649205b557af4a6fb0f68f82c3c48131` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:29.028738 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f28b61-9497-48b0-adf0-cd5cce8d439c admin admin] RBAC: Authorizing `identity:delete_project(project_id=649205b557af4a6fb0f68f82c3c48131)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:29.031295 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f28b61-9497-48b0-adf0-cd5cce8d439c admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:29.069005 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-55ffc72a-4316-413a-884d-1be5c67bc455 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:29.072871 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-55ffc72a-4316-413a-884d-1be5c67bc455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:29.107195 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 887/1763] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:22:29.116229 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ffc72a-4316-413a-884d-1be5c67bc455 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:29.140804 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-84f28b61-9497-48b0-adf0-cd5cce8d439c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '649205b557af4a6fb0f68f82c3c48131', 'request_id': 'req-84f28b61-9497-48b0-adf0-cd5cce8d439c'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:29.156239 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ffc72a-4316-413a-884d-1be5c67bc455 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:29.163052 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-84f28b61-9497-48b0-adf0-cd5cce8d439c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '649205b557af4a6fb0f68f82c3c48131', 'request_id': 'req-84f28b61-9497-48b0-adf0-cd5cce8d439c'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:29.188195 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-84f28b61-9497-48b0-adf0-cd5cce8d439c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '649205b557af4a6fb0f68f82c3c48131', 'request_id': 'req-84f28b61-9497-48b0-adf0-cd5cce8d439c'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:29.238659 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-84f28b61-9497-48b0-adf0-cd5cce8d439c admin admin] The token cache is being invalidate because project 649205b557af4a6fb0f68f82c3c48131 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:22:29.239199 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-84f28b61-9497-48b0-adf0-cd5cce8d439c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:29.240525 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-84f28b61-9497-48b0-adf0-cd5cce8d439c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:29.242693 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 877/1764] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:22:28 2022] DELETE /identity/v3/projects/649205b557af4a6fb0f68f82c3c48131 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:22:29.250657 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863d1b1-fb56-4faa-898f-01daf664fa3a None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:29.251158 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863d1b1-fb56-4faa-898f-01daf664fa3a None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:29.251582 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863d1b1-fb56-4faa-898f-01daf664fa3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:29.279096 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:29.313413 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-7863d1b1-fb56-4faa-898f-01daf664fa3a None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:29.316835 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7863d1b1-fb56-4faa-898f-01daf664fa3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:29.347608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6b799-9705-4932-87bb-308840d4bce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:29.351006 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6b799-9705-4932-87bb-308840d4bce6 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:29.351292 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6b799-9705-4932-87bb-308840d4bce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:29.351737 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6b799-9705-4932-87bb-308840d4bce6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:29.352430 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b6b799-9705-4932-87bb-308840d4bce6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:22:29.352741 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b6b799-9705-4932-87bb-308840d4bce6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:29.357619 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b6b799-9705-4932-87bb-308840d4bce6 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:29.390661 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 888/1765] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:22:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:22:29.390661 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6b799-9705-4932-87bb-308840d4bce6 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:29.395289 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-b0b6b799-9705-4932-87bb-308840d4bce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:29.429459 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6b799-9705-4932-87bb-308840d4bce6 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:29.438689 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ac189-01ee-4bf0-82f5-e82020ef8923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:29.439701 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ac189-01ee-4bf0-82f5-e82020ef8923 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:29.439995 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ac189-01ee-4bf0-82f5-e82020ef8923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:29.440277 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ac189-01ee-4bf0-82f5-e82020ef8923 admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:29.442876 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ac189-01ee-4bf0-82f5-e82020ef8923 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:29.444959 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ac189-01ee-4bf0-82f5-e82020ef8923 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:29.545793 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 878/1766] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:22:29.551660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51ecd8-40f0-4260-9a39-9796dc3e6c78 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:29.552601 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51ecd8-40f0-4260-9a39-9796dc3e6c78 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:29.566089 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51ecd8-40f0-4260-9a39-9796dc3e6c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:29.578783 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 889/1767] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:22:29 2022] POST /identity/v3/projects => generated 379 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:22:29.585678 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ac189-01ee-4bf0-82f5-e82020ef8923 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:29.651587 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:29.659546 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-0f51ecd8-40f0-4260-9a39-9796dc3e6c78 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:29.661814 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-0f51ecd8-40f0-4260-9a39-9796dc3e6c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:29.767486 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ac189-01ee-4bf0-82f5-e82020ef8923 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:29.776588 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe880e3-0a4c-4c40-9f83-a3cc344426d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:29.777549 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe880e3-0a4c-4c40-9f83-a3cc344426d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:29.778046 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe880e3-0a4c-4c40-9f83-a3cc344426d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:29.778592 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe880e3-0a4c-4c40-9f83-a3cc344426d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:29.779520 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe880e3-0a4c-4c40-9f83-a3cc344426d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:29.782395 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe880e3-0a4c-4c40-9f83-a3cc344426d0 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:29.849434 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 890/1768] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:22:29 2022] POST /identity/v3/users => generated 290 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:22:29.883583 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe880e3-0a4c-4c40-9f83-a3cc344426d0 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:29.897177 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 879/1769] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:22:29.898299 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51ecd8-40f0-4260-9a39-9796dc3e6c78 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:29.946041 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe880e3-0a4c-4c40-9f83-a3cc344426d0 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:29.955170 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51ecd8-40f0-4260-9a39-9796dc3e6c78 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:29.980588 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37c76a-cb5f-4a73-9603-df0d24bd331d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:29.981666 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37c76a-cb5f-4a73-9603-df0d24bd331d admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:29.982126 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37c76a-cb5f-4a73-9603-df0d24bd331d admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:29.982600 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37c76a-cb5f-4a73-9603-df0d24bd331d admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:29.983813 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37c76a-cb5f-4a73-9603-df0d24bd331d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:22:29.984316 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37c76a-cb5f-4a73-9603-df0d24bd331d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:29.986280 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a3e5e-eb87-4bda-8400-15a164cd7081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:29.987362 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a3e5e-eb87-4bda-8400-15a164cd7081 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:29.990938 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a3e5e-eb87-4bda-8400-15a164cd7081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:29.991715 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a3e5e-eb87-4bda-8400-15a164cd7081 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:29.995224 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a3e5e-eb87-4bda-8400-15a164cd7081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:30.002122 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37c76a-cb5f-4a73-9603-df0d24bd331d admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:30.014612 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a3e5e-eb87-4bda-8400-15a164cd7081 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:30.064845 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 891/1770] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:22:30.065392 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 880/1771] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:22:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:22:30.071886 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a3e5e-eb87-4bda-8400-15a164cd7081 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:30.073888 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37c76a-cb5f-4a73-9603-df0d24bd331d admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:30.084186 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a3e5e-eb87-4bda-8400-15a164cd7081 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:30.094100 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37c76a-cb5f-4a73-9603-df0d24bd331d admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:30.096273 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c94cb-9b84-4d2a-bb4f-22c6623eaa49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:30.096905 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c94cb-9b84-4d2a-bb4f-22c6623eaa49 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:30.097390 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c94cb-9b84-4d2a-bb4f-22c6623eaa49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:30.097674 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c94cb-9b84-4d2a-bb4f-22c6623eaa49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:30.098334 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c94cb-9b84-4d2a-bb4f-22c6623eaa49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:30.100461 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c94cb-9b84-4d2a-bb4f-22c6623eaa49 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:30.103640 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40080b89-3273-4cd9-a3ff-2bda84919b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:30.104916 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40080b89-3273-4cd9-a3ff-2bda84919b76 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:30.105485 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40080b89-3273-4cd9-a3ff-2bda84919b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:30.106018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40080b89-3273-4cd9-a3ff-2bda84919b76 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:30.107415 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40080b89-3273-4cd9-a3ff-2bda84919b76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:30.111502 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40080b89-3273-4cd9-a3ff-2bda84919b76 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:30.130432 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 892/1772] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:22:30.141005 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c94cb-9b84-4d2a-bb4f-22c6623eaa49 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:30.158421 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 881/1773] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:22:30 2022] POST /identity/v3/projects => generated 385 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:22:30.163281 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c94cb-9b84-4d2a-bb4f-22c6623eaa49 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:30.163503 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40080b89-3273-4cd9-a3ff-2bda84919b76 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:30.261863 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40080b89-3273-4cd9-a3ff-2bda84919b76 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:30.268593 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f84233-e15a-42b6-9d46-e88397aac6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:30.269556 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f84233-e15a-42b6-9d46-e88397aac6b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:30.269998 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f84233-e15a-42b6-9d46-e88397aac6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:30.270630 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f84233-e15a-42b6-9d46-e88397aac6b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:30.271631 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f84233-e15a-42b6-9d46-e88397aac6b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:30.273932 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f84233-e15a-42b6-9d46-e88397aac6b0 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:30.306101 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:30.330985 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 882/1774] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:22:30 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:22:30.334682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f84233-e15a-42b6-9d46-e88397aac6b0 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:30.340656 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b261a44-de5f-45ac-a8b0-01a430a471f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:30.341462 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b261a44-de5f-45ac-a8b0-01a430a471f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:30.341676 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b261a44-de5f-45ac-a8b0-01a430a471f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:30.342386 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b261a44-de5f-45ac-a8b0-01a430a471f6 admin admin] PATH_INFO: `/v3/projects/e9926a1ab87b453f9f25ae2e5a129ffd/users/8ff00733993a4dd2b23fcf71b35b5077/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:30.350355 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f84233-e15a-42b6-9d46-e88397aac6b0 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:30.358288 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3089044-f1e1-45d1-99ca-65864bff9c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:30.359666 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3089044-f1e1-45d1-99ca-65864bff9c4b admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:30.360084 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3089044-f1e1-45d1-99ca-65864bff9c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:30.360262 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3089044-f1e1-45d1-99ca-65864bff9c4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:30.360951 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3089044-f1e1-45d1-99ca-65864bff9c4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:30.363320 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3089044-f1e1-45d1-99ca-65864bff9c4b admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:30.367804 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b261a44-de5f-45ac-a8b0-01a430a471f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9926a1ab87b453f9f25ae2e5a129ffd, user_id=8ff00733993a4dd2b23fcf71b35b5077, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:30.375411 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 883/1775] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:22:30.379907 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3089044-f1e1-45d1-99ca-65864bff9c4b admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:30.383617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b261a44-de5f-45ac-a8b0-01a430a471f6 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:30.394185 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3089044-f1e1-45d1-99ca-65864bff9c4b admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:30.410741 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 893/1776] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:22:30 2022] PUT /identity/v3/projects/e9926a1ab87b453f9f25ae2e5a129ffd/users/8ff00733993a4dd2b23fcf71b35b5077/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:22:30.425463 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a487a46-5c06-43e6-a283-83da6c6f8234 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:30.425899 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a487a46-5c06-43e6-a283-83da6c6f8234 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:30.426282 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a487a46-5c06-43e6-a283-83da6c6f8234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:30.487288 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-4a487a46-5c06-43e6-a283-83da6c6f8234 None None] MFA Rules not processed for user `8ff00733993a4dd2b23fcf71b35b5077`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:30.491731 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-4a487a46-5c06-43e6-a283-83da6c6f8234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:30.559621 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa186b-9131-41f9-81b6-dd3b1712fad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:30.560565 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa186b-9131-41f9-81b6-dd3b1712fad0 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:30.561032 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa186b-9131-41f9-81b6-dd3b1712fad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:30.561474 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa186b-9131-41f9-81b6-dd3b1712fad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:30.566396 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa186b-9131-41f9-81b6-dd3b1712fad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:30.569447 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa186b-9131-41f9-81b6-dd3b1712fad0 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:30.616746 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 884/1777] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:22:30.618558 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa186b-9131-41f9-81b6-dd3b1712fad0 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:30.654028 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa186b-9131-41f9-81b6-dd3b1712fad0 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:30.681666 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf0f51-c639-4146-b5f3-1d0c3b14f630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:30.686099 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf0f51-c639-4146-b5f3-1d0c3b14f630 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:30.695823 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf0f51-c639-4146-b5f3-1d0c3b14f630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:30.695823 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf0f51-c639-4146-b5f3-1d0c3b14f630 admin admin] PATH_INFO: `/v3/projects/d06e44db692f4be8a688f7f0310d2a58/users/559d098175c44e43897ef04e29fb5d90/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:30.751388 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf0f51-c639-4146-b5f3-1d0c3b14f630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d06e44db692f4be8a688f7f0310d2a58, user_id=559d098175c44e43897ef04e29fb5d90, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:30.757715 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf0f51-c639-4146-b5f3-1d0c3b14f630 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:30.785297 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:30.822744 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 894/1778] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:22:30.835278 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a487a46-5c06-43e6-a283-83da6c6f8234 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:30.886688 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a487a46-5c06-43e6-a283-83da6c6f8234 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:30.893445 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 885/1779] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:22:30 2022] PUT /identity/v3/projects/d06e44db692f4be8a688f7f0310d2a58/users/559d098175c44e43897ef04e29fb5d90/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:22:30.911025 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b567c-7bcd-4534-aff7-8c69724e8527 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:30.911409 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b567c-7bcd-4534-aff7-8c69724e8527 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:30.912182 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b567c-7bcd-4534-aff7-8c69724e8527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:30.964274 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-353b567c-7bcd-4534-aff7-8c69724e8527 None None] MFA Rules not processed for user `559d098175c44e43897ef04e29fb5d90`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:30.965686 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-353b567c-7bcd-4534-aff7-8c69724e8527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:30.991932 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d92e88-3ca6-461e-bf1b-c24bd7a7fdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:30.992996 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d92e88-3ca6-461e-bf1b-c24bd7a7fdce admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:30.993437 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d92e88-3ca6-461e-bf1b-c24bd7a7fdce admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:30.993716 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d92e88-3ca6-461e-bf1b-c24bd7a7fdce admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:30.995152 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d92e88-3ca6-461e-bf1b-c24bd7a7fdce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:30.997281 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d92e88-3ca6-461e-bf1b-c24bd7a7fdce admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:31.067656 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 895/1780] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:22:30 2022] POST /identity/v3/projects => generated 381 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:22:31.074159 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d92e88-3ca6-461e-bf1b-c24bd7a7fdce admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:31.090663 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 886/1781] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:22:31.097597 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b567c-7bcd-4534-aff7-8c69724e8527 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:31.116366 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b567c-7bcd-4534-aff7-8c69724e8527 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:31.232748 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:31.252843 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced94cda-91c8-45b1-a81f-bee722ae61c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:31.253629 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced94cda-91c8-45b1-a81f-bee722ae61c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:31.254213 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced94cda-91c8-45b1-a81f-bee722ae61c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:31.254694 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced94cda-91c8-45b1-a81f-bee722ae61c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:31.255741 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced94cda-91c8-45b1-a81f-bee722ae61c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:31.258263 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced94cda-91c8-45b1-a81f-bee722ae61c7 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:31.309667 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d92e88-3ca6-461e-bf1b-c24bd7a7fdce admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:31.323647 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 887/1782] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:22:31 2022] POST /identity/v3/projects => generated 385 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:22:31.323909 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9cd2b3-5f75-410a-bb32-2f34c7d1ac7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:31.324465 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9cd2b3-5f75-410a-bb32-2f34c7d1ac7c admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:31.324916 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced94cda-91c8-45b1-a81f-bee722ae61c7 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:31.325093 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9cd2b3-5f75-410a-bb32-2f34c7d1ac7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:31.325413 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9cd2b3-5f75-410a-bb32-2f34c7d1ac7c admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:31.327844 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9cd2b3-5f75-410a-bb32-2f34c7d1ac7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:31.332103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9cd2b3-5f75-410a-bb32-2f34c7d1ac7c admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:31.421899 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 896/1783] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:22:31 2022] POST /identity/v3/users => generated 297 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:22:31.429108 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9cd2b3-5f75-410a-bb32-2f34c7d1ac7c admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:31.502254 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9cd2b3-5f75-410a-bb32-2f34c7d1ac7c admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:31.587115 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced94cda-91c8-45b1-a81f-bee722ae61c7 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:31.597121 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73cbe1-20b6-4830-9321-169f78ab6804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:31.598298 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73cbe1-20b6-4830-9321-169f78ab6804 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:31.598964 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73cbe1-20b6-4830-9321-169f78ab6804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:31.599622 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73cbe1-20b6-4830-9321-169f78ab6804 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:31.601024 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa73cbe1-20b6-4830-9321-169f78ab6804 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:31.606095 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa73cbe1-20b6-4830-9321-169f78ab6804 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:31.662342 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 888/1784] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:22:31 2022] POST /identity/v3/users => generated 299 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:22:31.674928 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73cbe1-20b6-4830-9321-169f78ab6804 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:31.697433 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73cbe1-20b6-4830-9321-169f78ab6804 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:31.704861 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6446ac-4d2b-46b3-9f6f-782b9ce32e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:31.705849 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6446ac-4d2b-46b3-9f6f-782b9ce32e76 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:31.706329 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6446ac-4d2b-46b3-9f6f-782b9ce32e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:31.706851 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6446ac-4d2b-46b3-9f6f-782b9ce32e76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:31.708060 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6446ac-4d2b-46b3-9f6f-782b9ce32e76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:31.711087 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6446ac-4d2b-46b3-9f6f-782b9ce32e76 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:31.716622 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938628e-f011-456b-9f59-764c35527eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:31.717261 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938628e-f011-456b-9f59-764c35527eee admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:31.717566 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938628e-f011-456b-9f59-764c35527eee admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:31.717809 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938628e-f011-456b-9f59-764c35527eee admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:31.719305 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7938628e-f011-456b-9f59-764c35527eee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:31.721163 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7938628e-f011-456b-9f59-764c35527eee admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:31.736261 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 897/1785] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:22:31.740813 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938628e-f011-456b-9f59-764c35527eee admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:31.744647 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 889/1786] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:22:31.748523 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6446ac-4d2b-46b3-9f6f-782b9ce32e76 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:31.761612 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6446ac-4d2b-46b3-9f6f-782b9ce32e76 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:31.762119 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938628e-f011-456b-9f59-764c35527eee admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:31.768955 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4f9f8-ce03-4f51-8af8-462e11e50f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:31.768955 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4f9f8-ce03-4f51-8af8-462e11e50f38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:31.769315 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4f9f8-ce03-4f51-8af8-462e11e50f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:31.769869 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4f9f8-ce03-4f51-8af8-462e11e50f38 admin admin] PATH_INFO: `/v3/projects/221ec66eef43461fbf10407bf0dce034/users/e97b35fd99504cce880b64e8149f77d5/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:31.771533 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961e0fa-c6f0-4ac9-b908-ed1c610f6712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:31.772454 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961e0fa-c6f0-4ac9-b908-ed1c610f6712 admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:31.773152 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961e0fa-c6f0-4ac9-b908-ed1c610f6712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:31.774723 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961e0fa-c6f0-4ac9-b908-ed1c610f6712 admin admin] PATH_INFO: `/v3/projects/858a3d61aa9942e09afefc1543503ecf/users/9525da7c6ddd40ec9bce3bc727f713f1/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:31.779181 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:31.796333 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b4f9f8-ce03-4f51-8af8-462e11e50f38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=221ec66eef43461fbf10407bf0dce034, user_id=e97b35fd99504cce880b64e8149f77d5, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:31.797414 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d961e0fa-c6f0-4ac9-b908-ed1c610f6712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=858a3d61aa9942e09afefc1543503ecf, user_id=9525da7c6ddd40ec9bce3bc727f713f1, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:31.809047 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d961e0fa-c6f0-4ac9-b908-ed1c610f6712 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:31.809147 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b4f9f8-ce03-4f51-8af8-462e11e50f38 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:31.828710 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 898/1787] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:22:31 2022] PUT /identity/v3/projects/858a3d61aa9942e09afefc1543503ecf/users/9525da7c6ddd40ec9bce3bc727f713f1/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:22:31.830312 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961e0fa-c6f0-4ac9-b908-ed1c610f6712 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:31.834345 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 890/1788] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:22:31 2022] PUT /identity/v3/projects/221ec66eef43461fbf10407bf0dce034/users/e97b35fd99504cce880b64e8149f77d5/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:22:31.839795 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4f9f8-ce03-4f51-8af8-462e11e50f38 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:32.018731 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961e0fa-c6f0-4ac9-b908-ed1c610f6712 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:32.024753 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4f9f8-ce03-4f51-8af8-462e11e50f38 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:32.039293 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6855f-8fa6-4559-9533-25f4bdfc997a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:32.040333 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6855f-8fa6-4559-9533-25f4bdfc997a admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:32.041302 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5c5bd-a3a7-49cf-8927-718a90433907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:32.041494 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6855f-8fa6-4559-9533-25f4bdfc997a admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:32.041851 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6855f-8fa6-4559-9533-25f4bdfc997a admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:32.043013 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6855f-8fa6-4559-9533-25f4bdfc997a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:32.043413 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5c5bd-a3a7-49cf-8927-718a90433907 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:32.044346 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5c5bd-a3a7-49cf-8927-718a90433907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:32.045011 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5c5bd-a3a7-49cf-8927-718a90433907 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:32.046557 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5c5bd-a3a7-49cf-8927-718a90433907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:32.048993 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6855f-8fa6-4559-9533-25f4bdfc997a admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:32.056360 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5c5bd-a3a7-49cf-8927-718a90433907 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:32.081973 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 899/1789] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:22:32.086261 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5c5bd-a3a7-49cf-8927-718a90433907 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:32.091562 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 891/1790] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:22:32.097458 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6855f-8fa6-4559-9533-25f4bdfc997a admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:32.129357 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6855f-8fa6-4559-9533-25f4bdfc997a admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:32.143819 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a143be-66b4-46d6-8b78-60f0106bb435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:32.144900 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a143be-66b4-46d6-8b78-60f0106bb435 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:32.145154 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5c5bd-a3a7-49cf-8927-718a90433907 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:32.145379 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a143be-66b4-46d6-8b78-60f0106bb435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:32.145856 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a143be-66b4-46d6-8b78-60f0106bb435 admin admin] PATH_INFO: `/v3/projects/221ec66eef43461fbf10407bf0dce034/users/e97b35fd99504cce880b64e8149f77d5/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:32.149876 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a143be-66b4-46d6-8b78-60f0106bb435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=221ec66eef43461fbf10407bf0dce034, user_id=e97b35fd99504cce880b64e8149f77d5, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:32.151138 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01924ae-3f36-4794-8ae5-412dacffeef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:32.153651 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01924ae-3f36-4794-8ae5-412dacffeef1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:32.154630 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01924ae-3f36-4794-8ae5-412dacffeef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:32.155071 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a143be-66b4-46d6-8b78-60f0106bb435 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:32.155310 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01924ae-3f36-4794-8ae5-412dacffeef1 admin admin] PATH_INFO: `/v3/projects/858a3d61aa9942e09afefc1543503ecf/users/9525da7c6ddd40ec9bce3bc727f713f1/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:32.160203 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01924ae-3f36-4794-8ae5-412dacffeef1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=858a3d61aa9942e09afefc1543503ecf, user_id=9525da7c6ddd40ec9bce3bc727f713f1, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:32.166876 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01924ae-3f36-4794-8ae5-412dacffeef1 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:32.184952 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 892/1791] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:22:32 2022] PUT /identity/v3/projects/221ec66eef43461fbf10407bf0dce034/users/e97b35fd99504cce880b64e8149f77d5/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:22:32.190644 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 900/1792] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:22:32 2022] PUT /identity/v3/projects/858a3d61aa9942e09afefc1543503ecf/users/9525da7c6ddd40ec9bce3bc727f713f1/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:22:32.210391 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0f7c5-549b-4095-b788-32b9c722e51c None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:32.210651 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0f7c5-549b-4095-b788-32b9c722e51c None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:32.210965 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0f7c5-549b-4095-b788-32b9c722e51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:32.213455 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7c3a7-5470-498f-81bc-4afb149b0668 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:32.214089 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7c3a7-5470-498f-81bc-4afb149b0668 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:32.214570 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7c3a7-5470-498f-81bc-4afb149b0668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:32.258422 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:32.262399 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-54d0f7c5-549b-4095-b788-32b9c722e51c None None] MFA Rules not processed for user `e97b35fd99504cce880b64e8149f77d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:32.263931 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-72d7c3a7-5470-498f-81bc-4afb149b0668 None None] MFA Rules not processed for user `9525da7c6ddd40ec9bce3bc727f713f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:32.265721 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-72d7c3a7-5470-498f-81bc-4afb149b0668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:32.268453 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-54d0f7c5-549b-4095-b788-32b9c722e51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:32.390203 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 893/1793] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:32 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:22:32.409824 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7c3a7-5470-498f-81bc-4afb149b0668 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:32.412161 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-72d7c3a7-5470-498f-81bc-4afb149b0668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:32.449743 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 901/1794] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:32 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:22:32.465950 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0f7c5-549b-4095-b788-32b9c722e51c None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:32.469088 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-54d0f7c5-549b-4095-b788-32b9c722e51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:32.510417 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7c3a7-5470-498f-81bc-4afb149b0668 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:32.515530 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2fd66-5018-4af0-a15b-7b16e96e6384 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:32.516330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2fd66-5018-4af0-a15b-7b16e96e6384 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:32.516621 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2fd66-5018-4af0-a15b-7b16e96e6384 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:32.516892 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2fd66-5018-4af0-a15b-7b16e96e6384 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:32.530432 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2fd66-5018-4af0-a15b-7b16e96e6384 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:32.531951 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2fd66-5018-4af0-a15b-7b16e96e6384 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:32.548761 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 894/1795] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:22:32 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:22:32.587546 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0f7c5-549b-4095-b788-32b9c722e51c None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:32.592942 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94700536-dd84-4974-8ab1-cc7aac7e65eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:32.593912 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94700536-dd84-4974-8ab1-cc7aac7e65eb service cinder] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:32.594351 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94700536-dd84-4974-8ab1-cc7aac7e65eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:32.594830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94700536-dd84-4974-8ab1-cc7aac7e65eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:32.607676 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:32.614216 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94700536-dd84-4974-8ab1-cc7aac7e65eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:32.616465 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94700536-dd84-4974-8ab1-cc7aac7e65eb service cinder] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:32.639574 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 902/1796] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:22:32 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:22:32.702091 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2fd66-5018-4af0-a15b-7b16e96e6384 service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:32.725102 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94700536-dd84-4974-8ab1-cc7aac7e65eb service cinder] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:32.736687 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94700536-dd84-4974-8ab1-cc7aac7e65eb service cinder] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:32.742962 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e19e8-d180-4068-8061-234137cb0ead service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:32.744438 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e19e8-d180-4068-8061-234137cb0ead service cinder] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:32.745050 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e19e8-d180-4068-8061-234137cb0ead service cinder] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:32.745346 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e19e8-d180-4068-8061-234137cb0ead service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:32.811491 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2fd66-5018-4af0-a15b-7b16e96e6384 service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:32.820605 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b42b0-edad-43bf-83ea-0c3b754aa32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:32.822344 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b42b0-edad-43bf-83ea-0c3b754aa32d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:32.822628 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b42b0-edad-43bf-83ea-0c3b754aa32d admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:32.823059 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b42b0-edad-43bf-83ea-0c3b754aa32d admin admin] PATH_INFO: `/v3/users/559d098175c44e43897ef04e29fb5d90` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:32.825701 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b42b0-edad-43bf-83ea-0c3b754aa32d admin admin] RBAC: Authorizing `identity:delete_user(user_id=559d098175c44e43897ef04e29fb5d90)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:32.828477 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b42b0-edad-43bf-83ea-0c3b754aa32d admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:32.873920 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e19e8-d180-4068-8061-234137cb0ead service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:32.876681 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e19e8-d180-4068-8061-234137cb0ead service cinder] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:32.894097 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 903/1797] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:22:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:22:32.907024 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:32.912929 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-fb7b42b0-edad-43bf-83ea-0c3b754aa32d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '559d098175c44e43897ef04e29fb5d90'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:32.928331 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-fb7b42b0-edad-43bf-83ea-0c3b754aa32d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '559d098175c44e43897ef04e29fb5d90'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:32.952565 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-fb7b42b0-edad-43bf-83ea-0c3b754aa32d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '559d098175c44e43897ef04e29fb5d90'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:32.954090 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-fb7b42b0-edad-43bf-83ea-0c3b754aa32d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '559d098175c44e43897ef04e29fb5d90'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:32.972950 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-fb7b42b0-edad-43bf-83ea-0c3b754aa32d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '559d098175c44e43897ef04e29fb5d90'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:32.986925 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 895/1798] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:22:32 2022] DELETE /identity/v3/users/559d098175c44e43897ef04e29fb5d90 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:22:32.989204 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac6101-06a6-43c9-b5ae-baa9de09c002 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:32.989665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac6101-06a6-43c9-b5ae-baa9de09c002 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:32.990102 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac6101-06a6-43c9-b5ae-baa9de09c002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:33.057227 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-77ac6101-06a6-43c9-b5ae-baa9de09c002 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:33.060270 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-77ac6101-06a6-43c9-b5ae-baa9de09c002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:33.194456 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 904/1799] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:22:33.207646 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b42b0-edad-43bf-83ea-0c3b754aa32d admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:33.209517 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-fb7b42b0-edad-43bf-83ea-0c3b754aa32d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:33.340568 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b42b0-edad-43bf-83ea-0c3b754aa32d admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:33.347970 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db6e8c-c94f-40ea-8bd4-960828c245af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:33.350279 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db6e8c-c94f-40ea-8bd4-960828c245af service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:33.350279 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db6e8c-c94f-40ea-8bd4-960828c245af service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:33.350279 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db6e8c-c94f-40ea-8bd4-960828c245af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:33.370519 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db6e8c-c94f-40ea-8bd4-960828c245af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:33.372496 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db6e8c-c94f-40ea-8bd4-960828c245af service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:33.389575 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 896/1800] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:22:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:22:34.136159 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac6101-06a6-43c9-b5ae-baa9de09c002 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:34.139050 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-77ac6101-06a6-43c9-b5ae-baa9de09c002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:34.167163 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac6101-06a6-43c9-b5ae-baa9de09c002 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:34.177413 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad1b33-d990-4565-9a53-82fedfd56b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:34.179562 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad1b33-d990-4565-9a53-82fedfd56b3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:34.180334 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad1b33-d990-4565-9a53-82fedfd56b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:34.181881 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad1b33-d990-4565-9a53-82fedfd56b3f admin admin] PATH_INFO: `/v3/users/19dfb153363641cf98893e4eec4a2879` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:34.185633 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad1b33-d990-4565-9a53-82fedfd56b3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=19dfb153363641cf98893e4eec4a2879)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:34.190707 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db6e8c-c94f-40ea-8bd4-960828c245af service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:34.192708 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad1b33-d990-4565-9a53-82fedfd56b3f admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:34.194014 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-86db6e8c-c94f-40ea-8bd4-960828c245af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:34.229744 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db6e8c-c94f-40ea-8bd4-960828c245af service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:34.249224 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cbaadd-1bd8-4fe8-a2b7-b93a78b14b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:34.249805 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbaadd-1bd8-4fe8-a2b7-b93a78b14b08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:34.250352 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbaadd-1bd8-4fe8-a2b7-b93a78b14b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:34.250863 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbaadd-1bd8-4fe8-a2b7-b93a78b14b08 admin admin] PATH_INFO: `/v3/projects/d06e44db692f4be8a688f7f0310d2a58` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:34.253296 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cbaadd-1bd8-4fe8-a2b7-b93a78b14b08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d06e44db692f4be8a688f7f0310d2a58)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:34.259275 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cbaadd-1bd8-4fe8-a2b7-b93a78b14b08 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:34.374683 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-95ad1b33-d990-4565-9a53-82fedfd56b3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19dfb153363641cf98893e4eec4a2879'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:34.385746 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-70cbaadd-1bd8-4fe8-a2b7-b93a78b14b08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd06e44db692f4be8a688f7f0310d2a58', 'request_id': 'req-70cbaadd-1bd8-4fe8-a2b7-b93a78b14b08'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:34.406576 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-70cbaadd-1bd8-4fe8-a2b7-b93a78b14b08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd06e44db692f4be8a688f7f0310d2a58', 'request_id': 'req-70cbaadd-1bd8-4fe8-a2b7-b93a78b14b08'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:34.436192 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-95ad1b33-d990-4565-9a53-82fedfd56b3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19dfb153363641cf98893e4eec4a2879'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:34.436627 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-70cbaadd-1bd8-4fe8-a2b7-b93a78b14b08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd06e44db692f4be8a688f7f0310d2a58', 'request_id': 'req-70cbaadd-1bd8-4fe8-a2b7-b93a78b14b08'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:34.454456 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-95ad1b33-d990-4565-9a53-82fedfd56b3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19dfb153363641cf98893e4eec4a2879'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:34.456389 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-95ad1b33-d990-4565-9a53-82fedfd56b3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19dfb153363641cf98893e4eec4a2879'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:34.470786 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-70cbaadd-1bd8-4fe8-a2b7-b93a78b14b08 admin admin] The token cache is being invalidate because project d06e44db692f4be8a688f7f0310d2a58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:22:34.471436 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-70cbaadd-1bd8-4fe8-a2b7-b93a78b14b08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:34.472871 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-70cbaadd-1bd8-4fe8-a2b7-b93a78b14b08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:34.476475 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-95ad1b33-d990-4565-9a53-82fedfd56b3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19dfb153363641cf98893e4eec4a2879'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:34.476733 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 897/1801] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:22:34 2022] DELETE /identity/v3/projects/d06e44db692f4be8a688f7f0310d2a58 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:22:34.482338 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cbaadd-1bd8-4fe8-a2b7-b93a78b14b08 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:34.485115 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-70cbaadd-1bd8-4fe8-a2b7-b93a78b14b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:34.496042 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 905/1802] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:22:34 2022] DELETE /identity/v3/users/19dfb153363641cf98893e4eec4a2879 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:22:34.503394 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d7587-9e35-410d-84c0-015dc7ba6707 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:34.504164 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d7587-9e35-410d-84c0-015dc7ba6707 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:34.504816 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d7587-9e35-410d-84c0-015dc7ba6707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:34.539900 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:34.555121 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-180d7587-9e35-410d-84c0-015dc7ba6707 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:34.559008 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-180d7587-9e35-410d-84c0-015dc7ba6707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:34.637337 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:34.673191 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cbaadd-1bd8-4fe8-a2b7-b93a78b14b08 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:34.722784 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 906/1803] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:22:34.738967 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d7587-9e35-410d-84c0-015dc7ba6707 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:34.741440 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-180d7587-9e35-410d-84c0-015dc7ba6707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:34.899330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25f564-8bbf-4c88-af25-13392d2a4279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:34.901112 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25f564-8bbf-4c88-af25-13392d2a4279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:34.901768 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25f564-8bbf-4c88-af25-13392d2a4279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:34.902771 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25f564-8bbf-4c88-af25-13392d2a4279 admin admin] PATH_INFO: `/v3/users/e97b35fd99504cce880b64e8149f77d5` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:34.905259 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd25f564-8bbf-4c88-af25-13392d2a4279 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e97b35fd99504cce880b64e8149f77d5)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:34.909603 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd25f564-8bbf-4c88-af25-13392d2a4279 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:34.943107 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d7587-9e35-410d-84c0-015dc7ba6707 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:34.951501 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea57df2-0087-455d-b99e-839c7510e359 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:34.952329 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea57df2-0087-455d-b99e-839c7510e359 service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:34.952814 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea57df2-0087-455d-b99e-839c7510e359 service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:34.953307 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea57df2-0087-455d-b99e-839c7510e359 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:34.979379 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea57df2-0087-455d-b99e-839c7510e359 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:34.982799 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea57df2-0087-455d-b99e-839c7510e359 service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:35.006681 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 907/1804] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:22:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:22:35.021414 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-cd25f564-8bbf-4c88-af25-13392d2a4279 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e97b35fd99504cce880b64e8149f77d5'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:35.035891 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-cd25f564-8bbf-4c88-af25-13392d2a4279 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e97b35fd99504cce880b64e8149f77d5'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:35.073376 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-cd25f564-8bbf-4c88-af25-13392d2a4279 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e97b35fd99504cce880b64e8149f77d5'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:35.073376 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-cd25f564-8bbf-4c88-af25-13392d2a4279 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e97b35fd99504cce880b64e8149f77d5'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:35.092155 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-cd25f564-8bbf-4c88-af25-13392d2a4279 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e97b35fd99504cce880b64e8149f77d5'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:35.109184 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 898/1805] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:22:34 2022] DELETE /identity/v3/users/e97b35fd99504cce880b64e8149f77d5 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:22:35.826479 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea57df2-0087-455d-b99e-839c7510e359 service neutron] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:35.828474 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-4ea57df2-0087-455d-b99e-839c7510e359 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:35.844092 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea57df2-0087-455d-b99e-839c7510e359 service neutron] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:35.902569 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25f564-8bbf-4c88-af25-13392d2a4279 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:35.907819 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-cd25f564-8bbf-4c88-af25-13392d2a4279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:35.985948 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e09e5-0c50-465d-9a2c-22fd581b25b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:35.986820 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e09e5-0c50-465d-9a2c-22fd581b25b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:35.987453 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e09e5-0c50-465d-9a2c-22fd581b25b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:35.987928 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e09e5-0c50-465d-9a2c-22fd581b25b5 admin admin] PATH_INFO: `/v3/projects/f3c1439ddb3149eeb70c6e58f462b6fe` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:35.989254 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e09e5-0c50-465d-9a2c-22fd581b25b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3c1439ddb3149eeb70c6e58f462b6fe)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:35.995335 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e09e5-0c50-465d-9a2c-22fd581b25b5 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:36.128560 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25f564-8bbf-4c88-af25-13392d2a4279 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:36.163321 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-446e09e5-0c50-465d-9a2c-22fd581b25b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3c1439ddb3149eeb70c6e58f462b6fe', 'request_id': 'req-446e09e5-0c50-465d-9a2c-22fd581b25b5'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:36.180242 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:36.224707 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-446e09e5-0c50-465d-9a2c-22fd581b25b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3c1439ddb3149eeb70c6e58f462b6fe', 'request_id': 'req-446e09e5-0c50-465d-9a2c-22fd581b25b5'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:36.266153 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:36.273355 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-446e09e5-0c50-465d-9a2c-22fd581b25b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3c1439ddb3149eeb70c6e58f462b6fe', 'request_id': 'req-446e09e5-0c50-465d-9a2c-22fd581b25b5'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:36.325308 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-446e09e5-0c50-465d-9a2c-22fd581b25b5 admin admin] The token cache is being invalidate because project f3c1439ddb3149eeb70c6e58f462b6fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:22:36.325693 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-446e09e5-0c50-465d-9a2c-22fd581b25b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:36.331025 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-446e09e5-0c50-465d-9a2c-22fd581b25b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:36.344165 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 908/1806] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:22:35 2022] DELETE /identity/v3/projects/f3c1439ddb3149eeb70c6e58f462b6fe => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:22:36.350407 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cceeb-2b94-4fd0-b5c9-7412dbe33d7a None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:36.351864 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cceeb-2b94-4fd0-b5c9-7412dbe33d7a None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:36.366417 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cceeb-2b94-4fd0-b5c9-7412dbe33d7a None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:36.366417 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 909/1807] 10.222.0.60 () {54 vars in 921 bytes} [Wed Sep 21 12:22:36 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:22:36.366417 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896cceeb-2b94-4fd0-b5c9-7412dbe33d7a None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:36.377276 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-896cceeb-2b94-4fd0-b5c9-7412dbe33d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:36.424029 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b8d02-7f44-4fec-a4b2-5e36743f2f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:36.425286 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b8d02-7f44-4fec-a4b2-5e36743f2f1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:36.425867 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b8d02-7f44-4fec-a4b2-5e36743f2f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:36.430228 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b8d02-7f44-4fec-a4b2-5e36743f2f1a admin admin] PATH_INFO: `/v3/projects/221ec66eef43461fbf10407bf0dce034` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:36.434469 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8b8d02-7f44-4fec-a4b2-5e36743f2f1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=221ec66eef43461fbf10407bf0dce034)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:36.441639 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8b8d02-7f44-4fec-a4b2-5e36743f2f1a admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:36.705908 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-1e8b8d02-7f44-4fec-a4b2-5e36743f2f1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '221ec66eef43461fbf10407bf0dce034', 'request_id': 'req-1e8b8d02-7f44-4fec-a4b2-5e36743f2f1a'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:36.739543 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-1e8b8d02-7f44-4fec-a4b2-5e36743f2f1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '221ec66eef43461fbf10407bf0dce034', 'request_id': 'req-1e8b8d02-7f44-4fec-a4b2-5e36743f2f1a'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:36.759948 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-1e8b8d02-7f44-4fec-a4b2-5e36743f2f1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '221ec66eef43461fbf10407bf0dce034', 'request_id': 'req-1e8b8d02-7f44-4fec-a4b2-5e36743f2f1a'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:36.773627 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896cceeb-2b94-4fd0-b5c9-7412dbe33d7a None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:36.820680 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-1e8b8d02-7f44-4fec-a4b2-5e36743f2f1a admin admin] The token cache is being invalidate because project 221ec66eef43461fbf10407bf0dce034 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:22:36.821526 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-1e8b8d02-7f44-4fec-a4b2-5e36743f2f1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:36.824735 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-1e8b8d02-7f44-4fec-a4b2-5e36743f2f1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:36.828950 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 899/1808] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:22:35 2022] DELETE /identity/v3/projects/221ec66eef43461fbf10407bf0dce034 => generated 0 bytes in 928 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:22:36.837393 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d15c0f-747d-46d5-98a9-b4cc5ff1cbfb None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:36.838252 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d15c0f-747d-46d5-98a9-b4cc5ff1cbfb None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:36.839142 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d15c0f-747d-46d5-98a9-b4cc5ff1cbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:36.924644 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70da5f7-36a1-4ede-a820-ee193e480bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:36.926296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70da5f7-36a1-4ede-a820-ee193e480bea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:36.926546 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70da5f7-36a1-4ede-a820-ee193e480bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:36.927084 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70da5f7-36a1-4ede-a820-ee193e480bea admin admin] PATH_INFO: `/v3/users/eb7bb17193dc4e7cb86b8e2cc74e5eb5` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:36.929307 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-80d15c0f-747d-46d5-98a9-b4cc5ff1cbfb None None] MFA Rules not processed for user `6cb4001f94b8439180ca2a93d3b279b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:36.929845 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70da5f7-36a1-4ede-a820-ee193e480bea admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb7bb17193dc4e7cb86b8e2cc74e5eb5)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:36.930838 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-80d15c0f-747d-46d5-98a9-b4cc5ff1cbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:36.934023 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70da5f7-36a1-4ede-a820-ee193e480bea admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:37.041727 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-c70da5f7-36a1-4ede-a820-ee193e480bea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb7bb17193dc4e7cb86b8e2cc74e5eb5'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:37.068295 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-c70da5f7-36a1-4ede-a820-ee193e480bea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb7bb17193dc4e7cb86b8e2cc74e5eb5'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:37.069826 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 900/1809] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Sep 21 12:22:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:22:37.071779 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fd900-fd9b-41e1-8d34-a98a4cebb5a3 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:37.072755 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fd900-fd9b-41e1-8d34-a98a4cebb5a3 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:37.073148 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fd900-fd9b-41e1-8d34-a98a4cebb5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:37.097118 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-c70da5f7-36a1-4ede-a820-ee193e480bea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb7bb17193dc4e7cb86b8e2cc74e5eb5'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:37.098221 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-c70da5f7-36a1-4ede-a820-ee193e480bea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb7bb17193dc4e7cb86b8e2cc74e5eb5'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:37.111138 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-ea8fd900-fd9b-41e1-8d34-a98a4cebb5a3 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:37.112991 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ea8fd900-fd9b-41e1-8d34-a98a4cebb5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:37.124946 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 901/1810] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:22:37.131927 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-c70da5f7-36a1-4ede-a820-ee193e480bea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb7bb17193dc4e7cb86b8e2cc74e5eb5'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:37.137692 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d0a82-f211-4379-9418-61aeb2a72791 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:37.138108 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d0a82-f211-4379-9418-61aeb2a72791 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:37.138262 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d0a82-f211-4379-9418-61aeb2a72791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:37.143178 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 910/1811] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:22:36 2022] DELETE /identity/v3/users/eb7bb17193dc4e7cb86b8e2cc74e5eb5 => generated 0 bytes in 779 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:22:37.165248 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-e47d0a82-f211-4379-9418-61aeb2a72791 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:37.166715 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-e47d0a82-f211-4379-9418-61aeb2a72791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:37.213283 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:37.262824 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 902/1812] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:22:37.269855 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70da5f7-36a1-4ede-a820-ee193e480bea admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:37.289678 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70da5f7-36a1-4ede-a820-ee193e480bea admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:37.301200 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e143e-fcdc-47e4-a2cb-f8ce7403deaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:37.302290 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e143e-fcdc-47e4-a2cb-f8ce7403deaf admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:37.302801 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e143e-fcdc-47e4-a2cb-f8ce7403deaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:37.303608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e143e-fcdc-47e4-a2cb-f8ce7403deaf admin admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:37.305004 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e143e-fcdc-47e4-a2cb-f8ce7403deaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:22:37.317789 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e143e-fcdc-47e4-a2cb-f8ce7403deaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:37.334435 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d0a82-f211-4379-9418-61aeb2a72791 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:37.340032 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-e47d0a82-f211-4379-9418-61aeb2a72791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:37.346148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e143e-fcdc-47e4-a2cb-f8ce7403deaf admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:37.358332 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:37.425780 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 911/1813] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:22:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:22:37.428598 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e143e-fcdc-47e4-a2cb-f8ce7403deaf admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:37.469077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e143e-fcdc-47e4-a2cb-f8ce7403deaf admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:37.480810 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbbf17-aa1e-406e-94df-e32eff5d5dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:37.482078 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbbf17-aa1e-406e-94df-e32eff5d5dc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:37.482728 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbbf17-aa1e-406e-94df-e32eff5d5dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:37.483344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbbf17-aa1e-406e-94df-e32eff5d5dc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:37.484844 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cbbf17-aa1e-406e-94df-e32eff5d5dc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:37.489611 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cbbf17-aa1e-406e-94df-e32eff5d5dc9 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:37.546921 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d0a82-f211-4379-9418-61aeb2a72791 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:37.576847 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3308549-55b1-47d8-b68c-c82cf2e210a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:37.577838 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3308549-55b1-47d8-b68c-c82cf2e210a5 service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:37.578287 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3308549-55b1-47d8-b68c-c82cf2e210a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:37.578793 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3308549-55b1-47d8-b68c-c82cf2e210a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:37.585472 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 912/1814] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:22:37 2022] POST /identity/v3/projects => generated 383 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:22:37.588367 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbbf17-aa1e-406e-94df-e32eff5d5dc9 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:37.590595 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-c3308549-55b1-47d8-b68c-c82cf2e210a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:37.609040 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3308549-55b1-47d8-b68c-c82cf2e210a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:37.612018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3308549-55b1-47d8-b68c-c82cf2e210a5 service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:37.640012 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 903/1815] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:22:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:22:37.730149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbbf17-aa1e-406e-94df-e32eff5d5dc9 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:37.751024 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018a461-e743-41bd-836b-95db7c9672d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:37.751721 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018a461-e743-41bd-836b-95db7c9672d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:37.752144 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018a461-e743-41bd-836b-95db7c9672d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:37.752424 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018a461-e743-41bd-836b-95db7c9672d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:37.753095 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e018a461-e743-41bd-836b-95db7c9672d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:37.755728 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e018a461-e743-41bd-836b-95db7c9672d5 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:37.794691 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 913/1816] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:22:37 2022] POST /identity/v3/users => generated 292 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:22:37.802862 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3308549-55b1-47d8-b68c-c82cf2e210a5 service nova] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:37.814984 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3308549-55b1-47d8-b68c-c82cf2e210a5 service nova] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:37.822881 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329cec7-0129-49dd-ad98-b9aac292c251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:37.823796 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329cec7-0129-49dd-ad98-b9aac292c251 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:37.824781 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329cec7-0129-49dd-ad98-b9aac292c251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:37.824781 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329cec7-0129-49dd-ad98-b9aac292c251 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:37.825232 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329cec7-0129-49dd-ad98-b9aac292c251 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:37.826902 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329cec7-0129-49dd-ad98-b9aac292c251 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:37.840566 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 904/1817] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:22:37.845946 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018a461-e743-41bd-836b-95db7c9672d5 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:37.866463 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018a461-e743-41bd-836b-95db7c9672d5 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:37.881274 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9f2f8-ff96-41e1-9d77-8ab3329619fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:37.882317 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9f2f8-ff96-41e1-9d77-8ab3329619fe admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:37.882835 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9f2f8-ff96-41e1-9d77-8ab3329619fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:37.883311 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9f2f8-ff96-41e1-9d77-8ab3329619fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:37.884487 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff9f2f8-ff96-41e1-9d77-8ab3329619fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:37.888202 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff9f2f8-ff96-41e1-9d77-8ab3329619fe admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:37.916280 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 914/1818] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:22:37.921230 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329cec7-0129-49dd-ad98-b9aac292c251 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:37.937522 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329cec7-0129-49dd-ad98-b9aac292c251 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:37.961601 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816e4fc-b4c2-466e-b299-89e673210ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:37.964582 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816e4fc-b4c2-466e-b299-89e673210ea9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:37.968619 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816e4fc-b4c2-466e-b299-89e673210ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:37.969507 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816e4fc-b4c2-466e-b299-89e673210ea9 admin admin] PATH_INFO: `/v3/projects/83c798bce4cd4e4fad0930687d0cc5de/users/154c577a85364893ac4c864e5adbab2d/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:38.011554 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f816e4fc-b4c2-466e-b299-89e673210ea9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83c798bce4cd4e4fad0930687d0cc5de, user_id=154c577a85364893ac4c864e5adbab2d, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:38.023499 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f816e4fc-b4c2-466e-b299-89e673210ea9 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:38.054745 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 905/1819] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:22:37 2022] PUT /identity/v3/projects/83c798bce4cd4e4fad0930687d0cc5de/users/154c577a85364893ac4c864e5adbab2d/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:22:38.062286 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b07d4-f49d-4069-899e-a1be75e7a644 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:38.063069 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b07d4-f49d-4069-899e-a1be75e7a644 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:38.063069 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b07d4-f49d-4069-899e-a1be75e7a644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:38.140891 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-539b07d4-f49d-4069-899e-a1be75e7a644 None None] MFA Rules not processed for user `154c577a85364893ac4c864e5adbab2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:38.142266 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-539b07d4-f49d-4069-899e-a1be75e7a644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:38.266059 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816e4fc-b4c2-466e-b299-89e673210ea9 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:38.273042 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f816e4fc-b4c2-466e-b299-89e673210ea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:38.295209 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 915/1820] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:22:38.296696 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b07d4-f49d-4069-899e-a1be75e7a644 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:38.407001 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:38.444460 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816e4fc-b4c2-466e-b299-89e673210ea9 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:38.458033 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37766a-4e98-49ad-b9b9-3539b375b896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:38.458321 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37766a-4e98-49ad-b9b9-3539b375b896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:38.458765 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37766a-4e98-49ad-b9b9-3539b375b896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:38.459050 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37766a-4e98-49ad-b9b9-3539b375b896 admin admin] PATH_INFO: `/v3/projects/2d5063b5cd1e40b1bb1bbadc340d9079` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:38.462038 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b07d4-f49d-4069-899e-a1be75e7a644 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:38.463740 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d37766a-4e98-49ad-b9b9-3539b375b896 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d5063b5cd1e40b1bb1bbadc340d9079)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:38.469129 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d37766a-4e98-49ad-b9b9-3539b375b896 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:38.479468 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15032b8-b074-4305-a259-ec363440dcc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:38.480900 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15032b8-b074-4305-a259-ec363440dcc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:38.482166 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15032b8-b074-4305-a259-ec363440dcc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:38.483148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15032b8-b074-4305-a259-ec363440dcc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:38.484752 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15032b8-b074-4305-a259-ec363440dcc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:38.499176 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15032b8-b074-4305-a259-ec363440dcc5 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:38.602825 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:38.624478 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 916/1821] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:22:38 2022] POST /identity/v3/projects => generated 383 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:22:38.633604 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15032b8-b074-4305-a259-ec363440dcc5 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:38.668750 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-6d37766a-4e98-49ad-b9b9-3539b375b896 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d5063b5cd1e40b1bb1bbadc340d9079', 'request_id': 'req-6d37766a-4e98-49ad-b9b9-3539b375b896'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:38.685528 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-6d37766a-4e98-49ad-b9b9-3539b375b896 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d5063b5cd1e40b1bb1bbadc340d9079', 'request_id': 'req-6d37766a-4e98-49ad-b9b9-3539b375b896'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:38.704078 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-6d37766a-4e98-49ad-b9b9-3539b375b896 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d5063b5cd1e40b1bb1bbadc340d9079', 'request_id': 'req-6d37766a-4e98-49ad-b9b9-3539b375b896'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:38.733898 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-6d37766a-4e98-49ad-b9b9-3539b375b896 admin admin] The token cache is being invalidate because project 2d5063b5cd1e40b1bb1bbadc340d9079 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:22:38.734477 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-6d37766a-4e98-49ad-b9b9-3539b375b896 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:38.735553 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-6d37766a-4e98-49ad-b9b9-3539b375b896 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:38.739626 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 906/1822] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:22:38 2022] DELETE /identity/v3/projects/2d5063b5cd1e40b1bb1bbadc340d9079 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:22:38.747934 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2dc66-ce05-49cd-bf8f-d040f9b88fed None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:38.748424 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2dc66-ce05-49cd-bf8f-d040f9b88fed None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:38.749308 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2dc66-ce05-49cd-bf8f-d040f9b88fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:38.787192 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15032b8-b074-4305-a259-ec363440dcc5 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:38.818890 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551bfee-035c-46c6-82b9-e1bfade6c90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:38.819906 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551bfee-035c-46c6-82b9-e1bfade6c90c admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:38.822939 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551bfee-035c-46c6-82b9-e1bfade6c90c admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:38.823523 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551bfee-035c-46c6-82b9-e1bfade6c90c admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:38.824781 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551bfee-035c-46c6-82b9-e1bfade6c90c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:38.828684 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551bfee-035c-46c6-82b9-e1bfade6c90c admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:38.840761 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-a2f2dc66-ce05-49cd-bf8f-d040f9b88fed None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:38.842385 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a2f2dc66-ce05-49cd-bf8f-d040f9b88fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:38.868269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 907/1823] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:22:38.879532 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff8b1c-fe88-4252-ab2b-49fdec281368 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:38.880022 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff8b1c-fe88-4252-ab2b-49fdec281368 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:38.880413 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff8b1c-fe88-4252-ab2b-49fdec281368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:38.893193 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 917/1824] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:22:38 2022] POST /identity/v3/users => generated 298 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:22:38.898910 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551bfee-035c-46c6-82b9-e1bfade6c90c admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:38.907839 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-c551bfee-035c-46c6-82b9-e1bfade6c90c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:38.913428 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-07ff8b1c-fe88-4252-ab2b-49fdec281368 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:38.915217 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-07ff8b1c-fe88-4252-ab2b-49fdec281368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:38.928666 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 908/1825] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:22:38.930017 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff8b1c-fe88-4252-ab2b-49fdec281368 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:38.968053 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff8b1c-fe88-4252-ab2b-49fdec281368 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:38.971089 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551bfee-035c-46c6-82b9-e1bfade6c90c admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:38.999840 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b54caf-2a58-4c7e-986d-23fa5bf028ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:39.000594 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b54caf-2a58-4c7e-986d-23fa5bf028ce admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:39.000951 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b54caf-2a58-4c7e-986d-23fa5bf028ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:39.001305 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b54caf-2a58-4c7e-986d-23fa5bf028ce admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:39.002076 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b54caf-2a58-4c7e-986d-23fa5bf028ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:22:39.002502 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b54caf-2a58-4c7e-986d-23fa5bf028ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:39.004684 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c79c02-0555-498b-9645-0575590d5145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:39.005072 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b54caf-2a58-4c7e-986d-23fa5bf028ce admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:39.005728 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c79c02-0555-498b-9645-0575590d5145 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:39.006225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c79c02-0555-498b-9645-0575590d5145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:39.006734 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c79c02-0555-498b-9645-0575590d5145 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:39.008215 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c79c02-0555-498b-9645-0575590d5145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:39.012332 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c79c02-0555-498b-9645-0575590d5145 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:39.050411 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 909/1826] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:22:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:22:39.051148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 918/1827] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:22:39.063630 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b54caf-2a58-4c7e-986d-23fa5bf028ce admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:39.076366 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c79c02-0555-498b-9645-0575590d5145 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:39.092627 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c79c02-0555-498b-9645-0575590d5145 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:39.099562 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53d886-fdbc-4137-ab0a-f27d7012a00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:39.099813 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b54caf-2a58-4c7e-986d-23fa5bf028ce admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:39.101065 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53d886-fdbc-4137-ab0a-f27d7012a00a admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:39.101706 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53d886-fdbc-4137-ab0a-f27d7012a00a admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:39.102186 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53d886-fdbc-4137-ab0a-f27d7012a00a admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:39.103058 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f53d886-fdbc-4137-ab0a-f27d7012a00a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:39.107491 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f53d886-fdbc-4137-ab0a-f27d7012a00a admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:39.120658 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408e9e3-87c6-4746-91e3-82c33de278a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:39.121931 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408e9e3-87c6-4746-91e3-82c33de278a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:39.122521 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408e9e3-87c6-4746-91e3-82c33de278a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:39.123057 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408e9e3-87c6-4746-91e3-82c33de278a2 admin admin] PATH_INFO: `/v3/projects/19e772dc3ab6498f96e8d8619faf8324/users/c16ba14a541242b1a0d9f02c991eab18/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:39.152427 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9408e9e3-87c6-4746-91e3-82c33de278a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19e772dc3ab6498f96e8d8619faf8324, user_id=c16ba14a541242b1a0d9f02c991eab18, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:39.157909 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9408e9e3-87c6-4746-91e3-82c33de278a2 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:39.191302 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 910/1828] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:22:39 2022] PUT /identity/v3/projects/19e772dc3ab6498f96e8d8619faf8324/users/c16ba14a541242b1a0d9f02c991eab18/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:22:39.202752 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408e9e3-87c6-4746-91e3-82c33de278a2 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:39.222757 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 919/1829] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:22:39 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:22:39.224605 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53d886-fdbc-4137-ab0a-f27d7012a00a admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:39.379528 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53d886-fdbc-4137-ab0a-f27d7012a00a admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:39.381726 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408e9e3-87c6-4746-91e3-82c33de278a2 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:39.386148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc3c1a-351c-4712-9f46-d7680c92fb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:39.386807 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc3c1a-351c-4712-9f46-d7680c92fb79 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:39.387087 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc3c1a-351c-4712-9f46-d7680c92fb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:39.387504 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc3c1a-351c-4712-9f46-d7680c92fb79 admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:39.388155 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc3c1a-351c-4712-9f46-d7680c92fb79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:39.390177 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc3c1a-351c-4712-9f46-d7680c92fb79 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:39.390624 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3990cd-8f99-452c-b117-26a6a61c916a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:39.391710 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3990cd-8f99-452c-b117-26a6a61c916a admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:39.392297 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3990cd-8f99-452c-b117-26a6a61c916a admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:39.393222 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3990cd-8f99-452c-b117-26a6a61c916a admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:39.394400 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3990cd-8f99-452c-b117-26a6a61c916a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:39.397573 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3990cd-8f99-452c-b117-26a6a61c916a admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:39.422547 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 911/1830] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:22:39.423745 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 920/1831] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:22:39 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:22:39.427490 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3990cd-8f99-452c-b117-26a6a61c916a admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:39.428446 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc3c1a-351c-4712-9f46-d7680c92fb79 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:39.443108 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3990cd-8f99-452c-b117-26a6a61c916a admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:39.444110 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc3c1a-351c-4712-9f46-d7680c92fb79 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:39.452881 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b7964-8c2e-45c4-ae0e-f1ee42bdc50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:39.453107 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470f2d4-deb2-4e8c-9075-1411ffd3c173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:39.453825 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470f2d4-deb2-4e8c-9075-1411ffd3c173 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:39.453929 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b7964-8c2e-45c4-ae0e-f1ee42bdc50a admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:39.454282 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470f2d4-deb2-4e8c-9075-1411ffd3c173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:39.454410 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b7964-8c2e-45c4-ae0e-f1ee42bdc50a admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:39.454760 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470f2d4-deb2-4e8c-9075-1411ffd3c173 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:39.454877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b7964-8c2e-45c4-ae0e-f1ee42bdc50a admin admin] PATH_INFO: `/v3/projects/19e772dc3ab6498f96e8d8619faf8324/users/c16ba14a541242b1a0d9f02c991eab18/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:39.455918 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2470f2d4-deb2-4e8c-9075-1411ffd3c173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:39.458034 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b7964-8c2e-45c4-ae0e-f1ee42bdc50a admin admin] RBAC: Authorizing `identity:create_grant(project_id=19e772dc3ab6498f96e8d8619faf8324, user_id=c16ba14a541242b1a0d9f02c991eab18, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:39.458767 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2470f2d4-deb2-4e8c-9075-1411ffd3c173 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:39.463556 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b7964-8c2e-45c4-ae0e-f1ee42bdc50a admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:39.469312 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:39.483872 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 921/1832] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:22:39.489397 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470f2d4-deb2-4e8c-9075-1411ffd3c173 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:39.492109 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 912/1833] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:22:39 2022] PUT /identity/v3/projects/19e772dc3ab6498f96e8d8619faf8324/users/c16ba14a541242b1a0d9f02c991eab18/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:22:39.512986 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67575b7d-15ca-42dd-9c70-2c1f2cbb2693 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:39.513485 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67575b7d-15ca-42dd-9c70-2c1f2cbb2693 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:39.513901 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67575b7d-15ca-42dd-9c70-2c1f2cbb2693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:39.517087 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470f2d4-deb2-4e8c-9075-1411ffd3c173 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:39.631315 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-67575b7d-15ca-42dd-9c70-2c1f2cbb2693 None None] MFA Rules not processed for user `c16ba14a541242b1a0d9f02c991eab18`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:39.635023 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-67575b7d-15ca-42dd-9c70-2c1f2cbb2693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:39.672177 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab98442-a7e0-491f-a318-ddfbe76816a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:39.673483 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab98442-a7e0-491f-a318-ddfbe76816a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:39.673925 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab98442-a7e0-491f-a318-ddfbe76816a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:39.674406 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab98442-a7e0-491f-a318-ddfbe76816a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:39.675701 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab98442-a7e0-491f-a318-ddfbe76816a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:39.678140 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab98442-a7e0-491f-a318-ddfbe76816a4 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:39.698496 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 922/1834] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:22:39.704840 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab98442-a7e0-491f-a318-ddfbe76816a4 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:39.722353 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:39.729731 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab98442-a7e0-491f-a318-ddfbe76816a4 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:39.739328 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed8b69-be1c-4d03-a71b-3ac33f9b8bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:39.740333 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed8b69-be1c-4d03-a71b-3ac33f9b8bea admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:39.740813 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed8b69-be1c-4d03-a71b-3ac33f9b8bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:39.741277 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed8b69-be1c-4d03-a71b-3ac33f9b8bea admin admin] PATH_INFO: `/v3/projects/8bbb8c40f06f4c028c9fb2ece7addecf/users/cdad254d93974ae9bcb60b4b420aec63/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:39.772016 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed8b69-be1c-4d03-a71b-3ac33f9b8bea admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bbb8c40f06f4c028c9fb2ece7addecf, user_id=cdad254d93974ae9bcb60b4b420aec63, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:39.778026 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed8b69-be1c-4d03-a71b-3ac33f9b8bea admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:39.783022 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 913/1835] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:39 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:22:39.803214 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 923/1836] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:22:39 2022] PUT /identity/v3/projects/8bbb8c40f06f4c028c9fb2ece7addecf/users/cdad254d93974ae9bcb60b4b420aec63/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:22:39.828837 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3fa3b5-864e-42c4-913d-28c3bba370c5 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:39.829489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3fa3b5-864e-42c4-913d-28c3bba370c5 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:39.829985 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3fa3b5-864e-42c4-913d-28c3bba370c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:39.835734 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed8b69-be1c-4d03-a71b-3ac33f9b8bea admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:39.841398 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-06ed8b69-be1c-4d03-a71b-3ac33f9b8bea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:40.025243 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-2b3fa3b5-864e-42c4-913d-28c3bba370c5 None None] MFA Rules not processed for user `cdad254d93974ae9bcb60b4b420aec63`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:40.034297 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2b3fa3b5-864e-42c4-913d-28c3bba370c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:40.213622 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed8b69-be1c-4d03-a71b-3ac33f9b8bea admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:40.222515 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ce094-2a0e-44da-8ca8-ba65eb62e677 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:40.223311 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ce094-2a0e-44da-8ca8-ba65eb62e677 service cinder] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:40.223698 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ce094-2a0e-44da-8ca8-ba65eb62e677 service cinder] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:40.225447 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ce094-2a0e-44da-8ca8-ba65eb62e677 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:40.433521 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ce094-2a0e-44da-8ca8-ba65eb62e677 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:40.435365 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ce094-2a0e-44da-8ca8-ba65eb62e677 service cinder] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:40.448717 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 914/1837] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 621 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:22:40.450951 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3fa3b5-864e-42c4-913d-28c3bba370c5 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:40.472347 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 924/1838] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:22:39 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:22:40.626989 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3fa3b5-864e-42c4-913d-28c3bba370c5 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:40.653678 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca28e5-6490-4017-b949-dc94d9325cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:40.656948 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca28e5-6490-4017-b949-dc94d9325cc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:40.657534 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca28e5-6490-4017-b949-dc94d9325cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:40.658087 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca28e5-6490-4017-b949-dc94d9325cc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:40.659448 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ca28e5-6490-4017-b949-dc94d9325cc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:40.666938 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ca28e5-6490-4017-b949-dc94d9325cc9 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:40.783735 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 915/1839] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:22:40 2022] POST /identity/v3/projects => generated 379 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:22:40.788039 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ce094-2a0e-44da-8ca8-ba65eb62e677 service cinder] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:40.793323 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca28e5-6490-4017-b949-dc94d9325cc9 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:40.803938 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ce094-2a0e-44da-8ca8-ba65eb62e677 service cinder] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:40.856109 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:40.989519 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b6ddd-d942-4967-80e1-2bc1002170de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:40.992502 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b6ddd-d942-4967-80e1-2bc1002170de admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:40.992901 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b6ddd-d942-4967-80e1-2bc1002170de admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:40.993135 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b6ddd-d942-4967-80e1-2bc1002170de admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:40.997248 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b6ddd-d942-4967-80e1-2bc1002170de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:41.003736 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b6ddd-d942-4967-80e1-2bc1002170de admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:41.070722 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:41.088110 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca28e5-6490-4017-b949-dc94d9325cc9 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:41.100757 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 925/1840] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:22:40 2022] POST /identity/v3/users => generated 296 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:22:41.102924 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b6ddd-d942-4967-80e1-2bc1002170de admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:41.106464 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad13118-d7fc-4cff-83d6-c2a42c632a0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:41.106464 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad13118-d7fc-4cff-83d6-c2a42c632a0f service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:41.106464 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad13118-d7fc-4cff-83d6-c2a42c632a0f service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:41.106464 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad13118-d7fc-4cff-83d6-c2a42c632a0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:41.120990 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2ad13118-d7fc-4cff-83d6-c2a42c632a0f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:41.137582 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b6ddd-d942-4967-80e1-2bc1002170de admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:41.152370 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cfa6f8-56ce-4923-971e-5e2f645b8427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:41.153042 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfa6f8-56ce-4923-971e-5e2f645b8427 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:41.154791 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfa6f8-56ce-4923-971e-5e2f645b8427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:41.155000 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfa6f8-56ce-4923-971e-5e2f645b8427 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:41.156061 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cfa6f8-56ce-4923-971e-5e2f645b8427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:41.166662 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cfa6f8-56ce-4923-971e-5e2f645b8427 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:41.193644 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 926/1841] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:22:41.205371 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cfa6f8-56ce-4923-971e-5e2f645b8427 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:41.232344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cfa6f8-56ce-4923-971e-5e2f645b8427 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:41.246869 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043310dd-8442-4bc0-8644-299f98d57af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:41.247688 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043310dd-8442-4bc0-8644-299f98d57af6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:41.247968 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043310dd-8442-4bc0-8644-299f98d57af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:41.248304 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043310dd-8442-4bc0-8644-299f98d57af6 admin admin] PATH_INFO: `/v3/projects/f4e3ed31621944a29b57eaf7f9a43953/users/1a91a8568bc2444c9ad95c5d70b84fff/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:41.307105 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043310dd-8442-4bc0-8644-299f98d57af6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4e3ed31621944a29b57eaf7f9a43953, user_id=1a91a8568bc2444c9ad95c5d70b84fff, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:41.309116 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043310dd-8442-4bc0-8644-299f98d57af6 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:41.359627 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 927/1842] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:22:41 2022] PUT /identity/v3/projects/f4e3ed31621944a29b57eaf7f9a43953/users/1a91a8568bc2444c9ad95c5d70b84fff/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:22:41.367547 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043310dd-8442-4bc0-8644-299f98d57af6 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:41.383052 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad13118-d7fc-4cff-83d6-c2a42c632a0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:41.388385 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad13118-d7fc-4cff-83d6-c2a42c632a0f service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:41.436708 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 916/1843] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:22:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 648 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:22:41.640236 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043310dd-8442-4bc0-8644-299f98d57af6 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:41.654695 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a64c5d6-1a30-420b-98e5-88497a233087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:41.667776 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64c5d6-1a30-420b-98e5-88497a233087 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:41.672811 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64c5d6-1a30-420b-98e5-88497a233087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:41.677023 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64c5d6-1a30-420b-98e5-88497a233087 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:41.678706 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a64c5d6-1a30-420b-98e5-88497a233087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:41.686163 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a64c5d6-1a30-420b-98e5-88497a233087 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:41.741044 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 928/1844] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:22:41.747154 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad13118-d7fc-4cff-83d6-c2a42c632a0f service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:41.798182 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad13118-d7fc-4cff-83d6-c2a42c632a0f service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:41.822456 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41611be-69dc-4140-9754-df9044078b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:41.826052 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41611be-69dc-4140-9754-df9044078b6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:41.828974 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41611be-69dc-4140-9754-df9044078b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:41.829808 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41611be-69dc-4140-9754-df9044078b6c admin admin] PATH_INFO: `/v3/projects/f4e3ed31621944a29b57eaf7f9a43953/users/1a91a8568bc2444c9ad95c5d70b84fff/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:41.840602 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41611be-69dc-4140-9754-df9044078b6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4e3ed31621944a29b57eaf7f9a43953, user_id=1a91a8568bc2444c9ad95c5d70b84fff, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:41.855112 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41611be-69dc-4140-9754-df9044078b6c admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:41.908741 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 917/1845] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:22:41 2022] PUT /identity/v3/projects/f4e3ed31621944a29b57eaf7f9a43953/users/1a91a8568bc2444c9ad95c5d70b84fff/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:22:41.914299 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2cdc39-5c33-40ad-ad14-f91bf5cd6cd6 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:41.915433 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2cdc39-5c33-40ad-ad14-f91bf5cd6cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:41.916055 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2cdc39-5c33-40ad-ad14-f91bf5cd6cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:41.997764 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-ee2cdc39-5c33-40ad-ad14-f91bf5cd6cd6 None None] MFA Rules not processed for user `1a91a8568bc2444c9ad95c5d70b84fff`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:42.001805 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-ee2cdc39-5c33-40ad-ad14-f91bf5cd6cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:42.169906 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:42.198486 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 929/1846] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:41 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:22:42.229754 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41611be-69dc-4140-9754-df9044078b6c admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:42.233218 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b41611be-69dc-4140-9754-df9044078b6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:42.412988 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41611be-69dc-4140-9754-df9044078b6c admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:42.419104 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e6cfd-f87f-47e4-ae14-daa7282ddf68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:42.420133 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e6cfd-f87f-47e4-ae14-daa7282ddf68 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:42.420580 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e6cfd-f87f-47e4-ae14-daa7282ddf68 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:42.421040 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e6cfd-f87f-47e4-ae14-daa7282ddf68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:42.565675 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e6cfd-f87f-47e4-ae14-daa7282ddf68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:42.567576 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e6cfd-f87f-47e4-ae14-daa7282ddf68 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:42.614891 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 918/1847] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:22:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:22:42.923428 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2cdc39-5c33-40ad-ad14-f91bf5cd6cd6 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:42.928021 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-ee2cdc39-5c33-40ad-ad14-f91bf5cd6cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:43.264429 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2cdc39-5c33-40ad-ad14-f91bf5cd6cd6 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:43.289721 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db4e03-4cf9-479f-b6a2-465628f63f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:43.290423 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db4e03-4cf9-479f-b6a2-465628f63f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:43.291237 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db4e03-4cf9-479f-b6a2-465628f63f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:43.291519 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db4e03-4cf9-479f-b6a2-465628f63f3a admin admin] PATH_INFO: `/v3/users/8ff00733993a4dd2b23fcf71b35b5077` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:43.292851 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db4e03-4cf9-479f-b6a2-465628f63f3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ff00733993a4dd2b23fcf71b35b5077)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:43.294902 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db4e03-4cf9-479f-b6a2-465628f63f3a admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:43.420599 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-45db4e03-4cf9-479f-b6a2-465628f63f3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ff00733993a4dd2b23fcf71b35b5077'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:43.442858 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-45db4e03-4cf9-479f-b6a2-465628f63f3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ff00733993a4dd2b23fcf71b35b5077'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:43.468384 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-45db4e03-4cf9-479f-b6a2-465628f63f3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ff00733993a4dd2b23fcf71b35b5077'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:43.469561 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-45db4e03-4cf9-479f-b6a2-465628f63f3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ff00733993a4dd2b23fcf71b35b5077'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:43.504287 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-45db4e03-4cf9-479f-b6a2-465628f63f3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ff00733993a4dd2b23fcf71b35b5077'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:43.527139 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 930/1848] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:22:42 2022] DELETE /identity/v3/users/8ff00733993a4dd2b23fcf71b35b5077 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:22:43.532248 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b0242-d3f5-4577-a40d-f33bf1131510 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:43.532973 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b0242-d3f5-4577-a40d-f33bf1131510 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:43.532973 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b0242-d3f5-4577-a40d-f33bf1131510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:43.611116 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-f89b0242-d3f5-4577-a40d-f33bf1131510 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:43.616151 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f89b0242-d3f5-4577-a40d-f33bf1131510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:43.744582 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:43.777934 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 919/1849] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:22:43.793045 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db4e03-4cf9-479f-b6a2-465628f63f3a admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:43.795138 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-45db4e03-4cf9-479f-b6a2-465628f63f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:43.957319 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db4e03-4cf9-479f-b6a2-465628f63f3a admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:43.964076 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0cca0-2150-4f1d-b327-6373b0a60175 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:43.965361 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0cca0-2150-4f1d-b327-6373b0a60175 service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:43.966115 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0cca0-2150-4f1d-b327-6373b0a60175 service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:43.967003 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0cca0-2150-4f1d-b327-6373b0a60175 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:43.984963 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0cca0-2150-4f1d-b327-6373b0a60175 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:43.986578 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0cca0-2150-4f1d-b327-6373b0a60175 service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:44.000424 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 931/1850] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:22:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:22:44.448122 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b0242-d3f5-4577-a40d-f33bf1131510 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:44.451370 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f89b0242-d3f5-4577-a40d-f33bf1131510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:44.493173 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0cca0-2150-4f1d-b327-6373b0a60175 service neutron] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:44.495052 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-0ec0cca0-2150-4f1d-b327-6373b0a60175 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:44.519527 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0cca0-2150-4f1d-b327-6373b0a60175 service neutron] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:44.566940 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79afadc7-ffd3-4810-a7aa-3acd4f687281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:44.569018 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afadc7-ffd3-4810-a7aa-3acd4f687281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:44.569296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afadc7-ffd3-4810-a7aa-3acd4f687281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:44.569733 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afadc7-ffd3-4810-a7aa-3acd4f687281 admin admin] PATH_INFO: `/v3/projects/e9926a1ab87b453f9f25ae2e5a129ffd` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:44.571670 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79afadc7-ffd3-4810-a7aa-3acd4f687281 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9926a1ab87b453f9f25ae2e5a129ffd)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:44.575882 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79afadc7-ffd3-4810-a7aa-3acd4f687281 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:44.631793 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:44.636204 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b0242-d3f5-4577-a40d-f33bf1131510 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:44.645501 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f96b3b-aba0-47d6-a27c-c9d657ea6ee8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:44.646497 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f96b3b-aba0-47d6-a27c-c9d657ea6ee8 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:44.646963 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f96b3b-aba0-47d6-a27c-c9d657ea6ee8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:44.647408 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f96b3b-aba0-47d6-a27c-c9d657ea6ee8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:44.649770 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-49f96b3b-aba0-47d6-a27c-c9d657ea6ee8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:44.715419 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-79afadc7-ffd3-4810-a7aa-3acd4f687281 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9926a1ab87b453f9f25ae2e5a129ffd', 'request_id': 'req-79afadc7-ffd3-4810-a7aa-3acd4f687281'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:44.731875 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-79afadc7-ffd3-4810-a7aa-3acd4f687281 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9926a1ab87b453f9f25ae2e5a129ffd', 'request_id': 'req-79afadc7-ffd3-4810-a7aa-3acd4f687281'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:44.746541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-79afadc7-ffd3-4810-a7aa-3acd4f687281 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9926a1ab87b453f9f25ae2e5a129ffd', 'request_id': 'req-79afadc7-ffd3-4810-a7aa-3acd4f687281'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:44.773159 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-79afadc7-ffd3-4810-a7aa-3acd4f687281 admin admin] The token cache is being invalidate because project e9926a1ab87b453f9f25ae2e5a129ffd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:22:44.773159 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-79afadc7-ffd3-4810-a7aa-3acd4f687281 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:44.774149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-79afadc7-ffd3-4810-a7aa-3acd4f687281 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:44.777749 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 932/1851] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:22:44 2022] DELETE /identity/v3/projects/e9926a1ab87b453f9f25ae2e5a129ffd => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:22:44.782690 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79afadc7-ffd3-4810-a7aa-3acd4f687281 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:44.785903 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-79afadc7-ffd3-4810-a7aa-3acd4f687281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:44.872084 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f96b3b-aba0-47d6-a27c-c9d657ea6ee8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:44.873677 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f96b3b-aba0-47d6-a27c-c9d657ea6ee8 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:44.901228 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 920/1852] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:22:44 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:22:44.980808 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79afadc7-ffd3-4810-a7aa-3acd4f687281 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:44.992827 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c757b-1ec1-4ee6-bbb8-5fb728a49bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:44.993802 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c757b-1ec1-4ee6-bbb8-5fb728a49bde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:44.994279 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c757b-1ec1-4ee6-bbb8-5fb728a49bde admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:44.994767 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c757b-1ec1-4ee6-bbb8-5fb728a49bde admin admin] PATH_INFO: `/v3/users/9525da7c6ddd40ec9bce3bc727f713f1` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:44.996842 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c757b-1ec1-4ee6-bbb8-5fb728a49bde admin admin] RBAC: Authorizing `identity:delete_user(user_id=9525da7c6ddd40ec9bce3bc727f713f1)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:45.000292 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c757b-1ec1-4ee6-bbb8-5fb728a49bde admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:45.015223 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f96b3b-aba0-47d6-a27c-c9d657ea6ee8 service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:45.017709 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-49f96b3b-aba0-47d6-a27c-c9d657ea6ee8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:45.045892 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f96b3b-aba0-47d6-a27c-c9d657ea6ee8 service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:45.054916 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c07de5-57c8-410d-9a45-5d992a8e0ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:45.056137 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c07de5-57c8-410d-9a45-5d992a8e0ae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:45.056644 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c07de5-57c8-410d-9a45-5d992a8e0ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:45.057067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c07de5-57c8-410d-9a45-5d992a8e0ae9 admin admin] PATH_INFO: `/v3/users/154c577a85364893ac4c864e5adbab2d` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:45.059269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c07de5-57c8-410d-9a45-5d992a8e0ae9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=154c577a85364893ac4c864e5adbab2d)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:45.064152 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c07de5-57c8-410d-9a45-5d992a8e0ae9 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:45.126428 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-bc1c757b-1ec1-4ee6-bbb8-5fb728a49bde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9525da7c6ddd40ec9bce3bc727f713f1'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:45.202732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-bc1c757b-1ec1-4ee6-bbb8-5fb728a49bde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9525da7c6ddd40ec9bce3bc727f713f1'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:45.236317 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-b4c07de5-57c8-410d-9a45-5d992a8e0ae9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '154c577a85364893ac4c864e5adbab2d'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:45.251867 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-b4c07de5-57c8-410d-9a45-5d992a8e0ae9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '154c577a85364893ac4c864e5adbab2d'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:45.259381 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-bc1c757b-1ec1-4ee6-bbb8-5fb728a49bde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9525da7c6ddd40ec9bce3bc727f713f1'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:45.276094 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-bc1c757b-1ec1-4ee6-bbb8-5fb728a49bde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9525da7c6ddd40ec9bce3bc727f713f1'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:45.291752 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-b4c07de5-57c8-410d-9a45-5d992a8e0ae9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '154c577a85364893ac4c864e5adbab2d'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:45.293086 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-b4c07de5-57c8-410d-9a45-5d992a8e0ae9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '154c577a85364893ac4c864e5adbab2d'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:45.313738 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-b4c07de5-57c8-410d-9a45-5d992a8e0ae9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '154c577a85364893ac4c864e5adbab2d'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:45.323762 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 921/1853] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:22:45 2022] DELETE /identity/v3/users/154c577a85364893ac4c864e5adbab2d => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:22:45.328616 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60936a74-e27f-4fd1-ba02-7b9b102529a7 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:45.330636 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60936a74-e27f-4fd1-ba02-7b9b102529a7 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:45.331247 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60936a74-e27f-4fd1-ba02-7b9b102529a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:45.332178 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-bc1c757b-1ec1-4ee6-bbb8-5fb728a49bde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9525da7c6ddd40ec9bce3bc727f713f1'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:45.360694 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:45.367845 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 933/1854] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:22:44 2022] DELETE /identity/v3/users/9525da7c6ddd40ec9bce3bc727f713f1 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:22:45.373870 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-60936a74-e27f-4fd1-ba02-7b9b102529a7 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:45.377823 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-60936a74-e27f-4fd1-ba02-7b9b102529a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:45.492563 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 922/1855] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:22:45.519026 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c757b-1ec1-4ee6-bbb8-5fb728a49bde admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:45.521839 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-bc1c757b-1ec1-4ee6-bbb8-5fb728a49bde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:45.582346 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:45.678087 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c757b-1ec1-4ee6-bbb8-5fb728a49bde admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:45.692175 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41430653-6fb5-41f1-b00a-bd5e84ed619c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:45.693250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41430653-6fb5-41f1-b00a-bd5e84ed619c service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:45.693734 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41430653-6fb5-41f1-b00a-bd5e84ed619c service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:45.694267 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41430653-6fb5-41f1-b00a-bd5e84ed619c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:45.716944 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41430653-6fb5-41f1-b00a-bd5e84ed619c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:45.721273 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41430653-6fb5-41f1-b00a-bd5e84ed619c service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:45.743342 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 934/1856] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:22:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:22:46.067581 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60936a74-e27f-4fd1-ba02-7b9b102529a7 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:46.070227 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-60936a74-e27f-4fd1-ba02-7b9b102529a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:46.120092 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60936a74-e27f-4fd1-ba02-7b9b102529a7 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:46.136384 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7578c96-5a6f-4b7d-add1-6311dd1a20e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:46.139810 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7578c96-5a6f-4b7d-add1-6311dd1a20e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:46.140912 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7578c96-5a6f-4b7d-add1-6311dd1a20e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:46.144341 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7578c96-5a6f-4b7d-add1-6311dd1a20e2 admin admin] PATH_INFO: `/v3/projects/858a3d61aa9942e09afefc1543503ecf` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:46.148602 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7578c96-5a6f-4b7d-add1-6311dd1a20e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=858a3d61aa9942e09afefc1543503ecf)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:46.155923 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7578c96-5a6f-4b7d-add1-6311dd1a20e2 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:46.266858 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f7578c96-5a6f-4b7d-add1-6311dd1a20e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '858a3d61aa9942e09afefc1543503ecf', 'request_id': 'req-f7578c96-5a6f-4b7d-add1-6311dd1a20e2'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:46.282984 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f7578c96-5a6f-4b7d-add1-6311dd1a20e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '858a3d61aa9942e09afefc1543503ecf', 'request_id': 'req-f7578c96-5a6f-4b7d-add1-6311dd1a20e2'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:46.311176 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f7578c96-5a6f-4b7d-add1-6311dd1a20e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '858a3d61aa9942e09afefc1543503ecf', 'request_id': 'req-f7578c96-5a6f-4b7d-add1-6311dd1a20e2'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:46.336666 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f7578c96-5a6f-4b7d-add1-6311dd1a20e2 admin admin] The token cache is being invalidate because project 858a3d61aa9942e09afefc1543503ecf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:22:46.336666 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f7578c96-5a6f-4b7d-add1-6311dd1a20e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:46.337470 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f7578c96-5a6f-4b7d-add1-6311dd1a20e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:46.345341 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448ecf5-742b-4cd6-b575-0a5008e8a740 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:46.345928 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448ecf5-742b-4cd6-b575-0a5008e8a740 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:46.345928 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448ecf5-742b-4cd6-b575-0a5008e8a740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:46.348842 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 923/1857] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:22:46 2022] DELETE /identity/v3/projects/858a3d61aa9942e09afefc1543503ecf => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:22:46.394333 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-c448ecf5-742b-4cd6-b575-0a5008e8a740 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:46.406216 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-c448ecf5-742b-4cd6-b575-0a5008e8a740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:46.575897 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 935/1858] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:22:46.583866 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a7bff-9568-4542-85a5-e47c79b576eb None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:46.584173 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a7bff-9568-4542-85a5-e47c79b576eb None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:46.584425 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a7bff-9568-4542-85a5-e47c79b576eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:46.629840 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-d06a7bff-9568-4542-85a5-e47c79b576eb None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:46.632067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d06a7bff-9568-4542-85a5-e47c79b576eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:46.651013 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448ecf5-742b-4cd6-b575-0a5008e8a740 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:46.651262 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 924/1859] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:22:46.669585 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448ecf5-742b-4cd6-b575-0a5008e8a740 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:46.678879 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f8a07-6370-49b8-a3e9-3477cff26d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:46.679518 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f8a07-6370-49b8-a3e9-3477cff26d8b admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:46.679804 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f8a07-6370-49b8-a3e9-3477cff26d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:46.680074 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f8a07-6370-49b8-a3e9-3477cff26d8b admin admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:46.680739 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09f8a07-6370-49b8-a3e9-3477cff26d8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:22:46.681073 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09f8a07-6370-49b8-a3e9-3477cff26d8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:46.682792 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09f8a07-6370-49b8-a3e9-3477cff26d8b admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:46.722722 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 936/1860] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:22:46.734547 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a7bff-9568-4542-85a5-e47c79b576eb None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:46.784616 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a7bff-9568-4542-85a5-e47c79b576eb None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:46.800366 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89a028-a5ef-424c-8473-f7cf96800baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:46.801571 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89a028-a5ef-424c-8473-f7cf96800baa admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:46.806865 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89a028-a5ef-424c-8473-f7cf96800baa admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:46.811706 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89a028-a5ef-424c-8473-f7cf96800baa admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:46.819954 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89a028-a5ef-424c-8473-f7cf96800baa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:46.823760 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89a028-a5ef-424c-8473-f7cf96800baa admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:46.879877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 925/1861] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:22:46 2022] POST /identity/v3/projects => generated 387 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:22:46.880207 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f8a07-6370-49b8-a3e9-3477cff26d8b admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:46.925388 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f8a07-6370-49b8-a3e9-3477cff26d8b admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:47.212440 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43f6ea-b175-4f85-9e7d-7ed467f4b5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:47.214216 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43f6ea-b175-4f85-9e7d-7ed467f4b5b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:47.214810 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43f6ea-b175-4f85-9e7d-7ed467f4b5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:47.215434 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43f6ea-b175-4f85-9e7d-7ed467f4b5b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:47.216636 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da43f6ea-b175-4f85-9e7d-7ed467f4b5b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:47.221325 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da43f6ea-b175-4f85-9e7d-7ed467f4b5b6 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:47.282867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 937/1862] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:22:46 2022] POST /identity/v3/users => generated 294 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:22:47.289553 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89a028-a5ef-424c-8473-f7cf96800baa admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:47.335385 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89a028-a5ef-424c-8473-f7cf96800baa admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:47.357752 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4dad99-8146-457b-8b2f-385f16171298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:47.359139 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4dad99-8146-457b-8b2f-385f16171298 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:47.359139 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4dad99-8146-457b-8b2f-385f16171298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:47.367268 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4dad99-8146-457b-8b2f-385f16171298 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:47.373238 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4dad99-8146-457b-8b2f-385f16171298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:47.377771 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4dad99-8146-457b-8b2f-385f16171298 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:47.413080 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 926/1863] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:22:47.419792 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43f6ea-b175-4f85-9e7d-7ed467f4b5b6 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:47.452955 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43f6ea-b175-4f85-9e7d-7ed467f4b5b6 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:47.465982 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c36abf-8770-4d95-8ef9-d09ad7d1a511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:47.468611 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c36abf-8770-4d95-8ef9-d09ad7d1a511 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:47.470567 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c36abf-8770-4d95-8ef9-d09ad7d1a511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:47.471499 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c36abf-8770-4d95-8ef9-d09ad7d1a511 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:47.475871 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c36abf-8770-4d95-8ef9-d09ad7d1a511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:47.481652 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c36abf-8770-4d95-8ef9-d09ad7d1a511 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:47.510631 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 938/1864] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:22:47.516545 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4dad99-8146-457b-8b2f-385f16171298 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:47.534023 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4dad99-8146-457b-8b2f-385f16171298 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:47.545243 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de6c6a-6004-4347-826b-e3e36214a003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:47.547377 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de6c6a-6004-4347-826b-e3e36214a003 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:47.547946 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de6c6a-6004-4347-826b-e3e36214a003 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:47.548411 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de6c6a-6004-4347-826b-e3e36214a003 admin admin] PATH_INFO: `/v3/projects/ba2fbaa883b548b8b72f22d174371189/users/6705c41c99f544fabbd6a084b95d6e95/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:47.592198 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86de6c6a-6004-4347-826b-e3e36214a003 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba2fbaa883b548b8b72f22d174371189, user_id=6705c41c99f544fabbd6a084b95d6e95, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:47.598064 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86de6c6a-6004-4347-826b-e3e36214a003 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:47.646230 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c36abf-8770-4d95-8ef9-d09ad7d1a511 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:47.665050 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-20c36abf-8770-4d95-8ef9-d09ad7d1a511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:47.666885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 927/1865] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:22:47 2022] PUT /identity/v3/projects/ba2fbaa883b548b8b72f22d174371189/users/6705c41c99f544fabbd6a084b95d6e95/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:22:47.675287 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a40d13-3bb7-46fa-894f-2a3339ed456d None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:47.675784 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a40d13-3bb7-46fa-894f-2a3339ed456d None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:47.676279 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a40d13-3bb7-46fa-894f-2a3339ed456d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:47.701875 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c36abf-8770-4d95-8ef9-d09ad7d1a511 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:47.729691 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-77a40d13-3bb7-46fa-894f-2a3339ed456d None None] MFA Rules not processed for user `6705c41c99f544fabbd6a084b95d6e95`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:47.732963 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-77a40d13-3bb7-46fa-894f-2a3339ed456d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:47.767552 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:47.821119 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:47.914920 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 928/1866] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:22:47.917325 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a40d13-3bb7-46fa-894f-2a3339ed456d None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:47.926958 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad448dca-d050-466a-9f63-ad07e5a9d782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:47.927774 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad448dca-d050-466a-9f63-ad07e5a9d782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:47.930510 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad448dca-d050-466a-9f63-ad07e5a9d782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:47.930676 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad448dca-d050-466a-9f63-ad07e5a9d782 admin admin] PATH_INFO: `/v3/projects/83c798bce4cd4e4fad0930687d0cc5de` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:47.937134 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad448dca-d050-466a-9f63-ad07e5a9d782 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83c798bce4cd4e4fad0930687d0cc5de)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:47.939533 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad448dca-d050-466a-9f63-ad07e5a9d782 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:47.940209 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a40d13-3bb7-46fa-894f-2a3339ed456d None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:47.960762 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dafb710-1982-428e-9579-4d03e1992d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:47.961339 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dafb710-1982-428e-9579-4d03e1992d84 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:47.962062 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dafb710-1982-428e-9579-4d03e1992d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:47.964497 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dafb710-1982-428e-9579-4d03e1992d84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:47.964876 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dafb710-1982-428e-9579-4d03e1992d84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:47.970197 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dafb710-1982-428e-9579-4d03e1992d84 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:48.116112 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 929/1867] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:22:47 2022] POST /identity/v3/projects => generated 387 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:22:48.123126 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dafb710-1982-428e-9579-4d03e1992d84 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:48.144031 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-ad448dca-d050-466a-9f63-ad07e5a9d782 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83c798bce4cd4e4fad0930687d0cc5de', 'request_id': 'req-ad448dca-d050-466a-9f63-ad07e5a9d782'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:48.159717 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-ad448dca-d050-466a-9f63-ad07e5a9d782 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83c798bce4cd4e4fad0930687d0cc5de', 'request_id': 'req-ad448dca-d050-466a-9f63-ad07e5a9d782'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:48.181408 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-ad448dca-d050-466a-9f63-ad07e5a9d782 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83c798bce4cd4e4fad0930687d0cc5de', 'request_id': 'req-ad448dca-d050-466a-9f63-ad07e5a9d782'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:48.218032 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-ad448dca-d050-466a-9f63-ad07e5a9d782 admin admin] The token cache is being invalidate because project 83c798bce4cd4e4fad0930687d0cc5de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:22:48.219059 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-ad448dca-d050-466a-9f63-ad07e5a9d782 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:48.221119 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-ad448dca-d050-466a-9f63-ad07e5a9d782 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:48.227628 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 939/1868] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:22:47 2022] DELETE /identity/v3/projects/83c798bce4cd4e4fad0930687d0cc5de => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:22:48.234219 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad448dca-d050-466a-9f63-ad07e5a9d782 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:48.241245 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-ad448dca-d050-466a-9f63-ad07e5a9d782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:48.253976 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dafb710-1982-428e-9579-4d03e1992d84 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:48.261180 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ce6ee-99de-4831-ab57-3fdb7234a757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:48.261964 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ce6ee-99de-4831-ab57-3fdb7234a757 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:48.262747 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ce6ee-99de-4831-ab57-3fdb7234a757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:48.263156 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ce6ee-99de-4831-ab57-3fdb7234a757 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:48.263982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ce6ee-99de-4831-ab57-3fdb7234a757 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:48.266231 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ce6ee-99de-4831-ab57-3fdb7234a757 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:48.305737 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 930/1869] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:22:48 2022] POST /identity/v3/users => generated 294 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:22:48.312064 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ce6ee-99de-4831-ab57-3fdb7234a757 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:48.314240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-1f6ce6ee-99de-4831-ab57-3fdb7234a757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:48.346842 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ce6ee-99de-4831-ab57-3fdb7234a757 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:48.355954 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c330ca8b-6c9f-4948-b2a0-9e95eb2d7ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:48.363367 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330ca8b-6c9f-4948-b2a0-9e95eb2d7ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:48.363838 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330ca8b-6c9f-4948-b2a0-9e95eb2d7ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:48.364296 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330ca8b-6c9f-4948-b2a0-9e95eb2d7ff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:48.365657 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c330ca8b-6c9f-4948-b2a0-9e95eb2d7ff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:48.369353 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c330ca8b-6c9f-4948-b2a0-9e95eb2d7ff4 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:48.388933 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 931/1870] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:22:48.395967 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c330ca8b-6c9f-4948-b2a0-9e95eb2d7ff4 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:48.413423 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c330ca8b-6c9f-4948-b2a0-9e95eb2d7ff4 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:48.423165 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0502ba17-9f0f-4aff-8a03-f709a858317c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:48.424102 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502ba17-9f0f-4aff-8a03-f709a858317c admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:48.424388 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502ba17-9f0f-4aff-8a03-f709a858317c admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:48.424700 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502ba17-9f0f-4aff-8a03-f709a858317c admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:48.425405 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0502ba17-9f0f-4aff-8a03-f709a858317c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:48.427275 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0502ba17-9f0f-4aff-8a03-f709a858317c admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:48.441375 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 932/1871] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:22:48.448371 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0502ba17-9f0f-4aff-8a03-f709a858317c admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:48.453959 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad448dca-d050-466a-9f63-ad07e5a9d782 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:48.461555 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab095e47-8dbd-4e37-96b0-14d7070db8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:48.462557 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab095e47-8dbd-4e37-96b0-14d7070db8b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:48.463116 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab095e47-8dbd-4e37-96b0-14d7070db8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:48.468116 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0502ba17-9f0f-4aff-8a03-f709a858317c admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:48.471803 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab095e47-8dbd-4e37-96b0-14d7070db8b3 admin admin] PATH_INFO: `/v3/users/c16ba14a541242b1a0d9f02c991eab18` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:48.473366 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab095e47-8dbd-4e37-96b0-14d7070db8b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c16ba14a541242b1a0d9f02c991eab18)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:48.478685 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8c0ff-82b5-4b89-9993-bbc7ad94b3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:48.479680 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab095e47-8dbd-4e37-96b0-14d7070db8b3 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:48.480648 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8c0ff-82b5-4b89-9993-bbc7ad94b3b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:48.481819 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8c0ff-82b5-4b89-9993-bbc7ad94b3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:48.483167 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8c0ff-82b5-4b89-9993-bbc7ad94b3b4 admin admin] PATH_INFO: `/v3/projects/38c62c447e784146af56dc7fc431a5ce/users/204465b76ede41a7a3825a634ebe4aa3/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:48.524012 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe8c0ff-82b5-4b89-9993-bbc7ad94b3b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38c62c447e784146af56dc7fc431a5ce, user_id=204465b76ede41a7a3825a634ebe4aa3, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:48.529995 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe8c0ff-82b5-4b89-9993-bbc7ad94b3b4 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:48.567409 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 933/1872] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:22:48 2022] PUT /identity/v3/projects/38c62c447e784146af56dc7fc431a5ce/users/204465b76ede41a7a3825a634ebe4aa3/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:22:48.581513 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21885b2c-066f-4dfa-ab87-67519a4cb424 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:48.582204 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21885b2c-066f-4dfa-ab87-67519a4cb424 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:48.583473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21885b2c-066f-4dfa-ab87-67519a4cb424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:48.604675 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-ab095e47-8dbd-4e37-96b0-14d7070db8b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c16ba14a541242b1a0d9f02c991eab18'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:48.640257 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:48.643928 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-ab095e47-8dbd-4e37-96b0-14d7070db8b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c16ba14a541242b1a0d9f02c991eab18'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:48.657414 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-21885b2c-066f-4dfa-ab87-67519a4cb424 None None] MFA Rules not processed for user `204465b76ede41a7a3825a634ebe4aa3`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:48.661610 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-21885b2c-066f-4dfa-ab87-67519a4cb424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:48.685060 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-ab095e47-8dbd-4e37-96b0-14d7070db8b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c16ba14a541242b1a0d9f02c991eab18'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:48.685377 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-ab095e47-8dbd-4e37-96b0-14d7070db8b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c16ba14a541242b1a0d9f02c991eab18'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:48.712439 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-ab095e47-8dbd-4e37-96b0-14d7070db8b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c16ba14a541242b1a0d9f02c991eab18'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:48.742118 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:48.748358 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 940/1873] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:22:48 2022] DELETE /identity/v3/users/c16ba14a541242b1a0d9f02c991eab18 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:22:48.841235 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 934/1874] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:22:48.848024 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab095e47-8dbd-4e37-96b0-14d7070db8b3 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:48.850457 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-ab095e47-8dbd-4e37-96b0-14d7070db8b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:48.969051 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab095e47-8dbd-4e37-96b0-14d7070db8b3 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:48.976678 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd114da-b0cb-4b52-bb3c-d2b2a2c2ff21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:48.978959 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd114da-b0cb-4b52-bb3c-d2b2a2c2ff21 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:48.980025 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd114da-b0cb-4b52-bb3c-d2b2a2c2ff21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:48.980025 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd114da-b0cb-4b52-bb3c-d2b2a2c2ff21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:48.981267 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd114da-b0cb-4b52-bb3c-d2b2a2c2ff21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:48.986260 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd114da-b0cb-4b52-bb3c-d2b2a2c2ff21 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:49.039285 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 941/1875] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:22:48 2022] POST /identity/v3/projects => generated 385 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:22:49.046154 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21885b2c-066f-4dfa-ab87-67519a4cb424 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:49.186062 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21885b2c-066f-4dfa-ab87-67519a4cb424 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:49.260685 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd114da-b0cb-4b52-bb3c-d2b2a2c2ff21 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:49.263796 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-2dd114da-b0cb-4b52-bb3c-d2b2a2c2ff21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:49.300003 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87f16c-c34f-4397-a8ab-d73e2e308197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:49.300644 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87f16c-c34f-4397-a8ab-d73e2e308197 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:49.300928 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87f16c-c34f-4397-a8ab-d73e2e308197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:49.301511 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87f16c-c34f-4397-a8ab-d73e2e308197 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:49.302186 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac87f16c-c34f-4397-a8ab-d73e2e308197 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:49.304491 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac87f16c-c34f-4397-a8ab-d73e2e308197 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:49.341570 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 935/1876] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:22:49 2022] POST /identity/v3/users => generated 299 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:22:49.346879 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87f16c-c34f-4397-a8ab-d73e2e308197 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:49.371397 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87f16c-c34f-4397-a8ab-d73e2e308197 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:49.381545 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253126b9-caf0-4d0a-b6da-e7d1747ae1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:49.382916 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253126b9-caf0-4d0a-b6da-e7d1747ae1c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:49.383429 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253126b9-caf0-4d0a-b6da-e7d1747ae1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:49.383945 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253126b9-caf0-4d0a-b6da-e7d1747ae1c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:49.386010 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253126b9-caf0-4d0a-b6da-e7d1747ae1c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:49.389337 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253126b9-caf0-4d0a-b6da-e7d1747ae1c4 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:49.414156 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 936/1877] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:22:49.414619 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd114da-b0cb-4b52-bb3c-d2b2a2c2ff21 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:49.416757 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253126b9-caf0-4d0a-b6da-e7d1747ae1c4 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:49.421247 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59600430-ebb6-4a43-bad1-4a840026e033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:49.422119 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59600430-ebb6-4a43-bad1-4a840026e033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:49.422560 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59600430-ebb6-4a43-bad1-4a840026e033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:49.422946 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59600430-ebb6-4a43-bad1-4a840026e033 admin admin] PATH_INFO: `/v3/projects/19e772dc3ab6498f96e8d8619faf8324` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:49.424586 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59600430-ebb6-4a43-bad1-4a840026e033 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19e772dc3ab6498f96e8d8619faf8324)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:49.427437 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59600430-ebb6-4a43-bad1-4a840026e033 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:49.438991 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253126b9-caf0-4d0a-b6da-e7d1747ae1c4 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:49.453673 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90507684-9fa9-47c1-9a3d-0acd8f8e0370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:49.455452 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90507684-9fa9-47c1-9a3d-0acd8f8e0370 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:49.456150 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90507684-9fa9-47c1-9a3d-0acd8f8e0370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:49.456838 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90507684-9fa9-47c1-9a3d-0acd8f8e0370 admin admin] PATH_INFO: `/v3/projects/b1b2a1fd9bf04bd29e4bed991320349e/users/84901fbcf9a1488ea35b170eedd1cd72/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:49.516680 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90507684-9fa9-47c1-9a3d-0acd8f8e0370 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1b2a1fd9bf04bd29e4bed991320349e, user_id=84901fbcf9a1488ea35b170eedd1cd72, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:49.524538 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90507684-9fa9-47c1-9a3d-0acd8f8e0370 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:49.581281 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-59600430-ebb6-4a43-bad1-4a840026e033 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19e772dc3ab6498f96e8d8619faf8324', 'request_id': 'req-59600430-ebb6-4a43-bad1-4a840026e033'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:49.588798 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 937/1878] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:22:49 2022] PUT /identity/v3/projects/b1b2a1fd9bf04bd29e4bed991320349e/users/84901fbcf9a1488ea35b170eedd1cd72/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:22:49.593211 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90507684-9fa9-47c1-9a3d-0acd8f8e0370 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:49.607670 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-59600430-ebb6-4a43-bad1-4a840026e033 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19e772dc3ab6498f96e8d8619faf8324', 'request_id': 'req-59600430-ebb6-4a43-bad1-4a840026e033'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:49.625274 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-59600430-ebb6-4a43-bad1-4a840026e033 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19e772dc3ab6498f96e8d8619faf8324', 'request_id': 'req-59600430-ebb6-4a43-bad1-4a840026e033'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:49.629292 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:49.663996 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-59600430-ebb6-4a43-bad1-4a840026e033 admin admin] The token cache is being invalidate because project 19e772dc3ab6498f96e8d8619faf8324 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:22:49.663996 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-59600430-ebb6-4a43-bad1-4a840026e033 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:49.665180 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-59600430-ebb6-4a43-bad1-4a840026e033 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:49.668428 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 942/1879] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:22:49 2022] DELETE /identity/v3/projects/19e772dc3ab6498f96e8d8619faf8324 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:22:49.675773 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724ddf4-188c-44c1-8f8f-78a9d5c6c852 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:49.676274 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724ddf4-188c-44c1-8f8f-78a9d5c6c852 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:49.676771 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724ddf4-188c-44c1-8f8f-78a9d5c6c852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:49.713132 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:49.722705 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-c724ddf4-188c-44c1-8f8f-78a9d5c6c852 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:49.723897 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-c724ddf4-188c-44c1-8f8f-78a9d5c6c852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:49.838027 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90507684-9fa9-47c1-9a3d-0acd8f8e0370 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:49.863429 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97283f-1123-4200-89a2-6462654463fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:49.864502 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97283f-1123-4200-89a2-6462654463fc admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:49.869894 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97283f-1123-4200-89a2-6462654463fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:49.870584 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97283f-1123-4200-89a2-6462654463fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:49.872841 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e97283f-1123-4200-89a2-6462654463fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:49.876334 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e97283f-1123-4200-89a2-6462654463fc admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:49.898344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 943/1880] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:22:49.905582 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724ddf4-188c-44c1-8f8f-78a9d5c6c852 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:49.907926 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-c724ddf4-188c-44c1-8f8f-78a9d5c6c852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:49.909969 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 938/1881] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:22:49.912898 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbbbb01-2781-4c94-bb77-18060c5cad0a None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:49.913409 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbbbb01-2781-4c94-bb77-18060c5cad0a None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:49.914032 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbbbb01-2781-4c94-bb77-18060c5cad0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:49.922581 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724ddf4-188c-44c1-8f8f-78a9d5c6c852 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:49.928403 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf00266-e207-43c2-8bae-18410aa968bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:49.929065 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf00266-e207-43c2-8bae-18410aa968bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:49.929349 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf00266-e207-43c2-8bae-18410aa968bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:49.929624 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf00266-e207-43c2-8bae-18410aa968bc admin admin] PATH_INFO: `/v3/users/cdad254d93974ae9bcb60b4b420aec63` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:49.933768 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf00266-e207-43c2-8bae-18410aa968bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdad254d93974ae9bcb60b4b420aec63)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:49.936179 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf00266-e207-43c2-8bae-18410aa968bc admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:49.968255 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-1fbbbb01-2781-4c94-bb77-18060c5cad0a None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:49.971055 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-1fbbbb01-2781-4c94-bb77-18060c5cad0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:49.998405 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 939/1882] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:22:49.998405 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbbbb01-2781-4c94-bb77-18060c5cad0a None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:50.010868 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-1fbbbb01-2781-4c94-bb77-18060c5cad0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:50.039879 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbbbb01-2781-4c94-bb77-18060c5cad0a None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:50.049970 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4e686-821b-4326-8be8-1f22d11cbb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:50.051228 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4e686-821b-4326-8be8-1f22d11cbb55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:50.052839 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4e686-821b-4326-8be8-1f22d11cbb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:50.053291 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4e686-821b-4326-8be8-1f22d11cbb55 admin admin] PATH_INFO: `/v3/projects/b1b2a1fd9bf04bd29e4bed991320349e/users/84901fbcf9a1488ea35b170eedd1cd72/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:50.059352 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4e686-821b-4326-8be8-1f22d11cbb55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1b2a1fd9bf04bd29e4bed991320349e, user_id=84901fbcf9a1488ea35b170eedd1cd72, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:50.063470 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4e686-821b-4326-8be8-1f22d11cbb55 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:50.081162 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-dbf00266-e207-43c2-8bae-18410aa968bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdad254d93974ae9bcb60b4b420aec63'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:50.081824 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 940/1883] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:22:49 2022] PUT /identity/v3/projects/b1b2a1fd9bf04bd29e4bed991320349e/users/84901fbcf9a1488ea35b170eedd1cd72/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:22:50.083321 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4e686-821b-4326-8be8-1f22d11cbb55 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:50.107897 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-dbf00266-e207-43c2-8bae-18410aa968bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdad254d93974ae9bcb60b4b420aec63'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:50.120099 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-dbf00266-e207-43c2-8bae-18410aa968bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdad254d93974ae9bcb60b4b420aec63'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:50.121579 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-dbf00266-e207-43c2-8bae-18410aa968bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdad254d93974ae9bcb60b4b420aec63'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:50.134164 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-dbf00266-e207-43c2-8bae-18410aa968bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdad254d93974ae9bcb60b4b420aec63'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:50.145400 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 944/1884] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:22:49 2022] DELETE /identity/v3/users/cdad254d93974ae9bcb60b4b420aec63 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:22:50.145400 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac68d07-80b8-4ee4-9e42-da3fef23907e None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:50.145400 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac68d07-80b8-4ee4-9e42-da3fef23907e None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:50.145400 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac68d07-80b8-4ee4-9e42-da3fef23907e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:50.183259 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-dac68d07-80b8-4ee4-9e42-da3fef23907e None None] MFA Rules not processed for user `84901fbcf9a1488ea35b170eedd1cd72`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:50.184605 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-dac68d07-80b8-4ee4-9e42-da3fef23907e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:50.206123 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4e686-821b-4326-8be8-1f22d11cbb55 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:50.272515 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:50.294865 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d0987-e3ad-45e0-b48d-5c2b6b3e6f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:50.295503 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d0987-e3ad-45e0-b48d-5c2b6b3e6f15 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:50.295792 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d0987-e3ad-45e0-b48d-5c2b6b3e6f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:50.296120 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d0987-e3ad-45e0-b48d-5c2b6b3e6f15 admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:50.296803 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d0987-e3ad-45e0-b48d-5c2b6b3e6f15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:22:50.297113 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d0987-e3ad-45e0-b48d-5c2b6b3e6f15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:50.298833 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d0987-e3ad-45e0-b48d-5c2b6b3e6f15 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:50.301807 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 945/1885] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:50 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:22:50.303833 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d5731-e948-4db5-b08f-980a62ea4613 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:50.304191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d5731-e948-4db5-b08f-980a62ea4613 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:50.305188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d5731-e948-4db5-b08f-980a62ea4613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:50.340958 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 941/1886] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:22:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:22:50.340958 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d0987-e3ad-45e0-b48d-5c2b6b3e6f15 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:50.343172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-0c6d0987-e3ad-45e0-b48d-5c2b6b3e6f15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:50.358781 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-354d5731-e948-4db5-b08f-980a62ea4613 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:50.363148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-354d5731-e948-4db5-b08f-980a62ea4613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:50.386968 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 946/1887] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:22:50.396706 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d5731-e948-4db5-b08f-980a62ea4613 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:50.399591 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-354d5731-e948-4db5-b08f-980a62ea4613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:50.440183 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d5731-e948-4db5-b08f-980a62ea4613 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:50.447484 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:50.449602 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042cf25-9771-494a-b44a-179a0b814049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:50.450212 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042cf25-9771-494a-b44a-179a0b814049 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:50.450732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042cf25-9771-494a-b44a-179a0b814049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:50.451211 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042cf25-9771-494a-b44a-179a0b814049 admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:50.452444 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6042cf25-9771-494a-b44a-179a0b814049 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:50.456694 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6042cf25-9771-494a-b44a-179a0b814049 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:50.456953 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d0987-e3ad-45e0-b48d-5c2b6b3e6f15 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:50.463483 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b62f288-66f3-4472-863a-7448e4a58a5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:50.464996 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62f288-66f3-4472-863a-7448e4a58a5e service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:50.466488 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62f288-66f3-4472-863a-7448e4a58a5e service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:50.466817 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62f288-66f3-4472-863a-7448e4a58a5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:50.486029 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b62f288-66f3-4472-863a-7448e4a58a5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:50.487727 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b62f288-66f3-4472-863a-7448e4a58a5e service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:50.513673 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 947/1888] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:22:50 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:22:50.515685 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042cf25-9771-494a-b44a-179a0b814049 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:50.522510 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-6042cf25-9771-494a-b44a-179a0b814049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:50.523146 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 942/1889] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:22:50 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:22:50.524508 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b62f288-66f3-4472-863a-7448e4a58a5e service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:50.558810 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b62f288-66f3-4472-863a-7448e4a58a5e service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:50.709982 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042cf25-9771-494a-b44a-179a0b814049 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:50.725514 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022d9b3-1495-42d4-8f61-7305d7df75f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:50.726463 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022d9b3-1495-42d4-8f61-7305d7df75f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:50.726855 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022d9b3-1495-42d4-8f61-7305d7df75f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:50.727342 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022d9b3-1495-42d4-8f61-7305d7df75f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:50.756800 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3779fc-965b-4c62-ab4f-585dd3cbeae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:50.757839 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3779fc-965b-4c62-ab4f-585dd3cbeae8 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:50.758288 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3779fc-965b-4c62-ab4f-585dd3cbeae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:50.760488 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3779fc-965b-4c62-ab4f-585dd3cbeae8 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:50.762527 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3779fc-965b-4c62-ab4f-585dd3cbeae8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:50.777561 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3779fc-965b-4c62-ab4f-585dd3cbeae8 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:50.864593 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 943/1890] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:22:50 2022] POST /identity/v3/users => generated 292 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:22:50.866814 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3779fc-965b-4c62-ab4f-585dd3cbeae8 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:50.897783 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3779fc-965b-4c62-ab4f-585dd3cbeae8 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:50.908551 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230750e-1c33-4579-b8c9-b6762c5012f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:50.909474 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230750e-1c33-4579-b8c9-b6762c5012f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:50.910210 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230750e-1c33-4579-b8c9-b6762c5012f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:50.911309 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230750e-1c33-4579-b8c9-b6762c5012f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:50.912550 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230750e-1c33-4579-b8c9-b6762c5012f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:50.917415 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230750e-1c33-4579-b8c9-b6762c5012f8 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:50.941559 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 944/1891] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:22:50.946184 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230750e-1c33-4579-b8c9-b6762c5012f8 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:50.968710 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230750e-1c33-4579-b8c9-b6762c5012f8 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:50.978419 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc26202-4d32-408b-82f9-77be5574b040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:50.979412 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc26202-4d32-408b-82f9-77be5574b040 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:50.979961 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc26202-4d32-408b-82f9-77be5574b040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:50.980503 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc26202-4d32-408b-82f9-77be5574b040 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:50.982612 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc26202-4d32-408b-82f9-77be5574b040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:50.986170 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc26202-4d32-408b-82f9-77be5574b040 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:51.027671 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 945/1892] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:22:51.041921 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc26202-4d32-408b-82f9-77be5574b040 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:51.043434 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022d9b3-1495-42d4-8f61-7305d7df75f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:51.047126 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022d9b3-1495-42d4-8f61-7305d7df75f9 service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:51.089471 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc26202-4d32-408b-82f9-77be5574b040 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:51.095021 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 948/1893] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:22:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:22:51.097870 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f2c49-0814-4bae-beec-68b12a82079c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:51.099136 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f2c49-0814-4bae-beec-68b12a82079c admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:51.099629 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f2c49-0814-4bae-beec-68b12a82079c admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:51.100088 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f2c49-0814-4bae-beec-68b12a82079c admin admin] PATH_INFO: `/v3/projects/c1fa7005a03443cba88994fdf1ef9314/users/d5735db20fbd472192d669b2cffb67b6/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:51.145023 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f2c49-0814-4bae-beec-68b12a82079c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1fa7005a03443cba88994fdf1ef9314, user_id=d5735db20fbd472192d669b2cffb67b6, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:51.152117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f2c49-0814-4bae-beec-68b12a82079c admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:51.219827 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 946/1894] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:22:51 2022] PUT /identity/v3/projects/c1fa7005a03443cba88994fdf1ef9314/users/d5735db20fbd472192d669b2cffb67b6/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:22:51.231664 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c884100-dece-45c6-acd0-fde72defbd42 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:51.232010 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c884100-dece-45c6-acd0-fde72defbd42 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:51.232317 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c884100-dece-45c6-acd0-fde72defbd42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:51.300888 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-3c884100-dece-45c6-acd0-fde72defbd42 None None] MFA Rules not processed for user `d5735db20fbd472192d669b2cffb67b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:51.302149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-3c884100-dece-45c6-acd0-fde72defbd42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:51.479210 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 949/1895] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:22:51.488917 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f2c49-0814-4bae-beec-68b12a82079c admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:51.623153 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f2c49-0814-4bae-beec-68b12a82079c admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:51.627429 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36aff1-ee75-49d8-917b-a9d6caa788b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:51.628061 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36aff1-ee75-49d8-917b-a9d6caa788b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:51.628496 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36aff1-ee75-49d8-917b-a9d6caa788b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:51.628783 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36aff1-ee75-49d8-917b-a9d6caa788b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:51.641141 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36aff1-ee75-49d8-917b-a9d6caa788b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:51.642838 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36aff1-ee75-49d8-917b-a9d6caa788b4 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:51.659756 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 947/1896] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:22:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:22:51.692800 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c884100-dece-45c6-acd0-fde72defbd42 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:51.702545 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:51.795259 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36aff1-ee75-49d8-917b-a9d6caa788b4 service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:51.812521 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36aff1-ee75-49d8-917b-a9d6caa788b4 service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:51.823621 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f128e2-a800-4b89-9d9f-0ba11130102e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:51.824604 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f128e2-a800-4b89-9d9f-0ba11130102e service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:51.826797 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f128e2-a800-4b89-9d9f-0ba11130102e service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:51.827057 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f128e2-a800-4b89-9d9f-0ba11130102e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:51.833645 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f3f128e2-a800-4b89-9d9f-0ba11130102e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:51.870709 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c884100-dece-45c6-acd0-fde72defbd42 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:51.896696 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eae382-c48d-44a0-bf14-48a6dae22b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:51.900346 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eae382-c48d-44a0-bf14-48a6dae22b7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:51.901099 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eae382-c48d-44a0-bf14-48a6dae22b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:51.907571 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eae382-c48d-44a0-bf14-48a6dae22b7a admin admin] PATH_INFO: `/v3/users/d5735db20fbd472192d669b2cffb67b6` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:51.909473 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eae382-c48d-44a0-bf14-48a6dae22b7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5735db20fbd472192d669b2cffb67b6)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:51.913094 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eae382-c48d-44a0-bf14-48a6dae22b7a admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:51.961225 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:52.016213 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-56eae382-c48d-44a0-bf14-48a6dae22b7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5735db20fbd472192d669b2cffb67b6'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:52.029271 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f128e2-a800-4b89-9d9f-0ba11130102e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:52.033663 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f128e2-a800-4b89-9d9f-0ba11130102e service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:52.038286 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-56eae382-c48d-44a0-bf14-48a6dae22b7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5735db20fbd472192d669b2cffb67b6'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:52.053107 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-56eae382-c48d-44a0-bf14-48a6dae22b7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5735db20fbd472192d669b2cffb67b6'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:52.054260 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-56eae382-c48d-44a0-bf14-48a6dae22b7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5735db20fbd472192d669b2cffb67b6'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:52.065407 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 948/1897] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:22:51 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:22:52.068916 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-56eae382-c48d-44a0-bf14-48a6dae22b7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5735db20fbd472192d669b2cffb67b6'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:52.087110 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 950/1898] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:22:51 2022] DELETE /identity/v3/users/d5735db20fbd472192d669b2cffb67b6 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:22:52.089424 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a571662-0abf-4fe7-9a64-b259a0f25382 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:52.090286 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a571662-0abf-4fe7-9a64-b259a0f25382 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:52.090603 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a571662-0abf-4fe7-9a64-b259a0f25382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:52.118335 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-4a571662-0abf-4fe7-9a64-b259a0f25382 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:52.120703 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-4a571662-0abf-4fe7-9a64-b259a0f25382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:52.248629 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 949/1899] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:22:52.277436 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eae382-c48d-44a0-bf14-48a6dae22b7a admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:52.280814 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-56eae382-c48d-44a0-bf14-48a6dae22b7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:52.364998 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eae382-c48d-44a0-bf14-48a6dae22b7a admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:52.373983 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaec012-8834-4ee9-943b-f4ea1b00160a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:52.375051 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaec012-8834-4ee9-943b-f4ea1b00160a service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:52.375607 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaec012-8834-4ee9-943b-f4ea1b00160a service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:52.376086 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaec012-8834-4ee9-943b-f4ea1b00160a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:52.402234 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaec012-8834-4ee9-943b-f4ea1b00160a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:52.405908 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaec012-8834-4ee9-943b-f4ea1b00160a service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:52.440181 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 951/1900] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:22:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:22:52.537780 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a571662-0abf-4fe7-9a64-b259a0f25382 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:52.539771 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-4a571662-0abf-4fe7-9a64-b259a0f25382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:52.552724 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a571662-0abf-4fe7-9a64-b259a0f25382 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:52.564484 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34508c8-e53e-431d-96d9-570fa562e6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:52.565025 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34508c8-e53e-431d-96d9-570fa562e6b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:52.565306 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34508c8-e53e-431d-96d9-570fa562e6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:52.565653 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34508c8-e53e-431d-96d9-570fa562e6b6 admin admin] PATH_INFO: `/v3/projects/8bbb8c40f06f4c028c9fb2ece7addecf` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:52.567554 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34508c8-e53e-431d-96d9-570fa562e6b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bbb8c40f06f4c028c9fb2ece7addecf)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:52.571151 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34508c8-e53e-431d-96d9-570fa562e6b6 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:52.640418 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d34508c8-e53e-431d-96d9-570fa562e6b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bbb8c40f06f4c028c9fb2ece7addecf', 'request_id': 'req-d34508c8-e53e-431d-96d9-570fa562e6b6'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:52.656574 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d34508c8-e53e-431d-96d9-570fa562e6b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bbb8c40f06f4c028c9fb2ece7addecf', 'request_id': 'req-d34508c8-e53e-431d-96d9-570fa562e6b6'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:52.668463 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d34508c8-e53e-431d-96d9-570fa562e6b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bbb8c40f06f4c028c9fb2ece7addecf', 'request_id': 'req-d34508c8-e53e-431d-96d9-570fa562e6b6'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:52.695817 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d34508c8-e53e-431d-96d9-570fa562e6b6 admin admin] The token cache is being invalidate because project 8bbb8c40f06f4c028c9fb2ece7addecf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:22:52.696131 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d34508c8-e53e-431d-96d9-570fa562e6b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:52.698659 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d34508c8-e53e-431d-96d9-570fa562e6b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:52.704897 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 950/1901] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:22:52 2022] DELETE /identity/v3/projects/8bbb8c40f06f4c028c9fb2ece7addecf => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:22:52.709118 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaec012-8834-4ee9-943b-f4ea1b00160a service neutron] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:52.731683 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaec012-8834-4ee9-943b-f4ea1b00160a service neutron] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:52.810408 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:52.851407 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17977ba3-1c23-4253-b1e8-61301fe15fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:52.852415 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17977ba3-1c23-4253-b1e8-61301fe15fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:52.852705 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17977ba3-1c23-4253-b1e8-61301fe15fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:52.853524 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17977ba3-1c23-4253-b1e8-61301fe15fa8 admin admin] PATH_INFO: `/v3/users/1a91a8568bc2444c9ad95c5d70b84fff` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:52.856748 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17977ba3-1c23-4253-b1e8-61301fe15fa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a91a8568bc2444c9ad95c5d70b84fff)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:52.857366 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17977ba3-1c23-4253-b1e8-61301fe15fa8 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:52.927517 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-17977ba3-1c23-4253-b1e8-61301fe15fa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a91a8568bc2444c9ad95c5d70b84fff'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:52.955388 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-17977ba3-1c23-4253-b1e8-61301fe15fa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a91a8568bc2444c9ad95c5d70b84fff'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:52.965618 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-17977ba3-1c23-4253-b1e8-61301fe15fa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a91a8568bc2444c9ad95c5d70b84fff'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:52.966328 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-17977ba3-1c23-4253-b1e8-61301fe15fa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a91a8568bc2444c9ad95c5d70b84fff'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:52.975295 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-17977ba3-1c23-4253-b1e8-61301fe15fa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a91a8568bc2444c9ad95c5d70b84fff'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:52.983401 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 952/1902] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:22:52 2022] DELETE /identity/v3/users/1a91a8568bc2444c9ad95c5d70b84fff => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:22:53.652226 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34508c8-e53e-431d-96d9-570fa562e6b6 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:53.655177 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d34508c8-e53e-431d-96d9-570fa562e6b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:53.682772 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34508c8-e53e-431d-96d9-570fa562e6b6 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:53.766819 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:53.778661 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91329f-ed8b-4fae-8815-95fe1f487e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:53.780164 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91329f-ed8b-4fae-8815-95fe1f487e3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:53.780823 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91329f-ed8b-4fae-8815-95fe1f487e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:53.781474 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91329f-ed8b-4fae-8815-95fe1f487e3f admin admin] PATH_INFO: `/v3/projects/c1fa7005a03443cba88994fdf1ef9314` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:53.783463 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91329f-ed8b-4fae-8815-95fe1f487e3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1fa7005a03443cba88994fdf1ef9314)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:53.786207 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c91329f-ed8b-4fae-8815-95fe1f487e3f admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:53.892389 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-2c91329f-ed8b-4fae-8815-95fe1f487e3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1fa7005a03443cba88994fdf1ef9314', 'request_id': 'req-2c91329f-ed8b-4fae-8815-95fe1f487e3f'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:53.914007 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-2c91329f-ed8b-4fae-8815-95fe1f487e3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1fa7005a03443cba88994fdf1ef9314', 'request_id': 'req-2c91329f-ed8b-4fae-8815-95fe1f487e3f'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:53.966095 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-2c91329f-ed8b-4fae-8815-95fe1f487e3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1fa7005a03443cba88994fdf1ef9314', 'request_id': 'req-2c91329f-ed8b-4fae-8815-95fe1f487e3f'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:54.023211 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-2c91329f-ed8b-4fae-8815-95fe1f487e3f admin admin] The token cache is being invalidate because project c1fa7005a03443cba88994fdf1ef9314 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:22:54.023745 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-2c91329f-ed8b-4fae-8815-95fe1f487e3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:54.026022 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-2c91329f-ed8b-4fae-8815-95fe1f487e3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:54.030981 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 951/1903] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:22:53 2022] DELETE /identity/v3/projects/c1fa7005a03443cba88994fdf1ef9314 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:22:54.039066 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee51c9-d809-4f34-bbe7-4addb2fbbdba None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:54.039885 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee51c9-d809-4f34-bbe7-4addb2fbbdba None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:54.040042 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee51c9-d809-4f34-bbe7-4addb2fbbdba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:54.101902 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-e1ee51c9-d809-4f34-bbe7-4addb2fbbdba None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:54.108422 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-e1ee51c9-d809-4f34-bbe7-4addb2fbbdba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:54.155120 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91329f-ed8b-4fae-8815-95fe1f487e3f admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:54.158234 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2c91329f-ed8b-4fae-8815-95fe1f487e3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:54.334934 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 953/1904] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:22:54.342009 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f5f72-a9cd-4dff-8959-cc84250fc0da None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:54.342009 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f5f72-a9cd-4dff-8959-cc84250fc0da None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:54.342009 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f5f72-a9cd-4dff-8959-cc84250fc0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:54.403456 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-c17f5f72-a9cd-4dff-8959-cc84250fc0da None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:54.403456 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-c17f5f72-a9cd-4dff-8959-cc84250fc0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:54.404450 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91329f-ed8b-4fae-8815-95fe1f487e3f admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:54.414401 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 954/1905] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:22:54.415701 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85d171-639a-4c9e-8003-3d2d0e9b228e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:54.415701 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85d171-639a-4c9e-8003-3d2d0e9b228e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:54.415701 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85d171-639a-4c9e-8003-3d2d0e9b228e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:54.415701 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85d171-639a-4c9e-8003-3d2d0e9b228e admin admin] PATH_INFO: `/v3/projects/f4e3ed31621944a29b57eaf7f9a43953` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:54.424947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85d171-639a-4c9e-8003-3d2d0e9b228e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4e3ed31621944a29b57eaf7f9a43953)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:54.425852 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f5f72-a9cd-4dff-8959-cc84250fc0da None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:54.426877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85d171-639a-4c9e-8003-3d2d0e9b228e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:54.447805 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f5f72-a9cd-4dff-8959-cc84250fc0da None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:54.463981 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15880f61-8c68-4e3e-a3df-970993d82bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:54.464837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15880f61-8c68-4e3e-a3df-970993d82bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:54.466344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15880f61-8c68-4e3e-a3df-970993d82bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:54.466892 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15880f61-8c68-4e3e-a3df-970993d82bd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:54.469461 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15880f61-8c68-4e3e-a3df-970993d82bd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:22:54.469993 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15880f61-8c68-4e3e-a3df-970993d82bd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:54.472553 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15880f61-8c68-4e3e-a3df-970993d82bd2 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:54.497756 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 955/1906] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:22:54.499666 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15880f61-8c68-4e3e-a3df-970993d82bd2 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:54.517511 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15880f61-8c68-4e3e-a3df-970993d82bd2 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:54.520378 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ff85d171-639a-4c9e-8003-3d2d0e9b228e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4e3ed31621944a29b57eaf7f9a43953', 'request_id': 'req-ff85d171-639a-4c9e-8003-3d2d0e9b228e'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:54.542300 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ff85d171-639a-4c9e-8003-3d2d0e9b228e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4e3ed31621944a29b57eaf7f9a43953', 'request_id': 'req-ff85d171-639a-4c9e-8003-3d2d0e9b228e'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:54.557490 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ff85d171-639a-4c9e-8003-3d2d0e9b228e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4e3ed31621944a29b57eaf7f9a43953', 'request_id': 'req-ff85d171-639a-4c9e-8003-3d2d0e9b228e'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:54.590587 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:54.591245 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ff85d171-639a-4c9e-8003-3d2d0e9b228e admin admin] The token cache is being invalidate because project f4e3ed31621944a29b57eaf7f9a43953 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:22:54.591579 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ff85d171-639a-4c9e-8003-3d2d0e9b228e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:54.592378 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ff85d171-639a-4c9e-8003-3d2d0e9b228e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:54.599714 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 952/1907] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:22:54 2022] DELETE /identity/v3/projects/f4e3ed31621944a29b57eaf7f9a43953 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:22:54.602484 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb05013-d45c-416c-963b-13dc4958c149 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:54.602845 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb05013-d45c-416c-963b-13dc4958c149 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:54.603245 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb05013-d45c-416c-963b-13dc4958c149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:54.646048 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-bfb05013-d45c-416c-963b-13dc4958c149 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:54.647820 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350bbd9b-193a-4922-a2eb-8363e4bc0633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:54.648458 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bbd9b-193a-4922-a2eb-8363e4bc0633 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:54.648737 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bbd9b-193a-4922-a2eb-8363e4bc0633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:54.648944 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-bfb05013-d45c-416c-963b-13dc4958c149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:54.649111 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bbd9b-193a-4922-a2eb-8363e4bc0633 admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:54.649717 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350bbd9b-193a-4922-a2eb-8363e4bc0633 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:54.652563 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350bbd9b-193a-4922-a2eb-8363e4bc0633 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:54.670547 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 953/1908] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:22:54.684630 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030af118-67fe-434e-ac3f-ae06f8d553b6 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:54.685125 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030af118-67fe-434e-ac3f-ae06f8d553b6 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:54.685610 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030af118-67fe-434e-ac3f-ae06f8d553b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:54.696280 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 956/1909] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:22:54 2022] POST /identity/v3/projects => generated 373 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:22:54.703627 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350bbd9b-193a-4922-a2eb-8363e4bc0633 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:54.706789 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-350bbd9b-193a-4922-a2eb-8363e4bc0633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:54.728385 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-030af118-67fe-434e-ac3f-ae06f8d553b6 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:54.730169 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-030af118-67fe-434e-ac3f-ae06f8d553b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:54.740694 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:54.857449 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 954/1910] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:22:54.863683 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030af118-67fe-434e-ac3f-ae06f8d553b6 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:54.896025 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030af118-67fe-434e-ac3f-ae06f8d553b6 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:54.921860 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e404a9-91b1-4769-ada9-4b027fe87475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:54.923374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e404a9-91b1-4769-ada9-4b027fe87475 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:54.924383 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e404a9-91b1-4769-ada9-4b027fe87475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:54.925171 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e404a9-91b1-4769-ada9-4b027fe87475 admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:54.926141 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e404a9-91b1-4769-ada9-4b027fe87475 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:22:54.926699 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e404a9-91b1-4769-ada9-4b027fe87475 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:54.929171 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e404a9-91b1-4769-ada9-4b027fe87475 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:54.949437 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 955/1911] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:22:54.958050 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e404a9-91b1-4769-ada9-4b027fe87475 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:54.971875 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e404a9-91b1-4769-ada9-4b027fe87475 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:54.976317 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350bbd9b-193a-4922-a2eb-8363e4bc0633 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:54.980244 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5e79c-8c7f-4e54-983c-770a2ec212dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:54.981217 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5e79c-8c7f-4e54-983c-770a2ec212dd admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:54.981814 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5e79c-8c7f-4e54-983c-770a2ec212dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:54.982051 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5e79c-8c7f-4e54-983c-770a2ec212dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:54.982842 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5e79c-8c7f-4e54-983c-770a2ec212dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:54.984703 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ddf3db-c0d7-4a16-9a2f-9661bbcb2660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:54.984955 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5e79c-8c7f-4e54-983c-770a2ec212dd admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:54.985959 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ddf3db-c0d7-4a16-9a2f-9661bbcb2660 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:54.986661 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ddf3db-c0d7-4a16-9a2f-9661bbcb2660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:54.987152 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ddf3db-c0d7-4a16-9a2f-9661bbcb2660 admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:54.988416 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ddf3db-c0d7-4a16-9a2f-9661bbcb2660 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:54.993366 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ddf3db-c0d7-4a16-9a2f-9661bbcb2660 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:55.028129 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 956/1912] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:22:54 2022] POST /identity/v3/projects => generated 381 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:22:55.032363 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5e79c-8c7f-4e54-983c-770a2ec212dd admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:55.035432 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 957/1913] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:22:54 2022] POST /identity/v3/users => generated 287 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:22:55.041520 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ddf3db-c0d7-4a16-9a2f-9661bbcb2660 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:55.062789 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ddf3db-c0d7-4a16-9a2f-9661bbcb2660 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:55.155203 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc132b-e9cb-4fea-9869-6f08b31ee1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:55.156252 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc132b-e9cb-4fea-9869-6f08b31ee1d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:55.156754 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc132b-e9cb-4fea-9869-6f08b31ee1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:55.157061 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc132b-e9cb-4fea-9869-6f08b31ee1d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:55.157714 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc132b-e9cb-4fea-9869-6f08b31ee1d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:55.159453 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc132b-e9cb-4fea-9869-6f08b31ee1d0 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:55.166643 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5e79c-8c7f-4e54-983c-770a2ec212dd admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:55.172782 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 958/1914] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:22:55.178395 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc132b-e9cb-4fea-9869-6f08b31ee1d0 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:55.179702 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf12a9cc-53d3-43d2-8244-5e075d0bb5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:55.181564 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf12a9cc-53d3-43d2-8244-5e075d0bb5cc admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:55.181764 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf12a9cc-53d3-43d2-8244-5e075d0bb5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:55.182077 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf12a9cc-53d3-43d2-8244-5e075d0bb5cc admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:55.185162 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf12a9cc-53d3-43d2-8244-5e075d0bb5cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:55.187116 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf12a9cc-53d3-43d2-8244-5e075d0bb5cc admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:55.191745 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc132b-e9cb-4fea-9869-6f08b31ee1d0 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:55.201686 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff2111-1915-423e-adbe-ee8d84ab8ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:55.202494 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff2111-1915-423e-adbe-ee8d84ab8ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:55.203591 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff2111-1915-423e-adbe-ee8d84ab8ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:55.204167 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff2111-1915-423e-adbe-ee8d84ab8ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:55.205662 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dff2111-1915-423e-adbe-ee8d84ab8ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:55.208649 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dff2111-1915-423e-adbe-ee8d84ab8ca8 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:55.225132 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 959/1915] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:22:55.232124 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff2111-1915-423e-adbe-ee8d84ab8ca8 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:55.234649 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 957/1916] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:22:55 2022] POST /identity/v3/users => generated 291 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:22:55.238645 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf12a9cc-53d3-43d2-8244-5e075d0bb5cc admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:55.262239 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf12a9cc-53d3-43d2-8244-5e075d0bb5cc admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:55.264162 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff2111-1915-423e-adbe-ee8d84ab8ca8 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:55.267439 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b80823-9ffd-4409-bee5-453afb355683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:55.267748 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b80823-9ffd-4409-bee5-453afb355683 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:55.267884 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b80823-9ffd-4409-bee5-453afb355683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:55.268448 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b80823-9ffd-4409-bee5-453afb355683 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:55.269320 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b80823-9ffd-4409-bee5-453afb355683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:55.271618 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b80823-9ffd-4409-bee5-453afb355683 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:55.276078 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d98526-ed07-48d9-97b0-824ac03fda52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:55.277188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d98526-ed07-48d9-97b0-824ac03fda52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:55.277868 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d98526-ed07-48d9-97b0-824ac03fda52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:55.278739 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d98526-ed07-48d9-97b0-824ac03fda52 admin admin] PATH_INFO: `/v3/projects/157e3da3bcc449e7ad16247b29fe6618/users/e60f4a0419f74f61a71f229e5673beae/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:55.288620 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 958/1917] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:22:55.293201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b80823-9ffd-4409-bee5-453afb355683 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:55.307269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b80823-9ffd-4409-bee5-453afb355683 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:55.314080 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d98526-ed07-48d9-97b0-824ac03fda52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=157e3da3bcc449e7ad16247b29fe6618, user_id=e60f4a0419f74f61a71f229e5673beae, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:55.314556 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31add1d-f979-4ee6-a83e-e324bec58455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:55.314898 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31add1d-f979-4ee6-a83e-e324bec58455 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:55.315248 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31add1d-f979-4ee6-a83e-e324bec58455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:55.315528 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31add1d-f979-4ee6-a83e-e324bec58455 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:55.316120 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31add1d-f979-4ee6-a83e-e324bec58455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:55.317815 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31add1d-f979-4ee6-a83e-e324bec58455 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:55.320700 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d98526-ed07-48d9-97b0-824ac03fda52 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:55.333509 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 959/1918] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:22:55.338437 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31add1d-f979-4ee6-a83e-e324bec58455 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:55.353469 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31add1d-f979-4ee6-a83e-e324bec58455 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:55.366911 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 960/1919] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:22:55 2022] PUT /identity/v3/projects/157e3da3bcc449e7ad16247b29fe6618/users/e60f4a0419f74f61a71f229e5673beae/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:22:55.375188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd708c8-dca5-45fa-991b-59e907eab6e6 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:55.375613 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd708c8-dca5-45fa-991b-59e907eab6e6 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:55.375957 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd708c8-dca5-45fa-991b-59e907eab6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:55.394562 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:55.451069 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-8dd708c8-dca5-45fa-991b-59e907eab6e6 None None] MFA Rules not processed for user `e60f4a0419f74f61a71f229e5673beae`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:55.456186 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-8dd708c8-dca5-45fa-991b-59e907eab6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:55.462215 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:55.500023 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e823770f-2e5f-4c6c-84d5-efb2855bae89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:55.500728 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823770f-2e5f-4c6c-84d5-efb2855bae89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:55.500994 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823770f-2e5f-4c6c-84d5-efb2855bae89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:55.501270 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823770f-2e5f-4c6c-84d5-efb2855bae89 admin admin] PATH_INFO: `/v3/projects/ed41c39c5f644344b8192ddd20803b6c/users/91de30f218fd4e10a8bcb4362793f9b1/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:55.523013 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e823770f-2e5f-4c6c-84d5-efb2855bae89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed41c39c5f644344b8192ddd20803b6c, user_id=91de30f218fd4e10a8bcb4362793f9b1, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:55.526459 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e823770f-2e5f-4c6c-84d5-efb2855bae89 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:55.557956 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 960/1920] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:22:55 2022] PUT /identity/v3/projects/ed41c39c5f644344b8192ddd20803b6c/users/91de30f218fd4e10a8bcb4362793f9b1/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:22:55.575480 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ab51f-22db-4062-915b-42a8dd7451c9 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:55.575864 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ab51f-22db-4062-915b-42a8dd7451c9 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:55.576278 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ab51f-22db-4062-915b-42a8dd7451c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:55.662665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 961/1921] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:22:55.686823 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd708c8-dca5-45fa-991b-59e907eab6e6 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:55.689367 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-8dd708c8-dca5-45fa-991b-59e907eab6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:55.693047 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-a16ab51f-22db-4062-915b-42a8dd7451c9 None None] MFA Rules not processed for user `91de30f218fd4e10a8bcb4362793f9b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:55.695371 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a16ab51f-22db-4062-915b-42a8dd7451c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:55.840660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 961/1922] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:22:55.852060 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ab51f-22db-4062-915b-42a8dd7451c9 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:55.940631 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd708c8-dca5-45fa-991b-59e907eab6e6 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:56.061550 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ab51f-22db-4062-915b-42a8dd7451c9 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:56.080331 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae6df4-2d07-453c-aa1d-43d1c1fb511c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:56.082144 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae6df4-2d07-453c-aa1d-43d1c1fb511c admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:56.082627 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae6df4-2d07-453c-aa1d-43d1c1fb511c admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:56.082833 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae6df4-2d07-453c-aa1d-43d1c1fb511c admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:56.085864 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae6df4-2d07-453c-aa1d-43d1c1fb511c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:56.089192 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae6df4-2d07-453c-aa1d-43d1c1fb511c admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:56.148586 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 962/1923] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:22:55 2022] POST /identity/v3/projects => generated 381 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:22:56.149913 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae6df4-2d07-453c-aa1d-43d1c1fb511c admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:56.155220 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47405a3a-3d85-480f-aab6-cc115b8a0ac3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:56.156743 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47405a3a-3d85-480f-aab6-cc115b8a0ac3 service cinder] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:56.157293 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47405a3a-3d85-480f-aab6-cc115b8a0ac3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:56.157801 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47405a3a-3d85-480f-aab6-cc115b8a0ac3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:56.265224 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:56.297045 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47405a3a-3d85-480f-aab6-cc115b8a0ac3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:56.300615 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47405a3a-3d85-480f-aab6-cc115b8a0ac3 service cinder] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:56.315294 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae6df4-2d07-453c-aa1d-43d1c1fb511c admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:56.325133 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfb616-eb71-452e-9cb8-886b0184af45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:56.326267 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfb616-eb71-452e-9cb8-886b0184af45 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:56.326833 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfb616-eb71-452e-9cb8-886b0184af45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:56.326979 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 962/1924] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:22:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:22:56.327367 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfb616-eb71-452e-9cb8-886b0184af45 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:56.328480 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cfb616-eb71-452e-9cb8-886b0184af45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:56.333376 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cfb616-eb71-452e-9cb8-886b0184af45 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:56.382982 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47405a3a-3d85-480f-aab6-cc115b8a0ac3 service cinder] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:56.406587 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:56.421006 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 963/1925] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:22:56 2022] POST /identity/v3/users => generated 297 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:22:56.426217 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfb616-eb71-452e-9cb8-886b0184af45 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:56.426710 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47405a3a-3d85-480f-aab6-cc115b8a0ac3 service cinder] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:56.439768 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac81aa-6bc0-449f-adcd-47600b23002c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:56.440831 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac81aa-6bc0-449f-adcd-47600b23002c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:56.441316 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac81aa-6bc0-449f-adcd-47600b23002c admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:56.442870 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac81aa-6bc0-449f-adcd-47600b23002c admin admin] PATH_INFO: `/v3/users/e60f4a0419f74f61a71f229e5673beae` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:56.454692 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac81aa-6bc0-449f-adcd-47600b23002c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e60f4a0419f74f61a71f229e5673beae)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:56.454692 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac81aa-6bc0-449f-adcd-47600b23002c admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:56.484580 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfb616-eb71-452e-9cb8-886b0184af45 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:56.499763 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b190e-c1d7-41ae-9e4c-0eaf39cd4283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:56.501587 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b190e-c1d7-41ae-9e4c-0eaf39cd4283 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:56.502689 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b190e-c1d7-41ae-9e4c-0eaf39cd4283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:56.503442 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b190e-c1d7-41ae-9e4c-0eaf39cd4283 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:56.505014 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b190e-c1d7-41ae-9e4c-0eaf39cd4283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:56.508685 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b190e-c1d7-41ae-9e4c-0eaf39cd4283 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:56.553917 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 964/1926] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:22:56.556584 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b190e-c1d7-41ae-9e4c-0eaf39cd4283 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:56.599447 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b190e-c1d7-41ae-9e4c-0eaf39cd4283 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:56.611465 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-deac81aa-6bc0-449f-adcd-47600b23002c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e60f4a0419f74f61a71f229e5673beae'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:56.627976 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12e24e-fe69-426b-925b-49a74ede1e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:56.634394 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12e24e-fe69-426b-925b-49a74ede1e63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:56.636318 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12e24e-fe69-426b-925b-49a74ede1e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:56.636610 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12e24e-fe69-426b-925b-49a74ede1e63 admin admin] PATH_INFO: `/v3/projects/d532ad361f2a43f7af8f9eed68d313f7/users/2d48afef1c7543a6bc00c23e717ff08a/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:56.663172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f12e24e-fe69-426b-925b-49a74ede1e63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d532ad361f2a43f7af8f9eed68d313f7, user_id=2d48afef1c7543a6bc00c23e717ff08a, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:56.672392 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f12e24e-fe69-426b-925b-49a74ede1e63 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:56.678590 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-deac81aa-6bc0-449f-adcd-47600b23002c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e60f4a0419f74f61a71f229e5673beae'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:56.701518 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-deac81aa-6bc0-449f-adcd-47600b23002c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e60f4a0419f74f61a71f229e5673beae'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:56.702158 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-deac81aa-6bc0-449f-adcd-47600b23002c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e60f4a0419f74f61a71f229e5673beae'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:56.714341 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-deac81aa-6bc0-449f-adcd-47600b23002c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e60f4a0419f74f61a71f229e5673beae'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:56.720820 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 965/1927] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:22:56 2022] PUT /identity/v3/projects/d532ad361f2a43f7af8f9eed68d313f7/users/2d48afef1c7543a6bc00c23e717ff08a/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:22:56.728948 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 963/1928] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:22:56 2022] DELETE /identity/v3/users/e60f4a0419f74f61a71f229e5673beae => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:22:56.731192 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12e24e-fe69-426b-925b-49a74ede1e63 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:56.733110 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e381ae-566a-45d9-8477-5ab516da5848 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:56.733420 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e381ae-566a-45d9-8477-5ab516da5848 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:56.733757 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e381ae-566a-45d9-8477-5ab516da5848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:56.735632 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-6f12e24e-fe69-426b-925b-49a74ede1e63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:56.787969 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-f9e381ae-566a-45d9-8477-5ab516da5848 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:56.789427 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-f9e381ae-566a-45d9-8477-5ab516da5848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:56.982761 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12e24e-fe69-426b-925b-49a74ede1e63 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:57.052121 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 964/1929] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:22:57.066466 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e381ae-566a-45d9-8477-5ab516da5848 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:57.068755 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-f9e381ae-566a-45d9-8477-5ab516da5848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:57.146149 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ead88-dbbb-4bc1-845d-a5c6b135f9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:57.148138 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ead88-dbbb-4bc1-845d-a5c6b135f9d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:57.152009 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ead88-dbbb-4bc1-845d-a5c6b135f9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:57.152556 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ead88-dbbb-4bc1-845d-a5c6b135f9d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:57.153552 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ead88-dbbb-4bc1-845d-a5c6b135f9d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:57.158778 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ead88-dbbb-4bc1-845d-a5c6b135f9d3 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:57.202989 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 966/1930] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 473 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:22:57.210183 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ead88-dbbb-4bc1-845d-a5c6b135f9d3 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:57.235361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ead88-dbbb-4bc1-845d-a5c6b135f9d3 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:57.242429 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4355ce4-ce2b-4491-a4fd-2b37ee5fcc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:57.242746 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4355ce4-ce2b-4491-a4fd-2b37ee5fcc7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:57.243010 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4355ce4-ce2b-4491-a4fd-2b37ee5fcc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:57.243828 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4355ce4-ce2b-4491-a4fd-2b37ee5fcc7b admin admin] PATH_INFO: `/v3/projects/d532ad361f2a43f7af8f9eed68d313f7/users/2d48afef1c7543a6bc00c23e717ff08a/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:57.248484 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4355ce4-ce2b-4491-a4fd-2b37ee5fcc7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d532ad361f2a43f7af8f9eed68d313f7, user_id=2d48afef1c7543a6bc00c23e717ff08a, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:57.253700 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e381ae-566a-45d9-8477-5ab516da5848 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:57.261203 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4355ce4-ce2b-4491-a4fd-2b37ee5fcc7b admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:57.264599 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c17edf-f55a-4f99-8288-a6d874ec50ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:57.265246 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c17edf-f55a-4f99-8288-a6d874ec50ec service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:57.265573 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c17edf-f55a-4f99-8288-a6d874ec50ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:57.265798 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c17edf-f55a-4f99-8288-a6d874ec50ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:57.291725 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c17edf-f55a-4f99-8288-a6d874ec50ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:57.293265 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c17edf-f55a-4f99-8288-a6d874ec50ec service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:57.297971 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 967/1931] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:22:57 2022] PUT /identity/v3/projects/d532ad361f2a43f7af8f9eed68d313f7/users/2d48afef1c7543a6bc00c23e717ff08a/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:22:57.311963 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 965/1932] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:22:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:22:57.315080 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c32691-8be5-4320-b33d-6c7415eb6831 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:57.315369 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c32691-8be5-4320-b33d-6c7415eb6831 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:57.315655 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c32691-8be5-4320-b33d-6c7415eb6831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:57.360720 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-b1c32691-8be5-4320-b33d-6c7415eb6831 None None] MFA Rules not processed for user `2d48afef1c7543a6bc00c23e717ff08a`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:57.370593 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b1c32691-8be5-4320-b33d-6c7415eb6831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:57.391573 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:57.552965 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c17edf-f55a-4f99-8288-a6d874ec50ec service neutron] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:57.555469 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-71c17edf-f55a-4f99-8288-a6d874ec50ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:57.581872 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 968/1933] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:57 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:22:57.629902 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:57.720132 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c17edf-f55a-4f99-8288-a6d874ec50ec service neutron] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:57.831968 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff22b1-0179-4bae-9269-67d64ab87ae7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:57.833217 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff22b1-0179-4bae-9269-67d64ab87ae7 service cinder] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:57.833766 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff22b1-0179-4bae-9269-67d64ab87ae7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:57.834324 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff22b1-0179-4bae-9269-67d64ab87ae7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:57.837941 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-18ff22b1-0179-4bae-9269-67d64ab87ae7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:57.973113 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c32691-8be5-4320-b33d-6c7415eb6831 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:57.975925 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b1c32691-8be5-4320-b33d-6c7415eb6831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:57.987819 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff22b1-0179-4bae-9269-67d64ab87ae7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:57.990661 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff22b1-0179-4bae-9269-67d64ab87ae7 service cinder] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:58.004466 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 966/1934] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:22:57 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:22:58.183349 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c32691-8be5-4320-b33d-6c7415eb6831 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:58.203087 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f831d2-3ba9-4a18-a752-620bd5ba48ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:58.203886 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f831d2-3ba9-4a18-a752-620bd5ba48ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:58.204236 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f831d2-3ba9-4a18-a752-620bd5ba48ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:58.204580 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f831d2-3ba9-4a18-a752-620bd5ba48ec admin admin] PATH_INFO: `/v3/projects/157e3da3bcc449e7ad16247b29fe6618` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:58.205974 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f831d2-3ba9-4a18-a752-620bd5ba48ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=157e3da3bcc449e7ad16247b29fe6618)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:58.208194 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f831d2-3ba9-4a18-a752-620bd5ba48ec admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:58.328912 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f6f831d2-3ba9-4a18-a752-620bd5ba48ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '157e3da3bcc449e7ad16247b29fe6618', 'request_id': 'req-f6f831d2-3ba9-4a18-a752-620bd5ba48ec'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:58.347278 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f6f831d2-3ba9-4a18-a752-620bd5ba48ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '157e3da3bcc449e7ad16247b29fe6618', 'request_id': 'req-f6f831d2-3ba9-4a18-a752-620bd5ba48ec'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:58.361107 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f6f831d2-3ba9-4a18-a752-620bd5ba48ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '157e3da3bcc449e7ad16247b29fe6618', 'request_id': 'req-f6f831d2-3ba9-4a18-a752-620bd5ba48ec'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:58.389460 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f6f831d2-3ba9-4a18-a752-620bd5ba48ec admin admin] The token cache is being invalidate because project 157e3da3bcc449e7ad16247b29fe6618 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:22:58.389460 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f6f831d2-3ba9-4a18-a752-620bd5ba48ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:58.389971 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f6f831d2-3ba9-4a18-a752-620bd5ba48ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:22:58.394421 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 969/1935] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:22:57 2022] DELETE /identity/v3/projects/157e3da3bcc449e7ad16247b29fe6618 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:22:58.405714 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54fb88-fe63-418d-a7a5-1dee48bbcb90 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:58.406387 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54fb88-fe63-418d-a7a5-1dee48bbcb90 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:58.406887 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54fb88-fe63-418d-a7a5-1dee48bbcb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:58.498440 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-7c54fb88-fe63-418d-a7a5-1dee48bbcb90 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:58.501217 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-7c54fb88-fe63-418d-a7a5-1dee48bbcb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:58.646146 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 967/1936] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:22:58.653213 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c71371-9b88-4709-a807-1a72b3ed3762 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:58.655865 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c71371-9b88-4709-a807-1a72b3ed3762 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:58.656384 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c71371-9b88-4709-a807-1a72b3ed3762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:58.726891 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-f0c71371-9b88-4709-a807-1a72b3ed3762 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:58.729281 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f0c71371-9b88-4709-a807-1a72b3ed3762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:58.745304 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 970/1937] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:22:58.747835 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54fb88-fe63-418d-a7a5-1dee48bbcb90 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:58.763775 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54fb88-fe63-418d-a7a5-1dee48bbcb90 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:58.771087 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c57a3e-9dc0-48cd-9a6e-02b556d46563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:58.771883 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c57a3e-9dc0-48cd-9a6e-02b556d46563 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:58.772213 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c57a3e-9dc0-48cd-9a6e-02b556d46563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:58.772546 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c57a3e-9dc0-48cd-9a6e-02b556d46563 admin admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:58.773366 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c57a3e-9dc0-48cd-9a6e-02b556d46563 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:22:58.773803 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c57a3e-9dc0-48cd-9a6e-02b556d46563 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:58.777411 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c57a3e-9dc0-48cd-9a6e-02b556d46563 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:58.801230 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 968/1938] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:22:58.810988 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c71371-9b88-4709-a807-1a72b3ed3762 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:58.829870 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c71371-9b88-4709-a807-1a72b3ed3762 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:58.839712 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d72e4-9928-4709-9bf0-ea481b113306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:58.840773 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d72e4-9928-4709-9bf0-ea481b113306 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:58.841251 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d72e4-9928-4709-9bf0-ea481b113306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:58.841727 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d72e4-9928-4709-9bf0-ea481b113306 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:58.842896 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d72e4-9928-4709-9bf0-ea481b113306 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:58.846915 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d72e4-9928-4709-9bf0-ea481b113306 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:58.918144 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 971/1939] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:22:58 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:22:58.924789 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c57a3e-9dc0-48cd-9a6e-02b556d46563 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:58.952915 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c57a3e-9dc0-48cd-9a6e-02b556d46563 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:59.002039 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:59.210733 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b6435-735a-4afc-b3e0-439739d4f6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:59.211810 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b6435-735a-4afc-b3e0-439739d4f6f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:59.212857 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b6435-735a-4afc-b3e0-439739d4f6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:59.219835 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b6435-735a-4afc-b3e0-439739d4f6f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:59.221195 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634b6435-735a-4afc-b3e0-439739d4f6f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:59.227238 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634b6435-735a-4afc-b3e0-439739d4f6f0 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:59.317445 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 969/1940] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:22:58 2022] POST /identity/v3/users => generated 286 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:22:59.319552 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d72e4-9928-4709-9bf0-ea481b113306 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:59.340686 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d72e4-9928-4709-9bf0-ea481b113306 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:59.352604 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b05840-a875-4e7c-9e09-a4dd54638ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:59.354437 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b05840-a875-4e7c-9e09-a4dd54638ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:59.354924 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b05840-a875-4e7c-9e09-a4dd54638ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:59.355410 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b05840-a875-4e7c-9e09-a4dd54638ba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:59.356606 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b05840-a875-4e7c-9e09-a4dd54638ba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:59.360496 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b05840-a875-4e7c-9e09-a4dd54638ba8 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:59.387849 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 972/1941] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:22:59.394417 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b6435-735a-4afc-b3e0-439739d4f6f0 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:59.418178 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b6435-735a-4afc-b3e0-439739d4f6f0 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:59.430961 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c776f-bfb2-4d87-a8da-8228e547031c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:59.432884 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c776f-bfb2-4d87-a8da-8228e547031c admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:59.433650 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c776f-bfb2-4d87-a8da-8228e547031c admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:59.434309 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c776f-bfb2-4d87-a8da-8228e547031c admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:59.435770 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c776f-bfb2-4d87-a8da-8228e547031c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:59.439739 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c776f-bfb2-4d87-a8da-8228e547031c admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:59.469482 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 970/1942] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:22:59.476979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b05840-a875-4e7c-9e09-a4dd54638ba8 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:59.488047 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:22:59.500715 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b05840-a875-4e7c-9e09-a4dd54638ba8 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:22:59.512560 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd576e2b-84df-4c0d-b457-837f9d6311ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:22:59.513918 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd576e2b-84df-4c0d-b457-837f9d6311ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:59.514543 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd576e2b-84df-4c0d-b457-837f9d6311ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:59.515129 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd576e2b-84df-4c0d-b457-837f9d6311ce admin admin] PATH_INFO: `/v3/projects/e1162d51bdde497ea2697b89d5abcb93/users/04b9f8825a6c4adeb941e987a447d1a1/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:59.546781 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd576e2b-84df-4c0d-b457-837f9d6311ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1162d51bdde497ea2697b89d5abcb93, user_id=04b9f8825a6c4adeb941e987a447d1a1, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:22:59.552303 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd576e2b-84df-4c0d-b457-837f9d6311ce admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:22:59.621790 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 973/1943] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:22:59 2022] PUT /identity/v3/projects/e1162d51bdde497ea2697b89d5abcb93/users/04b9f8825a6c4adeb941e987a447d1a1/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:22:59.624426 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2fff5-2ec7-4115-8c82-f3249d695617 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:22:59.625168 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2fff5-2ec7-4115-8c82-f3249d695617 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:22:59.625520 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2fff5-2ec7-4115-8c82-f3249d695617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:22:59.664294 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-81b2fff5-2ec7-4115-8c82-f3249d695617 None None] MFA Rules not processed for user `04b9f8825a6c4adeb941e987a447d1a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:22:59.666802 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-81b2fff5-2ec7-4115-8c82-f3249d695617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:22:59.820721 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 971/1944] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:22:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:22:59.838832 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd576e2b-84df-4c0d-b457-837f9d6311ce admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:22:59.841928 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-cd576e2b-84df-4c0d-b457-837f9d6311ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:00.083370 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd576e2b-84df-4c0d-b457-837f9d6311ce admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:00.091408 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3a30c-6def-40d9-b0c1-fa8f333aca35 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c513a6c91a0240de87c7b51b07617827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:00.093759 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3a30c-6def-40d9-b0c1-fa8f333aca35 service glance] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:00.094253 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3a30c-6def-40d9-b0c1-fa8f333aca35 service glance] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:00.094735 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3a30c-6def-40d9-b0c1-fa8f333aca35 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:00.117358 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad3a30c-6def-40d9-b0c1-fa8f333aca35 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:00.120776 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad3a30c-6def-40d9-b0c1-fa8f333aca35 service glance] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:00.151837 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 974/1945] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:22:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:23:01.768926 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b2fff5-2ec7-4115-8c82-f3249d695617 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:01.771800 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-81b2fff5-2ec7-4115-8c82-f3249d695617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:01.798224 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3a30c-6def-40d9-b0c1-fa8f333aca35 service glance] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:01.801402 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2ad3a30c-6def-40d9-b0c1-fa8f333aca35 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:01.915703 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b2fff5-2ec7-4115-8c82-f3249d695617 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:01.920236 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311caadb-43d7-450c-851d-93521326c64f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:01.921032 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311caadb-43d7-450c-851d-93521326c64f service cinder] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:01.921326 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311caadb-43d7-450c-851d-93521326c64f service cinder] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:01.921584 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311caadb-43d7-450c-851d-93521326c64f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:01.923605 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-311caadb-43d7-450c-851d-93521326c64f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:01.957072 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3a30c-6def-40d9-b0c1-fa8f333aca35 service glance] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:01.975366 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8510e6-2079-45e9-b982-5f9caae43924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:01.976310 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8510e6-2079-45e9-b982-5f9caae43924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:01.976734 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8510e6-2079-45e9-b982-5f9caae43924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:01.977181 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8510e6-2079-45e9-b982-5f9caae43924 admin admin] PATH_INFO: `/v3/users/6705c41c99f544fabbd6a084b95d6e95` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:01.979829 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8510e6-2079-45e9-b982-5f9caae43924 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6705c41c99f544fabbd6a084b95d6e95)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:01.984453 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8510e6-2079-45e9-b982-5f9caae43924 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:01.996105 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:02.077731 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311caadb-43d7-450c-851d-93521326c64f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:02.083233 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311caadb-43d7-450c-851d-93521326c64f service cinder] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:02.098113 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 972/1946] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:23:01 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:23:02.116332 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-1a8510e6-2079-45e9-b982-5f9caae43924 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6705c41c99f544fabbd6a084b95d6e95'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:02.143861 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-1a8510e6-2079-45e9-b982-5f9caae43924 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6705c41c99f544fabbd6a084b95d6e95'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:02.160314 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:02.178304 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-1a8510e6-2079-45e9-b982-5f9caae43924 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6705c41c99f544fabbd6a084b95d6e95'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:02.179092 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-1a8510e6-2079-45e9-b982-5f9caae43924 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6705c41c99f544fabbd6a084b95d6e95'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:02.189302 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-1a8510e6-2079-45e9-b982-5f9caae43924 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6705c41c99f544fabbd6a084b95d6e95'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:02.198414 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 975/1947] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:23:01 2022] DELETE /identity/v3/users/6705c41c99f544fabbd6a084b95d6e95 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:02.204690 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80ed59-d59b-4441-9c2e-fbf3f5de0a2f None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:02.204977 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80ed59-d59b-4441-9c2e-fbf3f5de0a2f None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:02.205246 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80ed59-d59b-4441-9c2e-fbf3f5de0a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:02.231223 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-bb80ed59-d59b-4441-9c2e-fbf3f5de0a2f None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:02.233431 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-bb80ed59-d59b-4441-9c2e-fbf3f5de0a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:02.409882 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 973/1948] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:23:02.424549 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8510e6-2079-45e9-b982-5f9caae43924 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:02.426313 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-1a8510e6-2079-45e9-b982-5f9caae43924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:02.515465 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8510e6-2079-45e9-b982-5f9caae43924 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:02.521141 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d8b70-d8e3-474e-8846-0a2a9055af6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:02.522076 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d8b70-d8e3-474e-8846-0a2a9055af6e service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:02.522573 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d8b70-d8e3-474e-8846-0a2a9055af6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:02.523010 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d8b70-d8e3-474e-8846-0a2a9055af6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:02.536850 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d8b70-d8e3-474e-8846-0a2a9055af6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:02.539517 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d8b70-d8e3-474e-8846-0a2a9055af6e service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:02.560280 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 976/1949] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:23:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:23:02.766470 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80ed59-d59b-4441-9c2e-fbf3f5de0a2f None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:02.769474 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-bb80ed59-d59b-4441-9c2e-fbf3f5de0a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:03.021135 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80ed59-d59b-4441-9c2e-fbf3f5de0a2f None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:03.036915 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e21e98-9404-4e92-8613-62a03048c24e tempest-VolumeQuotaClassesTest-1404719445 tempest-VolumeQuotaClassesTest-1404719445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d48afef1c7543a6bc00c23e717ff08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd532ad361f2a43f7af8f9eed68d313f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:03.038970 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e21e98-9404-4e92-8613-62a03048c24e tempest-VolumeQuotaClassesTest-1404719445 tempest-VolumeQuotaClassesTest-1404719445-project-admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:03.039435 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e21e98-9404-4e92-8613-62a03048c24e tempest-VolumeQuotaClassesTest-1404719445 tempest-VolumeQuotaClassesTest-1404719445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:03.039918 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e21e98-9404-4e92-8613-62a03048c24e tempest-VolumeQuotaClassesTest-1404719445 tempest-VolumeQuotaClassesTest-1404719445-project-admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:03.041092 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e21e98-9404-4e92-8613-62a03048c24e tempest-VolumeQuotaClassesTest-1404719445 tempest-VolumeQuotaClassesTest-1404719445-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:23:03.041591 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e21e98-9404-4e92-8613-62a03048c24e tempest-VolumeQuotaClassesTest-1404719445 tempest-VolumeQuotaClassesTest-1404719445-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:03.044554 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e21e98-9404-4e92-8613-62a03048c24e tempest-VolumeQuotaClassesTest-1404719445 tempest-VolumeQuotaClassesTest-1404719445-project-admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:03.089355 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 974/1950] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:23:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:23:03.090415 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d8b70-d8e3-474e-8846-0a2a9055af6e service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:03.167635 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e21e98-9404-4e92-8613-62a03048c24e tempest-VolumeQuotaClassesTest-1404719445 tempest-VolumeQuotaClassesTest-1404719445-project-admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:03.167899 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d8b70-d8e3-474e-8846-0a2a9055af6e service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:03.175427 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-e9e21e98-9404-4e92-8613-62a03048c24e tempest-VolumeQuotaClassesTest-1404719445 tempest-VolumeQuotaClassesTest-1404719445-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:03.207452 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8db92-1ce3-4504-b988-72e931d5e57e tempest-VolumeQuotaClassesTest-1404719445 tempest-VolumeQuotaClassesTest-1404719445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d48afef1c7543a6bc00c23e717ff08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd532ad361f2a43f7af8f9eed68d313f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:03.208437 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8db92-1ce3-4504-b988-72e931d5e57e tempest-VolumeQuotaClassesTest-1404719445 tempest-VolumeQuotaClassesTest-1404719445-project-admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:03.209075 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8db92-1ce3-4504-b988-72e931d5e57e tempest-VolumeQuotaClassesTest-1404719445 tempest-VolumeQuotaClassesTest-1404719445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:03.209495 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8db92-1ce3-4504-b988-72e931d5e57e tempest-VolumeQuotaClassesTest-1404719445 tempest-VolumeQuotaClassesTest-1404719445-project-admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:03.210777 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8db92-1ce3-4504-b988-72e931d5e57e tempest-VolumeQuotaClassesTest-1404719445 tempest-VolumeQuotaClassesTest-1404719445-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:03.222188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e21e98-9404-4e92-8613-62a03048c24e tempest-VolumeQuotaClassesTest-1404719445 tempest-VolumeQuotaClassesTest-1404719445-project-admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:03.236716 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8db92-1ce3-4504-b988-72e931d5e57e tempest-VolumeQuotaClassesTest-1404719445 tempest-VolumeQuotaClassesTest-1404719445-project-admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:03.241030 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946e24e-d272-4412-acf0-25388dbdc331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:03.242640 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946e24e-d272-4412-acf0-25388dbdc331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:03.244654 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946e24e-d272-4412-acf0-25388dbdc331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:03.245027 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946e24e-d272-4412-acf0-25388dbdc331 admin admin] PATH_INFO: `/v3/projects/ba2fbaa883b548b8b72f22d174371189` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:03.248906 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5946e24e-d272-4412-acf0-25388dbdc331 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba2fbaa883b548b8b72f22d174371189)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:03.256075 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5946e24e-d272-4412-acf0-25388dbdc331 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:03.317059 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 977/1951] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:23:03 2022] POST /identity/v3/projects => generated 355 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:23:03.324014 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8db92-1ce3-4504-b988-72e931d5e57e tempest-VolumeQuotaClassesTest-1404719445 tempest-VolumeQuotaClassesTest-1404719445-project-admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:03.345972 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-5946e24e-d272-4412-acf0-25388dbdc331 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba2fbaa883b548b8b72f22d174371189', 'request_id': 'req-5946e24e-d272-4412-acf0-25388dbdc331'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:03.364195 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-5946e24e-d272-4412-acf0-25388dbdc331 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba2fbaa883b548b8b72f22d174371189', 'request_id': 'req-5946e24e-d272-4412-acf0-25388dbdc331'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:03.382207 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:03.394703 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-5946e24e-d272-4412-acf0-25388dbdc331 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba2fbaa883b548b8b72f22d174371189', 'request_id': 'req-5946e24e-d272-4412-acf0-25388dbdc331'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:03.435186 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-5946e24e-d272-4412-acf0-25388dbdc331 admin admin] The token cache is being invalidate because project ba2fbaa883b548b8b72f22d174371189 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:23:03.435691 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-5946e24e-d272-4412-acf0-25388dbdc331 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:03.436816 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-5946e24e-d272-4412-acf0-25388dbdc331 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:03.440363 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 975/1952] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:23:03 2022] DELETE /identity/v3/projects/ba2fbaa883b548b8b72f22d174371189 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:03.445589 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946e24e-d272-4412-acf0-25388dbdc331 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:03.447999 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-5946e24e-d272-4412-acf0-25388dbdc331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:03.459358 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8db92-1ce3-4504-b988-72e931d5e57e tempest-VolumeQuotaClassesTest-1404719445 tempest-VolumeQuotaClassesTest-1404719445-project-admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:03.481612 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b16b5-b251-408b-b7cb-b42213470e68 tempest-VolumeQuotaClassesTest-1404719445 tempest-VolumeQuotaClassesTest-1404719445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d48afef1c7543a6bc00c23e717ff08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd532ad361f2a43f7af8f9eed68d313f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:03.482327 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b16b5-b251-408b-b7cb-b42213470e68 tempest-VolumeQuotaClassesTest-1404719445 tempest-VolumeQuotaClassesTest-1404719445-project-admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:03.483453 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b16b5-b251-408b-b7cb-b42213470e68 tempest-VolumeQuotaClassesTest-1404719445 tempest-VolumeQuotaClassesTest-1404719445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:03.484492 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b16b5-b251-408b-b7cb-b42213470e68 tempest-VolumeQuotaClassesTest-1404719445 tempest-VolumeQuotaClassesTest-1404719445-project-admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:03.486138 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b16b5-b251-408b-b7cb-b42213470e68 tempest-VolumeQuotaClassesTest-1404719445 tempest-VolumeQuotaClassesTest-1404719445-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:23:03.488915 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b16b5-b251-408b-b7cb-b42213470e68 tempest-VolumeQuotaClassesTest-1404719445 tempest-VolumeQuotaClassesTest-1404719445-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:03.490995 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12b16b5-b251-408b-b7cb-b42213470e68 tempest-VolumeQuotaClassesTest-1404719445 tempest-VolumeQuotaClassesTest-1404719445-project-admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:03.515785 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 978/1953] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:23:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:23:03.590334 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946e24e-d272-4412-acf0-25388dbdc331 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:03.621878 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b16b5-b251-408b-b7cb-b42213470e68 tempest-VolumeQuotaClassesTest-1404719445 tempest-VolumeQuotaClassesTest-1404719445-project-admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:03.625244 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b12b16b5-b251-408b-b7cb-b42213470e68 tempest-VolumeQuotaClassesTest-1404719445 tempest-VolumeQuotaClassesTest-1404719445-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:03.653416 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b16b5-b251-408b-b7cb-b42213470e68 tempest-VolumeQuotaClassesTest-1404719445 tempest-VolumeQuotaClassesTest-1404719445-project-admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:03.659544 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5204a3a-4cc8-47fa-af37-f4241b9c4b2b tempest-VolumeQuotaClassesTest-1404719445 tempest-VolumeQuotaClassesTest-1404719445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d48afef1c7543a6bc00c23e717ff08a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd532ad361f2a43f7af8f9eed68d313f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:03.660942 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5204a3a-4cc8-47fa-af37-f4241b9c4b2b tempest-VolumeQuotaClassesTest-1404719445 tempest-VolumeQuotaClassesTest-1404719445-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:03.660942 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5204a3a-4cc8-47fa-af37-f4241b9c4b2b tempest-VolumeQuotaClassesTest-1404719445 tempest-VolumeQuotaClassesTest-1404719445-project-admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:03.660942 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5204a3a-4cc8-47fa-af37-f4241b9c4b2b tempest-VolumeQuotaClassesTest-1404719445 tempest-VolumeQuotaClassesTest-1404719445-project-admin] PATH_INFO: `/v3/projects/5befaac8e72e4bed855dd2fc9e17447a` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:03.662288 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5204a3a-4cc8-47fa-af37-f4241b9c4b2b tempest-VolumeQuotaClassesTest-1404719445 tempest-VolumeQuotaClassesTest-1404719445-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5befaac8e72e4bed855dd2fc9e17447a)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:03.664212 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5204a3a-4cc8-47fa-af37-f4241b9c4b2b tempest-VolumeQuotaClassesTest-1404719445 tempest-VolumeQuotaClassesTest-1404719445-project-admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:03.680568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1417c47-7eb7-48c9-b0ff-689c0927b76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:03.681898 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1417c47-7eb7-48c9-b0ff-689c0927b76f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:03.682128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1417c47-7eb7-48c9-b0ff-689c0927b76f admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:03.682469 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1417c47-7eb7-48c9-b0ff-689c0927b76f admin admin] PATH_INFO: `/v3/users/204465b76ede41a7a3825a634ebe4aa3` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:03.687344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1417c47-7eb7-48c9-b0ff-689c0927b76f admin admin] RBAC: Authorizing `identity:delete_user(user_id=204465b76ede41a7a3825a634ebe4aa3)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:03.690939 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1417c47-7eb7-48c9-b0ff-689c0927b76f admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:03.741507 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d5204a3a-4cc8-47fa-af37-f4241b9c4b2b tempest-VolumeQuotaClassesTest-1404719445 tempest-VolumeQuotaClassesTest-1404719445-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5befaac8e72e4bed855dd2fc9e17447a', 'request_id': 'req-d5204a3a-4cc8-47fa-af37-f4241b9c4b2b'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:03.744376 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:03.753569 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d5204a3a-4cc8-47fa-af37-f4241b9c4b2b tempest-VolumeQuotaClassesTest-1404719445 tempest-VolumeQuotaClassesTest-1404719445-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5befaac8e72e4bed855dd2fc9e17447a', 'request_id': 'req-d5204a3a-4cc8-47fa-af37-f4241b9c4b2b'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:03.766634 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d5204a3a-4cc8-47fa-af37-f4241b9c4b2b tempest-VolumeQuotaClassesTest-1404719445 tempest-VolumeQuotaClassesTest-1404719445-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5befaac8e72e4bed855dd2fc9e17447a', 'request_id': 'req-d5204a3a-4cc8-47fa-af37-f4241b9c4b2b'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:03.784927 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-e1417c47-7eb7-48c9-b0ff-689c0927b76f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '204465b76ede41a7a3825a634ebe4aa3'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:03.788245 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d5204a3a-4cc8-47fa-af37-f4241b9c4b2b tempest-VolumeQuotaClassesTest-1404719445 tempest-VolumeQuotaClassesTest-1404719445-project-admin] The token cache is being invalidate because project 5befaac8e72e4bed855dd2fc9e17447a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:23:03.788687 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d5204a3a-4cc8-47fa-af37-f4241b9c4b2b tempest-VolumeQuotaClassesTest-1404719445 tempest-VolumeQuotaClassesTest-1404719445-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:03.789719 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d5204a3a-4cc8-47fa-af37-f4241b9c4b2b tempest-VolumeQuotaClassesTest-1404719445 tempest-VolumeQuotaClassesTest-1404719445-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:03.792719 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 979/1954] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:23:03 2022] DELETE /identity/v3/projects/5befaac8e72e4bed855dd2fc9e17447a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:03.813018 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-e1417c47-7eb7-48c9-b0ff-689c0927b76f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '204465b76ede41a7a3825a634ebe4aa3'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:03.825279 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-e1417c47-7eb7-48c9-b0ff-689c0927b76f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '204465b76ede41a7a3825a634ebe4aa3'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:03.826790 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-e1417c47-7eb7-48c9-b0ff-689c0927b76f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '204465b76ede41a7a3825a634ebe4aa3'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:03.841082 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-e1417c47-7eb7-48c9-b0ff-689c0927b76f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '204465b76ede41a7a3825a634ebe4aa3'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:03.849264 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 976/1955] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:23:03 2022] DELETE /identity/v3/users/204465b76ede41a7a3825a634ebe4aa3 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:04.127723 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5204a3a-4cc8-47fa-af37-f4241b9c4b2b tempest-VolumeQuotaClassesTest-1404719445 tempest-VolumeQuotaClassesTest-1404719445-project-admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:04.130524 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d5204a3a-4cc8-47fa-af37-f4241b9c4b2b tempest-VolumeQuotaClassesTest-1404719445 tempest-VolumeQuotaClassesTest-1404719445-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:04.234227 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5204a3a-4cc8-47fa-af37-f4241b9c4b2b tempest-VolumeQuotaClassesTest-1404719445 tempest-VolumeQuotaClassesTest-1404719445-project-admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:04.318117 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1417c47-7eb7-48c9-b0ff-689c0927b76f admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:04.322664 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-e1417c47-7eb7-48c9-b0ff-689c0927b76f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:04.370395 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:04.400622 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29536abb-74f2-49a1-bc88-839ac4bb8bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:04.401916 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29536abb-74f2-49a1-bc88-839ac4bb8bb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:04.402585 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29536abb-74f2-49a1-bc88-839ac4bb8bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:04.403189 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29536abb-74f2-49a1-bc88-839ac4bb8bb7 admin admin] PATH_INFO: `/v3/users/91de30f218fd4e10a8bcb4362793f9b1` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:04.407961 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29536abb-74f2-49a1-bc88-839ac4bb8bb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91de30f218fd4e10a8bcb4362793f9b1)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:04.413381 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29536abb-74f2-49a1-bc88-839ac4bb8bb7 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:04.485538 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1417c47-7eb7-48c9-b0ff-689c0927b76f admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:04.494864 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077bc23-b378-441f-aaa5-f30c13a0b914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:04.498614 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077bc23-b378-441f-aaa5-f30c13a0b914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:04.499094 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077bc23-b378-441f-aaa5-f30c13a0b914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:04.499571 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077bc23-b378-441f-aaa5-f30c13a0b914 admin admin] PATH_INFO: `/v3/projects/38c62c447e784146af56dc7fc431a5ce` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:04.502291 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d077bc23-b378-441f-aaa5-f30c13a0b914 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38c62c447e784146af56dc7fc431a5ce)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:04.506416 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d077bc23-b378-441f-aaa5-f30c13a0b914 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:04.529839 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-29536abb-74f2-49a1-bc88-839ac4bb8bb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91de30f218fd4e10a8bcb4362793f9b1'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:04.548208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-29536abb-74f2-49a1-bc88-839ac4bb8bb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91de30f218fd4e10a8bcb4362793f9b1'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:04.580003 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-29536abb-74f2-49a1-bc88-839ac4bb8bb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91de30f218fd4e10a8bcb4362793f9b1'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:04.583680 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-29536abb-74f2-49a1-bc88-839ac4bb8bb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91de30f218fd4e10a8bcb4362793f9b1'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:04.602434 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-29536abb-74f2-49a1-bc88-839ac4bb8bb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91de30f218fd4e10a8bcb4362793f9b1'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:04.630189 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 980/1956] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:23:04 2022] DELETE /identity/v3/users/91de30f218fd4e10a8bcb4362793f9b1 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:04.633536 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0745a-dad3-4794-b31f-efc5e5ea50c3 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:04.634535 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0745a-dad3-4794-b31f-efc5e5ea50c3 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:04.635081 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b0745a-dad3-4794-b31f-efc5e5ea50c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:04.663543 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:04.664291 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-d077bc23-b378-441f-aaa5-f30c13a0b914 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38c62c447e784146af56dc7fc431a5ce', 'request_id': 'req-d077bc23-b378-441f-aaa5-f30c13a0b914'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:04.682167 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-d077bc23-b378-441f-aaa5-f30c13a0b914 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38c62c447e784146af56dc7fc431a5ce', 'request_id': 'req-d077bc23-b378-441f-aaa5-f30c13a0b914'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:04.688896 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-40b0745a-dad3-4794-b31f-efc5e5ea50c3 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:04.695379 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-40b0745a-dad3-4794-b31f-efc5e5ea50c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:04.707058 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-d077bc23-b378-441f-aaa5-f30c13a0b914 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38c62c447e784146af56dc7fc431a5ce', 'request_id': 'req-d077bc23-b378-441f-aaa5-f30c13a0b914'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:04.734057 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-d077bc23-b378-441f-aaa5-f30c13a0b914 admin admin] The token cache is being invalidate because project 38c62c447e784146af56dc7fc431a5ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:23:04.734589 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-d077bc23-b378-441f-aaa5-f30c13a0b914 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:04.735644 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-d077bc23-b378-441f-aaa5-f30c13a0b914 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:04.738437 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 977/1957] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:23:04 2022] DELETE /identity/v3/projects/38c62c447e784146af56dc7fc431a5ce => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:04.744275 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077bc23-b378-441f-aaa5-f30c13a0b914 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:04.748586 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-d077bc23-b378-441f-aaa5-f30c13a0b914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:04.823792 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 981/1958] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:23:04.835160 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0745a-dad3-4794-b31f-efc5e5ea50c3 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:04.839439 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-40b0745a-dad3-4794-b31f-efc5e5ea50c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:04.874682 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077bc23-b378-441f-aaa5-f30c13a0b914 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:04.883094 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27406e90-9318-4a40-98b0-cb9eee663962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:04.884184 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27406e90-9318-4a40-98b0-cb9eee663962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:04.885229 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27406e90-9318-4a40-98b0-cb9eee663962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:04.885982 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27406e90-9318-4a40-98b0-cb9eee663962 admin admin] PATH_INFO: `/v3/users/84901fbcf9a1488ea35b170eedd1cd72` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:04.887829 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27406e90-9318-4a40-98b0-cb9eee663962 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84901fbcf9a1488ea35b170eedd1cd72)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:04.890460 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27406e90-9318-4a40-98b0-cb9eee663962 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:04.992009 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-27406e90-9318-4a40-98b0-cb9eee663962 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84901fbcf9a1488ea35b170eedd1cd72'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:04.995400 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:05.003073 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b0745a-dad3-4794-b31f-efc5e5ea50c3 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:05.009626 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7369f3-c645-46b1-84c9-f53e6f90bed8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:05.021073 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7369f3-c645-46b1-84c9-f53e6f90bed8 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:05.021815 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7369f3-c645-46b1-84c9-f53e6f90bed8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:05.022293 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7369f3-c645-46b1-84c9-f53e6f90bed8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:05.023285 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-27406e90-9318-4a40-98b0-cb9eee663962 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84901fbcf9a1488ea35b170eedd1cd72'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:05.050551 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-27406e90-9318-4a40-98b0-cb9eee663962 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84901fbcf9a1488ea35b170eedd1cd72'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:05.052399 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-27406e90-9318-4a40-98b0-cb9eee663962 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84901fbcf9a1488ea35b170eedd1cd72'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:05.053058 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7369f3-c645-46b1-84c9-f53e6f90bed8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:05.056805 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7369f3-c645-46b1-84c9-f53e6f90bed8 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:05.071144 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-27406e90-9318-4a40-98b0-cb9eee663962 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84901fbcf9a1488ea35b170eedd1cd72'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:05.076388 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 982/1959] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:23:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:23:05.081303 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 978/1960] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:23:04 2022] DELETE /identity/v3/users/84901fbcf9a1488ea35b170eedd1cd72 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:23:05.607225 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7369f3-c645-46b1-84c9-f53e6f90bed8 service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:05.628584 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7369f3-c645-46b1-84c9-f53e6f90bed8 service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:05.705164 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27406e90-9318-4a40-98b0-cb9eee663962 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:05.708178 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-27406e90-9318-4a40-98b0-cb9eee663962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:05.787984 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0622334b-05f6-4110-b9bd-3bac12dafaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:05.789903 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622334b-05f6-4110-b9bd-3bac12dafaad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:05.790965 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622334b-05f6-4110-b9bd-3bac12dafaad admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:05.791430 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622334b-05f6-4110-b9bd-3bac12dafaad admin admin] PATH_INFO: `/v3/projects/b1b2a1fd9bf04bd29e4bed991320349e` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:05.793654 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0622334b-05f6-4110-b9bd-3bac12dafaad admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1b2a1fd9bf04bd29e4bed991320349e)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:05.797403 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0622334b-05f6-4110-b9bd-3bac12dafaad admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:05.879943 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27406e90-9318-4a40-98b0-cb9eee663962 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:05.895310 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0622334b-05f6-4110-b9bd-3bac12dafaad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1b2a1fd9bf04bd29e4bed991320349e', 'request_id': 'req-0622334b-05f6-4110-b9bd-3bac12dafaad'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:05.900580 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:05.908664 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0622334b-05f6-4110-b9bd-3bac12dafaad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1b2a1fd9bf04bd29e4bed991320349e', 'request_id': 'req-0622334b-05f6-4110-b9bd-3bac12dafaad'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:05.921837 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0622334b-05f6-4110-b9bd-3bac12dafaad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1b2a1fd9bf04bd29e4bed991320349e', 'request_id': 'req-0622334b-05f6-4110-b9bd-3bac12dafaad'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:05.949969 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0622334b-05f6-4110-b9bd-3bac12dafaad admin admin] The token cache is being invalidate because project b1b2a1fd9bf04bd29e4bed991320349e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:23:05.949969 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0622334b-05f6-4110-b9bd-3bac12dafaad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:05.949969 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0622334b-05f6-4110-b9bd-3bac12dafaad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:05.952132 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 983/1961] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:23:05 2022] DELETE /identity/v3/projects/b1b2a1fd9bf04bd29e4bed991320349e => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:05.966786 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa939c9-8e45-4de5-a447-ee62aa4536bc None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:05.967142 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa939c9-8e45-4de5-a447-ee62aa4536bc None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:05.967509 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa939c9-8e45-4de5-a447-ee62aa4536bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:06.038946 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4bbfb-07a7-40ca-a94e-34638b4bd736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:06.039802 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4bbfb-07a7-40ca-a94e-34638b4bd736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:06.040216 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4bbfb-07a7-40ca-a94e-34638b4bd736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:06.040598 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4bbfb-07a7-40ca-a94e-34638b4bd736 admin admin] PATH_INFO: `/v3/projects/ed41c39c5f644344b8192ddd20803b6c` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:06.048318 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4bbfb-07a7-40ca-a94e-34638b4bd736 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed41c39c5f644344b8192ddd20803b6c)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:06.049908 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-caa939c9-8e45-4de5-a447-ee62aa4536bc None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:06.052334 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-caa939c9-8e45-4de5-a447-ee62aa4536bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:06.053471 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4bbfb-07a7-40ca-a94e-34638b4bd736 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:06.072859 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 984/1962] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:23:06.082192 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbffc38-c14f-433e-8f65-a0b446ca5d80 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:06.085058 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbffc38-c14f-433e-8f65-a0b446ca5d80 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:06.085058 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbffc38-c14f-433e-8f65-a0b446ca5d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:06.125921 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-dbbffc38-c14f-433e-8f65-a0b446ca5d80 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:06.127687 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-dbbffc38-c14f-433e-8f65-a0b446ca5d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:06.145696 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 985/1963] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:23:06.157314 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbffc38-c14f-433e-8f65-a0b446ca5d80 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:06.180150 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbffc38-c14f-433e-8f65-a0b446ca5d80 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:06.197955 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-38b4bbfb-07a7-40ca-a94e-34638b4bd736 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed41c39c5f644344b8192ddd20803b6c', 'request_id': 'req-38b4bbfb-07a7-40ca-a94e-34638b4bd736'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:06.213260 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-38b4bbfb-07a7-40ca-a94e-34638b4bd736 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed41c39c5f644344b8192ddd20803b6c', 'request_id': 'req-38b4bbfb-07a7-40ca-a94e-34638b4bd736'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:06.224837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-38b4bbfb-07a7-40ca-a94e-34638b4bd736 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed41c39c5f644344b8192ddd20803b6c', 'request_id': 'req-38b4bbfb-07a7-40ca-a94e-34638b4bd736'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:06.281612 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-38b4bbfb-07a7-40ca-a94e-34638b4bd736 admin admin] The token cache is being invalidate because project ed41c39c5f644344b8192ddd20803b6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:23:06.282156 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-38b4bbfb-07a7-40ca-a94e-34638b4bd736 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:06.285942 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-38b4bbfb-07a7-40ca-a94e-34638b4bd736 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:06.288955 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbd37b-ee03-459c-82c0-cdc5681de1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:06.291328 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbd37b-ee03-459c-82c0-cdc5681de1b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:06.291832 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbd37b-ee03-459c-82c0-cdc5681de1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:06.294896 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbd37b-ee03-459c-82c0-cdc5681de1b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:06.296007 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febbd37b-ee03-459c-82c0-cdc5681de1b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:23:06.296654 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febbd37b-ee03-459c-82c0-cdc5681de1b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:06.298784 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febbd37b-ee03-459c-82c0-cdc5681de1b8 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:06.310931 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 979/1964] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:23:05 2022] DELETE /identity/v3/projects/ed41c39c5f644344b8192ddd20803b6c => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:06.313808 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4bbfb-07a7-40ca-a94e-34638b4bd736 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:06.316163 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 986/1965] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:23:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:23:06.323510 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbd37b-ee03-459c-82c0-cdc5681de1b8 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:06.325965 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-febbd37b-ee03-459c-82c0-cdc5681de1b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:06.327986 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-38b4bbfb-07a7-40ca-a94e-34638b4bd736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:06.344089 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbd37b-ee03-459c-82c0-cdc5681de1b8 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:06.353527 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf4f5c-5dde-4adb-9940-89898aa72250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:06.357872 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf4f5c-5dde-4adb-9940-89898aa72250 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:06.358398 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf4f5c-5dde-4adb-9940-89898aa72250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:06.358885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf4f5c-5dde-4adb-9940-89898aa72250 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:06.360082 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf4f5c-5dde-4adb-9940-89898aa72250 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:06.362042 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:06.364787 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcf4f5c-5dde-4adb-9940-89898aa72250 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:06.370067 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4bbfb-07a7-40ca-a94e-34638b4bd736 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:06.384601 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36d257-6377-4caa-be0b-4dd41faee464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:06.386808 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36d257-6377-4caa-be0b-4dd41faee464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:06.387408 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36d257-6377-4caa-be0b-4dd41faee464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:06.387915 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36d257-6377-4caa-be0b-4dd41faee464 admin admin] PATH_INFO: `/v3/users/2d48afef1c7543a6bc00c23e717ff08a` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:06.392227 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f36d257-6377-4caa-be0b-4dd41faee464 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d48afef1c7543a6bc00c23e717ff08a)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:06.397077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f36d257-6377-4caa-be0b-4dd41faee464 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:06.438470 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 987/1966] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:23:06 2022] POST /identity/v3/projects => generated 389 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:23:06.440014 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf4f5c-5dde-4adb-9940-89898aa72250 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:06.563497 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-6f36d257-6377-4caa-be0b-4dd41faee464 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d48afef1c7543a6bc00c23e717ff08a'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:06.642707 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-6f36d257-6377-4caa-be0b-4dd41faee464 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d48afef1c7543a6bc00c23e717ff08a'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:06.676844 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf4f5c-5dde-4adb-9940-89898aa72250 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:06.688451 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-6f36d257-6377-4caa-be0b-4dd41faee464 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d48afef1c7543a6bc00c23e717ff08a'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:06.690743 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-6f36d257-6377-4caa-be0b-4dd41faee464 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d48afef1c7543a6bc00c23e717ff08a'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:06.697162 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70577ea2-f386-4c68-a90e-5525e12761c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:06.699171 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70577ea2-f386-4c68-a90e-5525e12761c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:06.700103 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70577ea2-f386-4c68-a90e-5525e12761c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:06.700955 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70577ea2-f386-4c68-a90e-5525e12761c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:06.702594 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70577ea2-f386-4c68-a90e-5525e12761c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:06.708247 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70577ea2-f386-4c68-a90e-5525e12761c1 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:06.717529 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-6f36d257-6377-4caa-be0b-4dd41faee464 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d48afef1c7543a6bc00c23e717ff08a'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:06.753764 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 980/1967] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:23:06 2022] DELETE /identity/v3/users/2d48afef1c7543a6bc00c23e717ff08a => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:06.818821 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36d257-6377-4caa-be0b-4dd41faee464 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:06.822730 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-6f36d257-6377-4caa-be0b-4dd41faee464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:06.824490 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 988/1968] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:23:06 2022] POST /identity/v3/users => generated 295 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:23:06.980671 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36d257-6377-4caa-be0b-4dd41faee464 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:06.989230 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e73447-9799-422e-adae-58e8613dc244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:06.990345 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e73447-9799-422e-adae-58e8613dc244 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:06.990948 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e73447-9799-422e-adae-58e8613dc244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:06.991446 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e73447-9799-422e-adae-58e8613dc244 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:06.992712 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e73447-9799-422e-adae-58e8613dc244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:06.996328 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e73447-9799-422e-adae-58e8613dc244 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:07.019102 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 981/1969] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:23:07.025820 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70577ea2-f386-4c68-a90e-5525e12761c1 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:07.047379 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70577ea2-f386-4c68-a90e-5525e12761c1 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:07.057295 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7d12a-af30-4ede-8d11-cf7881cf21a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:07.058133 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7d12a-af30-4ede-8d11-cf7881cf21a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:07.058769 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7d12a-af30-4ede-8d11-cf7881cf21a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:07.063299 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7d12a-af30-4ede-8d11-cf7881cf21a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:07.063299 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7d12a-af30-4ede-8d11-cf7881cf21a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:07.063739 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7d12a-af30-4ede-8d11-cf7881cf21a8 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:07.091687 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 989/1970] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:23:07.098252 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e73447-9799-422e-adae-58e8613dc244 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:07.129889 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e73447-9799-422e-adae-58e8613dc244 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:07.159302 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832332c0-7f1e-4f49-bfdc-fba6ba9bba38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:07.160424 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832332c0-7f1e-4f49-bfdc-fba6ba9bba38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:07.160907 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832332c0-7f1e-4f49-bfdc-fba6ba9bba38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:07.161410 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832332c0-7f1e-4f49-bfdc-fba6ba9bba38 admin admin] PATH_INFO: `/v3/projects/576355ecea1541a4abade18e53862d7f/users/da2a546ea33f4cb9ac2f4db8fbca896b/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:07.197967 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832332c0-7f1e-4f49-bfdc-fba6ba9bba38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=576355ecea1541a4abade18e53862d7f, user_id=da2a546ea33f4cb9ac2f4db8fbca896b, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:07.204587 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832332c0-7f1e-4f49-bfdc-fba6ba9bba38 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:07.237023 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 982/1971] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:23:07 2022] PUT /identity/v3/projects/576355ecea1541a4abade18e53862d7f/users/da2a546ea33f4cb9ac2f4db8fbca896b/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:07.258071 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3009a6-56bd-4ee7-adf8-89bad979e682 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:07.259918 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3009a6-56bd-4ee7-adf8-89bad979e682 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:07.260403 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3009a6-56bd-4ee7-adf8-89bad979e682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:07.315632 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-ea3009a6-56bd-4ee7-adf8-89bad979e682 None None] MFA Rules not processed for user `da2a546ea33f4cb9ac2f4db8fbca896b`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:07.317854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ea3009a6-56bd-4ee7-adf8-89bad979e682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:07.325722 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:07.360127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832332c0-7f1e-4f49-bfdc-fba6ba9bba38 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:07.362971 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-832332c0-7f1e-4f49-bfdc-fba6ba9bba38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:07.466643 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 990/1972] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:07 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:23:07.476622 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3009a6-56bd-4ee7-adf8-89bad979e682 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:07.525959 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:07.575297 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832332c0-7f1e-4f49-bfdc-fba6ba9bba38 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:07.588372 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d45be-41ec-49e3-a358-e61161c4dfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:07.589390 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d45be-41ec-49e3-a358-e61161c4dfa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:07.589837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d45be-41ec-49e3-a358-e61161c4dfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:07.590276 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d45be-41ec-49e3-a358-e61161c4dfa4 admin admin] PATH_INFO: `/v3/projects/d532ad361f2a43f7af8f9eed68d313f7` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:07.594597 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d45be-41ec-49e3-a358-e61161c4dfa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d532ad361f2a43f7af8f9eed68d313f7)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:07.596405 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d45be-41ec-49e3-a358-e61161c4dfa4 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:07.651233 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3009a6-56bd-4ee7-adf8-89bad979e682 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:07.659388 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b675b8f-67c9-40ef-8775-870ba948c55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:07.660885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b675b8f-67c9-40ef-8775-870ba948c55a admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:07.661596 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b675b8f-67c9-40ef-8775-870ba948c55a admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:07.662327 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b675b8f-67c9-40ef-8775-870ba948c55a admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:07.663849 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b675b8f-67c9-40ef-8775-870ba948c55a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:07.668706 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b675b8f-67c9-40ef-8775-870ba948c55a admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:07.722457 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-7c7d45be-41ec-49e3-a358-e61161c4dfa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd532ad361f2a43f7af8f9eed68d313f7', 'request_id': 'req-7c7d45be-41ec-49e3-a358-e61161c4dfa4'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:07.740506 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-7c7d45be-41ec-49e3-a358-e61161c4dfa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd532ad361f2a43f7af8f9eed68d313f7', 'request_id': 'req-7c7d45be-41ec-49e3-a358-e61161c4dfa4'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:07.751785 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 991/1973] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:23:07 2022] POST /identity/v3/projects => generated 387 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:23:07.754878 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b675b8f-67c9-40ef-8775-870ba948c55a admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:07.755363 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-7c7d45be-41ec-49e3-a358-e61161c4dfa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd532ad361f2a43f7af8f9eed68d313f7', 'request_id': 'req-7c7d45be-41ec-49e3-a358-e61161c4dfa4'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:07.789939 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-7c7d45be-41ec-49e3-a358-e61161c4dfa4 admin admin] The token cache is being invalidate because project d532ad361f2a43f7af8f9eed68d313f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:23:07.791133 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-7c7d45be-41ec-49e3-a358-e61161c4dfa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:07.792573 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-7c7d45be-41ec-49e3-a358-e61161c4dfa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:07.796967 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 983/1974] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:23:07 2022] DELETE /identity/v3/projects/d532ad361f2a43f7af8f9eed68d313f7 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:07.808191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffafb58-7ecd-49a1-9810-d68b5883186c None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:07.808895 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffafb58-7ecd-49a1-9810-d68b5883186c None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:07.809370 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffafb58-7ecd-49a1-9810-d68b5883186c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:07.854226 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-8ffafb58-7ecd-49a1-9810-d68b5883186c None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:07.855539 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-8ffafb58-7ecd-49a1-9810-d68b5883186c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:08.003629 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 984/1975] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:23:08.008160 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6455f-6f07-4e09-9fa0-5ffeaf3502b2 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:08.010480 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6455f-6f07-4e09-9fa0-5ffeaf3502b2 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:08.013279 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc6455f-6f07-4e09-9fa0-5ffeaf3502b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:08.039131 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b675b8f-67c9-40ef-8775-870ba948c55a admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:08.045263 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe68d52-1273-466e-99ab-476b421e647f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:08.045893 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe68d52-1273-466e-99ab-476b421e647f admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:08.046179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe68d52-1273-466e-99ab-476b421e647f admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:08.046494 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe68d52-1273-466e-99ab-476b421e647f admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:08.047147 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe68d52-1273-466e-99ab-476b421e647f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:08.049159 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe68d52-1273-466e-99ab-476b421e647f admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:08.066926 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-ddc6455f-6f07-4e09-9fa0-5ffeaf3502b2 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:08.068030 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-ddc6455f-6f07-4e09-9fa0-5ffeaf3502b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:08.091547 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 985/1976] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:23:08.094861 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc6455f-6f07-4e09-9fa0-5ffeaf3502b2 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:08.095107 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 992/1977] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:23:07 2022] POST /identity/v3/users => generated 300 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:23:08.096540 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe68d52-1273-466e-99ab-476b421e647f admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:08.099127 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-3fe68d52-1273-466e-99ab-476b421e647f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:08.107099 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc6455f-6f07-4e09-9fa0-5ffeaf3502b2 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:08.118080 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c16735-e8d9-48cd-b11e-8eede8623f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:08.119307 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c16735-e8d9-48cd-b11e-8eede8623f30 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:08.119589 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c16735-e8d9-48cd-b11e-8eede8623f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:08.119961 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c16735-e8d9-48cd-b11e-8eede8623f30 admin admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:08.120617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c16735-e8d9-48cd-b11e-8eede8623f30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:23:08.121120 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c16735-e8d9-48cd-b11e-8eede8623f30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:08.122874 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c16735-e8d9-48cd-b11e-8eede8623f30 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:08.123065 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe68d52-1273-466e-99ab-476b421e647f admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:08.130661 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94984a7-fb0f-4f91-ac05-33270dd1e308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:08.131527 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94984a7-fb0f-4f91-ac05-33270dd1e308 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:08.131950 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94984a7-fb0f-4f91-ac05-33270dd1e308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:08.132322 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94984a7-fb0f-4f91-ac05-33270dd1e308 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:08.133123 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94984a7-fb0f-4f91-ac05-33270dd1e308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:08.135766 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94984a7-fb0f-4f91-ac05-33270dd1e308 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:08.148256 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 986/1978] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:23:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:23:08.154950 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c16735-e8d9-48cd-b11e-8eede8623f30 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:08.158460 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 993/1979] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:23:08 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:23:08.159755 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94984a7-fb0f-4f91-ac05-33270dd1e308 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:08.175078 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94984a7-fb0f-4f91-ac05-33270dd1e308 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:08.179666 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c16735-e8d9-48cd-b11e-8eede8623f30 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:08.183014 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf82d33-d345-42c4-96ba-5e801ca4f796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:08.184005 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf82d33-d345-42c4-96ba-5e801ca4f796 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:08.184415 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf82d33-d345-42c4-96ba-5e801ca4f796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:08.184798 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf82d33-d345-42c4-96ba-5e801ca4f796 admin admin] PATH_INFO: `/v3/projects/4cb49541e5dc46cba9b1011e73c96734/users/b7c1c4a5b96c4d40a3984cb9e4eb4fe6/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:08.195975 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:08.199997 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757673a-2ab1-4b02-be6d-565b09981c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:08.201509 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757673a-2ab1-4b02-be6d-565b09981c6b admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:08.201874 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757673a-2ab1-4b02-be6d-565b09981c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:08.202501 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757673a-2ab1-4b02-be6d-565b09981c6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:08.203383 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757673a-2ab1-4b02-be6d-565b09981c6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:08.211488 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757673a-2ab1-4b02-be6d-565b09981c6b admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:08.226084 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf82d33-d345-42c4-96ba-5e801ca4f796 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cb49541e5dc46cba9b1011e73c96734, user_id=b7c1c4a5b96c4d40a3984cb9e4eb4fe6, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:08.231179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf82d33-d345-42c4-96ba-5e801ca4f796 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:08.265614 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 994/1980] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:23:08 2022] PUT /identity/v3/projects/4cb49541e5dc46cba9b1011e73c96734/users/b7c1c4a5b96c4d40a3984cb9e4eb4fe6/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:08.270555 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf82d33-d345-42c4-96ba-5e801ca4f796 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:08.295076 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 987/1981] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:23:08 2022] POST /identity/v3/projects => generated 373 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:23:08.300791 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757673a-2ab1-4b02-be6d-565b09981c6b admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:08.413864 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:08.424187 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf82d33-d345-42c4-96ba-5e801ca4f796 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:08.463184 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757673a-2ab1-4b02-be6d-565b09981c6b admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:08.471112 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85636aad-5edd-4915-baa1-a898133f6e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:08.472643 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85636aad-5edd-4915-baa1-a898133f6e18 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:08.473124 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85636aad-5edd-4915-baa1-a898133f6e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:08.473582 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85636aad-5edd-4915-baa1-a898133f6e18 admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:08.474789 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85636aad-5edd-4915-baa1-a898133f6e18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:08.479011 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85636aad-5edd-4915-baa1-a898133f6e18 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:08.522603 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 988/1982] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:23:08 2022] POST /identity/v3/users => generated 287 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:23:08.530031 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85636aad-5edd-4915-baa1-a898133f6e18 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:08.548129 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85636aad-5edd-4915-baa1-a898133f6e18 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:08.557682 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe9589-268e-4bed-b3d7-5ae78ded504c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:08.558672 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe9589-268e-4bed-b3d7-5ae78ded504c admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:08.559155 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe9589-268e-4bed-b3d7-5ae78ded504c admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:08.559566 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe9589-268e-4bed-b3d7-5ae78ded504c admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:08.560767 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fe9589-268e-4bed-b3d7-5ae78ded504c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:08.563667 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6e60b-3572-4bbe-b9b8-4ee3c1262b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:08.564218 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fe9589-268e-4bed-b3d7-5ae78ded504c admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:08.565276 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6e60b-3572-4bbe-b9b8-4ee3c1262b82 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:08.565954 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6e60b-3572-4bbe-b9b8-4ee3c1262b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:08.566806 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6e60b-3572-4bbe-b9b8-4ee3c1262b82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:08.568217 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb6e60b-3572-4bbe-b9b8-4ee3c1262b82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:08.572281 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb6e60b-3572-4bbe-b9b8-4ee3c1262b82 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:08.590615 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 989/1983] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:23:08 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:23:08.599545 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe9589-268e-4bed-b3d7-5ae78ded504c admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:08.602629 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 995/1984] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:23:08 2022] GET /identity/v3/roles => generated 1420 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:23:08.603961 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6e60b-3572-4bbe-b9b8-4ee3c1262b82 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:08.619372 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6e60b-3572-4bbe-b9b8-4ee3c1262b82 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:08.624257 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe9589-268e-4bed-b3d7-5ae78ded504c admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:08.626199 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1a79a-2803-4acd-9571-d22ed987941f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:08.627389 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1a79a-2803-4acd-9571-d22ed987941f admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:08.627806 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1a79a-2803-4acd-9571-d22ed987941f admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:08.628233 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1a79a-2803-4acd-9571-d22ed987941f admin admin] PATH_INFO: `/v3/projects/4cb49541e5dc46cba9b1011e73c96734/users/b7c1c4a5b96c4d40a3984cb9e4eb4fe6/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:08.636221 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1a79a-2803-4acd-9571-d22ed987941f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cb49541e5dc46cba9b1011e73c96734, user_id=b7c1c4a5b96c4d40a3984cb9e4eb4fe6, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:08.639624 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1a79a-2803-4acd-9571-d22ed987941f admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:08.641040 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373c7bc-d4d2-414c-b334-e36345028bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:08.642482 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373c7bc-d4d2-414c-b334-e36345028bfe admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:08.643445 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373c7bc-d4d2-414c-b334-e36345028bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:08.644012 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373c7bc-d4d2-414c-b334-e36345028bfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:08.645385 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4373c7bc-d4d2-414c-b334-e36345028bfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:08.649125 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4373c7bc-d4d2-414c-b334-e36345028bfe admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:08.654820 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 996/1985] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:23:08 2022] PUT /identity/v3/projects/4cb49541e5dc46cba9b1011e73c96734/users/b7c1c4a5b96c4d40a3984cb9e4eb4fe6/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:08.668199 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10b440-278d-4cdb-97c8-a4dfa2d50a7b None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:08.668665 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10b440-278d-4cdb-97c8-a4dfa2d50a7b None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:08.669213 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10b440-278d-4cdb-97c8-a4dfa2d50a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:08.677162 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 990/1986] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:23:08 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:23:08.679582 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373c7bc-d4d2-414c-b334-e36345028bfe admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:08.700674 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373c7bc-d4d2-414c-b334-e36345028bfe admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:08.725444 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-7d10b440-278d-4cdb-97c8-a4dfa2d50a7b None None] MFA Rules not processed for user `b7c1c4a5b96c4d40a3984cb9e4eb4fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:08.727758 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7d10b440-278d-4cdb-97c8-a4dfa2d50a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:08.866859 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28a1c2-3edc-464d-a4f8-a601a86327c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:08.871647 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28a1c2-3edc-464d-a4f8-a601a86327c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:08.872140 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28a1c2-3edc-464d-a4f8-a601a86327c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:08.872494 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28a1c2-3edc-464d-a4f8-a601a86327c8 admin admin] PATH_INFO: `/v3/projects/0172d122c2884bc0876182726c7b7b43/users/ef19a0adc3a7479b8d5ba7725be618a2/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:08.873902 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:08.883257 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 997/1987] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:08 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:23:08.926381 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28a1c2-3edc-464d-a4f8-a601a86327c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0172d122c2884bc0876182726c7b7b43, user_id=ef19a0adc3a7479b8d5ba7725be618a2, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:08.927170 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10b440-278d-4cdb-97c8-a4dfa2d50a7b None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:08.930933 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7d10b440-278d-4cdb-97c8-a4dfa2d50a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:08.933656 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28a1c2-3edc-464d-a4f8-a601a86327c8 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:08.976933 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 991/1988] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:23:08 2022] PUT /identity/v3/projects/0172d122c2884bc0876182726c7b7b43/users/ef19a0adc3a7479b8d5ba7725be618a2/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:09.000414 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4947191-1d93-45fb-b824-8b959ddfecb7 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:09.001028 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4947191-1d93-45fb-b824-8b959ddfecb7 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:09.002978 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4947191-1d93-45fb-b824-8b959ddfecb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:09.065706 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10b440-278d-4cdb-97c8-a4dfa2d50a7b None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:09.173229 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-e4947191-1d93-45fb-b824-8b959ddfecb7 None None] MFA Rules not processed for user `ef19a0adc3a7479b8d5ba7725be618a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:09.176486 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-e4947191-1d93-45fb-b824-8b959ddfecb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:09.210576 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb9214f-ad70-487b-9685-a20fa8ebaee2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:09.212148 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb9214f-ad70-487b-9685-a20fa8ebaee2 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:09.212889 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb9214f-ad70-487b-9685-a20fa8ebaee2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:09.213570 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb9214f-ad70-487b-9685-a20fa8ebaee2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:09.406171 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb9214f-ad70-487b-9685-a20fa8ebaee2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:09.407648 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb9214f-ad70-487b-9685-a20fa8ebaee2 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:09.422504 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 998/1989] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:23:08 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:23:09.469022 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 992/1990] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:23:09.494428 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb9214f-ad70-487b-9685-a20fa8ebaee2 service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:09.496333 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-8eb9214f-ad70-487b-9685-a20fa8ebaee2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:09.527604 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb9214f-ad70-487b-9685-a20fa8ebaee2 service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:09.543585 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a818a-45f1-4863-8445-5e43a014ac14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:09.545434 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a818a-45f1-4863-8445-5e43a014ac14 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:09.545740 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a818a-45f1-4863-8445-5e43a014ac14 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:09.546658 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a818a-45f1-4863-8445-5e43a014ac14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:09.565993 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a818a-45f1-4863-8445-5e43a014ac14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:09.567873 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a818a-45f1-4863-8445-5e43a014ac14 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:09.598065 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 999/1991] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:23:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:23:10.096152 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4947191-1d93-45fb-b824-8b959ddfecb7 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:10.161193 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:10.294223 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4947191-1d93-45fb-b824-8b959ddfecb7 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:10.309822 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932df22-0c26-4b26-8f90-bafd5ff1e36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:10.310957 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932df22-0c26-4b26-8f90-bafd5ff1e36c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:10.311309 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932df22-0c26-4b26-8f90-bafd5ff1e36c admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:10.311911 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932df22-0c26-4b26-8f90-bafd5ff1e36c admin admin] PATH_INFO: `/v3/users/da2a546ea33f4cb9ac2f4db8fbca896b` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:10.314255 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0932df22-0c26-4b26-8f90-bafd5ff1e36c admin admin] RBAC: Authorizing `identity:delete_user(user_id=da2a546ea33f4cb9ac2f4db8fbca896b)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:10.316493 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0932df22-0c26-4b26-8f90-bafd5ff1e36c admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:10.436621 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-0932df22-0c26-4b26-8f90-bafd5ff1e36c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da2a546ea33f4cb9ac2f4db8fbca896b'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:10.472408 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-0932df22-0c26-4b26-8f90-bafd5ff1e36c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da2a546ea33f4cb9ac2f4db8fbca896b'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:10.487043 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-0932df22-0c26-4b26-8f90-bafd5ff1e36c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da2a546ea33f4cb9ac2f4db8fbca896b'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:10.487975 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-0932df22-0c26-4b26-8f90-bafd5ff1e36c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da2a546ea33f4cb9ac2f4db8fbca896b'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:10.504461 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-0932df22-0c26-4b26-8f90-bafd5ff1e36c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da2a546ea33f4cb9ac2f4db8fbca896b'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:10.526003 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 993/1992] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:23:10 2022] DELETE /identity/v3/users/da2a546ea33f4cb9ac2f4db8fbca896b => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:10.527472 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62de522-d05f-4358-bae5-0452a5fdf57b None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:10.528273 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62de522-d05f-4358-bae5-0452a5fdf57b None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:10.528273 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62de522-d05f-4358-bae5-0452a5fdf57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:10.583665 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-d62de522-d05f-4358-bae5-0452a5fdf57b None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:10.590340 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d62de522-d05f-4358-bae5-0452a5fdf57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:10.725504 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:10.752411 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1000/1993] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:23:10.776889 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932df22-0c26-4b26-8f90-bafd5ff1e36c admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:10.779682 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-0932df22-0c26-4b26-8f90-bafd5ff1e36c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:10.907514 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932df22-0c26-4b26-8f90-bafd5ff1e36c admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:10.914311 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6764a-ce39-49c3-867c-370c5738938c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:10.918904 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6764a-ce39-49c3-867c-370c5738938c service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:10.919697 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6764a-ce39-49c3-867c-370c5738938c service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:10.921176 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6764a-ce39-49c3-867c-370c5738938c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:10.949377 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6764a-ce39-49c3-867c-370c5738938c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:10.952576 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6764a-ce39-49c3-867c-370c5738938c service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:10.983607 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 994/1994] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:23:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:23:12.189860 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62de522-d05f-4358-bae5-0452a5fdf57b None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:12.192765 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d62de522-d05f-4358-bae5-0452a5fdf57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:12.232311 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62de522-d05f-4358-bae5-0452a5fdf57b None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:12.252042 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0ef27f-91ab-4af6-af6b-e9508cedc33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:12.252042 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ef27f-91ab-4af6-af6b-e9508cedc33d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:12.252042 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ef27f-91ab-4af6-af6b-e9508cedc33d admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:12.252042 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ef27f-91ab-4af6-af6b-e9508cedc33d admin admin] PATH_INFO: `/v3/projects/576355ecea1541a4abade18e53862d7f` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:12.255698 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0ef27f-91ab-4af6-af6b-e9508cedc33d admin admin] RBAC: Authorizing `identity:delete_project(project_id=576355ecea1541a4abade18e53862d7f)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:12.261257 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0ef27f-91ab-4af6-af6b-e9508cedc33d admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:12.445466 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-4c0ef27f-91ab-4af6-af6b-e9508cedc33d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '576355ecea1541a4abade18e53862d7f', 'request_id': 'req-4c0ef27f-91ab-4af6-af6b-e9508cedc33d'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:12.460647 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-4c0ef27f-91ab-4af6-af6b-e9508cedc33d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '576355ecea1541a4abade18e53862d7f', 'request_id': 'req-4c0ef27f-91ab-4af6-af6b-e9508cedc33d'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:12.514672 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-4c0ef27f-91ab-4af6-af6b-e9508cedc33d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '576355ecea1541a4abade18e53862d7f', 'request_id': 'req-4c0ef27f-91ab-4af6-af6b-e9508cedc33d'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:12.558885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-4c0ef27f-91ab-4af6-af6b-e9508cedc33d admin admin] The token cache is being invalidate because project 576355ecea1541a4abade18e53862d7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:23:12.559597 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-4c0ef27f-91ab-4af6-af6b-e9508cedc33d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:12.561076 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-4c0ef27f-91ab-4af6-af6b-e9508cedc33d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:12.570939 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1001/1995] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:23:12 2022] DELETE /identity/v3/projects/576355ecea1541a4abade18e53862d7f => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:12.573191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6764a-ce39-49c3-867c-370c5738938c service neutron] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:12.588620 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6764a-ce39-49c3-867c-370c5738938c service neutron] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:12.730786 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:12.780227 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eafc33-8857-44d0-b0fd-d462c589eca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:12.781181 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eafc33-8857-44d0-b0fd-d462c589eca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:12.781528 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eafc33-8857-44d0-b0fd-d462c589eca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:12.781528 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eafc33-8857-44d0-b0fd-d462c589eca2 admin admin] PATH_INFO: `/v3/users/b7c1c4a5b96c4d40a3984cb9e4eb4fe6` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:12.785780 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eafc33-8857-44d0-b0fd-d462c589eca2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7c1c4a5b96c4d40a3984cb9e4eb4fe6)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:12.787970 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eafc33-8857-44d0-b0fd-d462c589eca2 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:12.912517 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-53eafc33-8857-44d0-b0fd-d462c589eca2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7c1c4a5b96c4d40a3984cb9e4eb4fe6'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:12.965299 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-53eafc33-8857-44d0-b0fd-d462c589eca2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7c1c4a5b96c4d40a3984cb9e4eb4fe6'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:12.980786 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-53eafc33-8857-44d0-b0fd-d462c589eca2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7c1c4a5b96c4d40a3984cb9e4eb4fe6'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:12.986109 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-53eafc33-8857-44d0-b0fd-d462c589eca2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7c1c4a5b96c4d40a3984cb9e4eb4fe6'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:13.003529 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-53eafc33-8857-44d0-b0fd-d462c589eca2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7c1c4a5b96c4d40a3984cb9e4eb4fe6'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:13.022979 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 995/1996] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:23:12 2022] DELETE /identity/v3/users/b7c1c4a5b96c4d40a3984cb9e4eb4fe6 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:13.497637 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0ef27f-91ab-4af6-af6b-e9508cedc33d admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:13.500274 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-4c0ef27f-91ab-4af6-af6b-e9508cedc33d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:13.534602 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0ef27f-91ab-4af6-af6b-e9508cedc33d admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:13.657085 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0321f959-d62a-469a-825b-85f28ef6f507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:13.659079 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321f959-d62a-469a-825b-85f28ef6f507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:13.659630 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321f959-d62a-469a-825b-85f28ef6f507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:13.660301 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321f959-d62a-469a-825b-85f28ef6f507 admin admin] PATH_INFO: `/v3/projects/4cb49541e5dc46cba9b1011e73c96734` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:13.665565 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0321f959-d62a-469a-825b-85f28ef6f507 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cb49541e5dc46cba9b1011e73c96734)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:13.670302 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0321f959-d62a-469a-825b-85f28ef6f507 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:13.763999 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0321f959-d62a-469a-825b-85f28ef6f507 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cb49541e5dc46cba9b1011e73c96734', 'request_id': 'req-0321f959-d62a-469a-825b-85f28ef6f507'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:13.779205 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0321f959-d62a-469a-825b-85f28ef6f507 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cb49541e5dc46cba9b1011e73c96734', 'request_id': 'req-0321f959-d62a-469a-825b-85f28ef6f507'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:13.799158 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0321f959-d62a-469a-825b-85f28ef6f507 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cb49541e5dc46cba9b1011e73c96734', 'request_id': 'req-0321f959-d62a-469a-825b-85f28ef6f507'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:13.828656 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0321f959-d62a-469a-825b-85f28ef6f507 admin admin] The token cache is being invalidate because project 4cb49541e5dc46cba9b1011e73c96734 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:23:13.829171 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0321f959-d62a-469a-825b-85f28ef6f507 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:13.830424 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0321f959-d62a-469a-825b-85f28ef6f507 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:13.835325 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1002/1997] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:23:13 2022] DELETE /identity/v3/projects/4cb49541e5dc46cba9b1011e73c96734 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:23:13.839145 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d789441-3268-40a5-81d0-c023cbb5fcd8 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:13.839939 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d789441-3268-40a5-81d0-c023cbb5fcd8 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:13.840080 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d789441-3268-40a5-81d0-c023cbb5fcd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:13.866244 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-6d789441-3268-40a5-81d0-c023cbb5fcd8 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:13.867867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-6d789441-3268-40a5-81d0-c023cbb5fcd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:14.036022 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 996/1998] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:23:14.057474 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eca528-096f-48bf-a235-35ee12edf8ad None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:14.058243 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eca528-096f-48bf-a235-35ee12edf8ad None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:14.059319 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eca528-096f-48bf-a235-35ee12edf8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:14.124505 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:14.141489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-92eca528-096f-48bf-a235-35ee12edf8ad None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:14.146108 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-92eca528-096f-48bf-a235-35ee12edf8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:14.177237 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1003/1999] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:23:14.183967 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d789441-3268-40a5-81d0-c023cbb5fcd8 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:14.210726 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d789441-3268-40a5-81d0-c023cbb5fcd8 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:14.216326 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703815b9-c8b1-4a06-92f6-3884415ea3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:14.217491 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703815b9-c8b1-4a06-92f6-3884415ea3cc admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:14.218074 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703815b9-c8b1-4a06-92f6-3884415ea3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:14.218573 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703815b9-c8b1-4a06-92f6-3884415ea3cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:14.219759 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703815b9-c8b1-4a06-92f6-3884415ea3cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:23:14.220266 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703815b9-c8b1-4a06-92f6-3884415ea3cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:14.222984 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703815b9-c8b1-4a06-92f6-3884415ea3cc admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:14.244816 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 997/2000] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:23:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:23:14.250891 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eca528-096f-48bf-a235-35ee12edf8ad None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:14.289188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eca528-096f-48bf-a235-35ee12edf8ad None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:14.300646 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb84780-639c-43ba-9dde-97aca7450e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:14.302236 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb84780-639c-43ba-9dde-97aca7450e58 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:14.303296 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb84780-639c-43ba-9dde-97aca7450e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:14.304007 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb84780-639c-43ba-9dde-97aca7450e58 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:14.307295 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb84780-639c-43ba-9dde-97aca7450e58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:14.316106 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb84780-639c-43ba-9dde-97aca7450e58 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:14.321536 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703815b9-c8b1-4a06-92f6-3884415ea3cc admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:14.330755 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-703815b9-c8b1-4a06-92f6-3884415ea3cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:14.369811 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703815b9-c8b1-4a06-92f6-3884415ea3cc admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:14.385711 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adbd8f9-838d-4843-bae9-8f8aaa02415f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:14.387188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbd8f9-838d-4843-bae9-8f8aaa02415f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:14.388441 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbd8f9-838d-4843-bae9-8f8aaa02415f admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:14.388803 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbd8f9-838d-4843-bae9-8f8aaa02415f admin admin] PATH_INFO: `/v3/users/ef19a0adc3a7479b8d5ba7725be618a2` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:14.391455 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adbd8f9-838d-4843-bae9-8f8aaa02415f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef19a0adc3a7479b8d5ba7725be618a2)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:14.396762 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adbd8f9-838d-4843-bae9-8f8aaa02415f admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:14.412894 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1004/2001] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:23:14 2022] POST /identity/v3/projects => generated 379 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:23:14.420454 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb84780-639c-43ba-9dde-97aca7450e58 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:14.537225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:14.553153 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-7adbd8f9-838d-4843-bae9-8f8aaa02415f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef19a0adc3a7479b8d5ba7725be618a2'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:14.606963 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-7adbd8f9-838d-4843-bae9-8f8aaa02415f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef19a0adc3a7479b8d5ba7725be618a2'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:14.630850 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-7adbd8f9-838d-4843-bae9-8f8aaa02415f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef19a0adc3a7479b8d5ba7725be618a2'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:14.633021 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb84780-639c-43ba-9dde-97aca7450e58 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:14.633803 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-7adbd8f9-838d-4843-bae9-8f8aaa02415f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef19a0adc3a7479b8d5ba7725be618a2'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:14.642946 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe5fb0-5c60-41c4-ac21-437b7f3bf322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:14.644693 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe5fb0-5c60-41c4-ac21-437b7f3bf322 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:14.645384 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe5fb0-5c60-41c4-ac21-437b7f3bf322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:14.646038 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe5fb0-5c60-41c4-ac21-437b7f3bf322 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:14.647427 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe5fb0-5c60-41c4-ac21-437b7f3bf322 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:14.652056 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe5fb0-5c60-41c4-ac21-437b7f3bf322 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:14.677320 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-7adbd8f9-838d-4843-bae9-8f8aaa02415f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef19a0adc3a7479b8d5ba7725be618a2'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:14.696879 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1005/2002] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:23:14 2022] POST /identity/v3/users => generated 290 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:23:14.701969 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe5fb0-5c60-41c4-ac21-437b7f3bf322 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:14.705239 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-4afe5fb0-5c60-41c4-ac21-437b7f3bf322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:14.722777 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 998/2003] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:23:14 2022] DELETE /identity/v3/users/ef19a0adc3a7479b8d5ba7725be618a2 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:14.725659 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5740b-cd5c-4219-b262-545b33ea41a0 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:14.726335 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5740b-cd5c-4219-b262-545b33ea41a0 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:14.727071 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5740b-cd5c-4219-b262-545b33ea41a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:14.741492 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe5fb0-5c60-41c4-ac21-437b7f3bf322 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:14.794162 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-efa5740b-cd5c-4219-b262-545b33ea41a0 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:14.798745 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-efa5740b-cd5c-4219-b262-545b33ea41a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:14.968297 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88494aef-28c0-4d8f-8ad5-d9dec7f4d522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:14.969302 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88494aef-28c0-4d8f-8ad5-d9dec7f4d522 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:14.969794 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88494aef-28c0-4d8f-8ad5-d9dec7f4d522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:14.970290 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88494aef-28c0-4d8f-8ad5-d9dec7f4d522 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:14.971661 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88494aef-28c0-4d8f-8ad5-d9dec7f4d522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:14.975281 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88494aef-28c0-4d8f-8ad5-d9dec7f4d522 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:15.007929 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1006/2004] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:23:15.014697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88494aef-28c0-4d8f-8ad5-d9dec7f4d522 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:15.038739 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88494aef-28c0-4d8f-8ad5-d9dec7f4d522 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:15.047443 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd7673-ea59-4b58-b49b-2b35124d9f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:15.048483 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd7673-ea59-4b58-b49b-2b35124d9f64 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:15.048976 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd7673-ea59-4b58-b49b-2b35124d9f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:15.049467 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd7673-ea59-4b58-b49b-2b35124d9f64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:15.050794 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd7673-ea59-4b58-b49b-2b35124d9f64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:15.054152 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd7673-ea59-4b58-b49b-2b35124d9f64 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:15.055966 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 999/2005] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:23:15.079790 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1007/2006] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:23:15.084017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5740b-cd5c-4219-b262-545b33ea41a0 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:15.085619 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd7673-ea59-4b58-b49b-2b35124d9f64 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:15.086460 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-efa5740b-cd5c-4219-b262-545b33ea41a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:15.116504 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd7673-ea59-4b58-b49b-2b35124d9f64 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:15.142078 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678abd9-176c-4b89-af9b-c34072837c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:15.142078 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678abd9-176c-4b89-af9b-c34072837c66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:15.142595 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678abd9-176c-4b89-af9b-c34072837c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:15.142752 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678abd9-176c-4b89-af9b-c34072837c66 admin admin] PATH_INFO: `/v3/projects/496f9aed89df4a82aacdc414bccdf0af/users/5f783765c3d044279f87a26b6e231171/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:15.212897 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a678abd9-176c-4b89-af9b-c34072837c66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=496f9aed89df4a82aacdc414bccdf0af, user_id=5f783765c3d044279f87a26b6e231171, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:15.223489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a678abd9-176c-4b89-af9b-c34072837c66 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:15.274830 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1008/2007] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:23:15 2022] PUT /identity/v3/projects/496f9aed89df4a82aacdc414bccdf0af/users/5f783765c3d044279f87a26b6e231171/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:15.295916 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efdb6b-9ae8-4a62-a014-d5f18deba218 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:15.296576 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efdb6b-9ae8-4a62-a014-d5f18deba218 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:15.298407 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efdb6b-9ae8-4a62-a014-d5f18deba218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:15.325032 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5740b-cd5c-4219-b262-545b33ea41a0 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:15.413392 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-59efdb6b-9ae8-4a62-a014-d5f18deba218 None None] MFA Rules not processed for user `5f783765c3d044279f87a26b6e231171`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:15.416540 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-59efdb6b-9ae8-4a62-a014-d5f18deba218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:15.493570 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac33e3-aa73-4c1a-94e1-d443431a33bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:15.494871 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac33e3-aa73-4c1a-94e1-d443431a33bb service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:15.495378 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac33e3-aa73-4c1a-94e1-d443431a33bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:15.495820 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac33e3-aa73-4c1a-94e1-d443431a33bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:15.504144 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:15.625301 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:15.676666 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1009/2008] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:23:15.684026 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59efdb6b-9ae8-4a62-a014-d5f18deba218 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:15.757479 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac33e3-aa73-4c1a-94e1-d443431a33bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:15.760563 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac33e3-aa73-4c1a-94e1-d443431a33bb service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:15.801237 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1000/2009] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:23:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 718 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:23:15.839085 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59efdb6b-9ae8-4a62-a014-d5f18deba218 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:15.853272 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9697f25c-549b-4e16-ac84-f5a19ae7c3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:15.855503 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9697f25c-549b-4e16-ac84-f5a19ae7c3b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:15.855503 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9697f25c-549b-4e16-ac84-f5a19ae7c3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:15.855983 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9697f25c-549b-4e16-ac84-f5a19ae7c3b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:15.857157 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9697f25c-549b-4e16-ac84-f5a19ae7c3b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:15.860630 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9697f25c-549b-4e16-ac84-f5a19ae7c3b1 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:15.937169 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1010/2010] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:23:15 2022] POST /identity/v3/projects => generated 379 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:23:15.943255 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac33e3-aa73-4c1a-94e1-d443431a33bb service neutron] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:15.966098 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac33e3-aa73-4c1a-94e1-d443431a33bb service neutron] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:16.151302 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62b597-dc46-451f-8d35-365dcb595717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:16.154010 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62b597-dc46-451f-8d35-365dcb595717 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:16.155181 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62b597-dc46-451f-8d35-365dcb595717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:16.156077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f62b597-dc46-451f-8d35-365dcb595717 admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:16.157690 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f62b597-dc46-451f-8d35-365dcb595717 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:16.163044 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f62b597-dc46-451f-8d35-365dcb595717 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:16.233977 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1001/2011] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:23:15 2022] POST /identity/v3/users => generated 290 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:23:16.239402 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9697f25c-549b-4e16-ac84-f5a19ae7c3b1 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:16.258396 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9697f25c-549b-4e16-ac84-f5a19ae7c3b1 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:16.272884 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adea57e-4534-4322-bbb3-fb1412e28dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:16.274698 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adea57e-4534-4322-bbb3-fb1412e28dcb admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:16.274698 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adea57e-4534-4322-bbb3-fb1412e28dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:16.275286 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adea57e-4534-4322-bbb3-fb1412e28dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:16.277106 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adea57e-4534-4322-bbb3-fb1412e28dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:16.280856 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adea57e-4534-4322-bbb3-fb1412e28dcb admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:16.310181 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1011/2012] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:23:16.312749 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62b597-dc46-451f-8d35-365dcb595717 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:16.335313 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f62b597-dc46-451f-8d35-365dcb595717 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:16.348936 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4d35f2-3088-4a5f-af15-fb32bd72d173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:16.350902 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d35f2-3088-4a5f-af15-fb32bd72d173 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:16.351843 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d35f2-3088-4a5f-af15-fb32bd72d173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:16.353207 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d35f2-3088-4a5f-af15-fb32bd72d173 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:16.355447 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4d35f2-3088-4a5f-af15-fb32bd72d173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:16.360468 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4d35f2-3088-4a5f-af15-fb32bd72d173 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:16.399187 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1002/2013] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:23:16.400776 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adea57e-4534-4322-bbb3-fb1412e28dcb admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:16.417272 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adea57e-4534-4322-bbb3-fb1412e28dcb admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:16.426060 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08ef8c-5231-4492-8709-96e421b7adbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:16.427326 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08ef8c-5231-4492-8709-96e421b7adbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:16.427824 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08ef8c-5231-4492-8709-96e421b7adbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:16.428298 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08ef8c-5231-4492-8709-96e421b7adbb admin admin] PATH_INFO: `/v3/projects/f857b291fbf44384a491c35809557fc0/users/96b87260222e44f5ad506ec15e906078/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:16.469113 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08ef8c-5231-4492-8709-96e421b7adbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f857b291fbf44384a491c35809557fc0, user_id=96b87260222e44f5ad506ec15e906078, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:16.474498 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08ef8c-5231-4492-8709-96e421b7adbb admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:16.492553 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4d35f2-3088-4a5f-af15-fb32bd72d173 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:16.495475 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-5c4d35f2-3088-4a5f-af15-fb32bd72d173 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:16.506447 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1012/2014] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:23:16 2022] PUT /identity/v3/projects/f857b291fbf44384a491c35809557fc0/users/96b87260222e44f5ad506ec15e906078/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:23:16.522179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d41ae-89a5-49ac-8a98-dbb37b210123 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:16.523008 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d41ae-89a5-49ac-8a98-dbb37b210123 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:16.525292 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d41ae-89a5-49ac-8a98-dbb37b210123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:16.546720 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4d35f2-3088-4a5f-af15-fb32bd72d173 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:16.611877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-685d41ae-89a5-49ac-8a98-dbb37b210123 None None] MFA Rules not processed for user `96b87260222e44f5ad506ec15e906078`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:16.616299 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-685d41ae-89a5-49ac-8a98-dbb37b210123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:16.685459 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d863398-fadc-45be-a97f-2373dcacc61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:16.688968 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d863398-fadc-45be-a97f-2373dcacc61e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:16.689785 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d863398-fadc-45be-a97f-2373dcacc61e admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:16.690621 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d863398-fadc-45be-a97f-2373dcacc61e admin admin] PATH_INFO: `/v3/projects/0172d122c2884bc0876182726c7b7b43` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:16.698956 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d863398-fadc-45be-a97f-2373dcacc61e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0172d122c2884bc0876182726c7b7b43)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:16.703312 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d863398-fadc-45be-a97f-2373dcacc61e admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:16.739735 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:16.754324 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1013/2015] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:23:16.755377 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d41ae-89a5-49ac-8a98-dbb37b210123 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:16.770290 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d41ae-89a5-49ac-8a98-dbb37b210123 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:16.779556 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34f213-fe7f-42d4-b9c5-ad22d203adf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:16.780554 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34f213-fe7f-42d4-b9c5-ad22d203adf0 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:16.780882 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34f213-fe7f-42d4-b9c5-ad22d203adf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:16.781160 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34f213-fe7f-42d4-b9c5-ad22d203adf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:16.781868 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b34f213-fe7f-42d4-b9c5-ad22d203adf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:16.784131 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b34f213-fe7f-42d4-b9c5-ad22d203adf0 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:16.802823 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:16.810611 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-0d863398-fadc-45be-a97f-2373dcacc61e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0172d122c2884bc0876182726c7b7b43', 'request_id': 'req-0d863398-fadc-45be-a97f-2373dcacc61e'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:16.833554 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1014/2016] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:23:16 2022] POST /identity/v3/projects => generated 377 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:23:16.835215 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34f213-fe7f-42d4-b9c5-ad22d203adf0 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:16.844875 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-0d863398-fadc-45be-a97f-2373dcacc61e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0172d122c2884bc0876182726c7b7b43', 'request_id': 'req-0d863398-fadc-45be-a97f-2373dcacc61e'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:16.858953 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-0d863398-fadc-45be-a97f-2373dcacc61e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0172d122c2884bc0876182726c7b7b43', 'request_id': 'req-0d863398-fadc-45be-a97f-2373dcacc61e'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:16.888376 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-0d863398-fadc-45be-a97f-2373dcacc61e admin admin] The token cache is being invalidate because project 0172d122c2884bc0876182726c7b7b43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:23:16.888864 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-0d863398-fadc-45be-a97f-2373dcacc61e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:16.890801 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-0d863398-fadc-45be-a97f-2373dcacc61e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:16.899726 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1003/2017] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:23:16 2022] DELETE /identity/v3/projects/0172d122c2884bc0876182726c7b7b43 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:23:16.902840 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d85d1-44ba-4e79-8b06-506a99080e8b None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:16.903298 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d85d1-44ba-4e79-8b06-506a99080e8b None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:16.903747 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5d85d1-44ba-4e79-8b06-506a99080e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:16.953871 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-fa5d85d1-44ba-4e79-8b06-506a99080e8b None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:16.956214 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-fa5d85d1-44ba-4e79-8b06-506a99080e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:16.971191 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34f213-fe7f-42d4-b9c5-ad22d203adf0 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:16.978416 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1004/2018] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:23:16.979516 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8a32b-8df0-4061-8bb9-b27f1ce11254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:16.980658 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8a32b-8df0-4061-8bb9-b27f1ce11254 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:16.981300 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8a32b-8df0-4061-8bb9-b27f1ce11254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:16.981901 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8a32b-8df0-4061-8bb9-b27f1ce11254 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:16.983372 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d8a32b-8df0-4061-8bb9-b27f1ce11254 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:16.985059 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddb107-1e3f-4648-a32f-215f00dcd17f None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:16.985807 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddb107-1e3f-4648-a32f-215f00dcd17f None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:16.986813 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddb107-1e3f-4648-a32f-215f00dcd17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:16.988034 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d8a32b-8df0-4061-8bb9-b27f1ce11254 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:17.035362 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-9eddb107-1e3f-4648-a32f-215f00dcd17f None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:17.036636 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1015/2019] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:23:16 2022] POST /identity/v3/users => generated 295 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:23:17.040264 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-9eddb107-1e3f-4648-a32f-215f00dcd17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:17.043995 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8a32b-8df0-4061-8bb9-b27f1ce11254 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:17.047750 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-e1d8a32b-8df0-4061-8bb9-b27f1ce11254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:17.062733 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1005/2020] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:23:17.068766 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eddb107-1e3f-4648-a32f-215f00dcd17f None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:17.082994 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eddb107-1e3f-4648-a32f-215f00dcd17f None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:17.093265 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8a32b-8df0-4061-8bb9-b27f1ce11254 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:17.103267 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053c1dc-066e-4ce9-9815-d20fee6166dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:17.104162 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053c1dc-066e-4ce9-9815-d20fee6166dd admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:17.104625 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec402a6-fe96-4e59-9ae7-05ca446e59f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:17.104908 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053c1dc-066e-4ce9-9815-d20fee6166dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:17.105378 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053c1dc-066e-4ce9-9815-d20fee6166dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:17.105688 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec402a6-fe96-4e59-9ae7-05ca446e59f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:17.106177 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec402a6-fe96-4e59-9ae7-05ca446e59f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:17.106711 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053c1dc-066e-4ce9-9815-d20fee6166dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:23:17.106819 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec402a6-fe96-4e59-9ae7-05ca446e59f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:17.107486 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053c1dc-066e-4ce9-9815-d20fee6166dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:17.107968 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec402a6-fe96-4e59-9ae7-05ca446e59f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:17.109662 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053c1dc-066e-4ce9-9815-d20fee6166dd admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:17.111593 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec402a6-fe96-4e59-9ae7-05ca446e59f6 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:17.151252 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1016/2021] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:23:17.167294 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec402a6-fe96-4e59-9ae7-05ca446e59f6 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:17.189170 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec402a6-fe96-4e59-9ae7-05ca446e59f6 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:17.195859 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10adc2fb-f4fd-4d11-a308-8c8a351f4cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:17.197987 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10adc2fb-f4fd-4d11-a308-8c8a351f4cde admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:17.198414 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10adc2fb-f4fd-4d11-a308-8c8a351f4cde admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:17.198861 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10adc2fb-f4fd-4d11-a308-8c8a351f4cde admin admin] PATH_INFO: `/v3/projects/77a6cbcad4644f0689b5b28e4ca588fa/users/7ef1c19ac8c4411d9e1f1618136f99b3/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:17.225996 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1006/2022] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:23:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:23:17.230107 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053c1dc-066e-4ce9-9815-d20fee6166dd admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:17.244498 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10adc2fb-f4fd-4d11-a308-8c8a351f4cde admin admin] RBAC: Authorizing `identity:create_grant(project_id=77a6cbcad4644f0689b5b28e4ca588fa, user_id=7ef1c19ac8c4411d9e1f1618136f99b3, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:17.246849 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053c1dc-066e-4ce9-9815-d20fee6166dd admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:17.250211 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10adc2fb-f4fd-4d11-a308-8c8a351f4cde admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:17.256761 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53425875-e5b0-438d-bf60-2451f96f5e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:17.258253 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53425875-e5b0-438d-bf60-2451f96f5e3f admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:17.260160 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53425875-e5b0-438d-bf60-2451f96f5e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:17.260749 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53425875-e5b0-438d-bf60-2451f96f5e3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:17.262233 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53425875-e5b0-438d-bf60-2451f96f5e3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:17.266538 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53425875-e5b0-438d-bf60-2451f96f5e3f admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:17.282415 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1017/2023] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:23:17 2022] PUT /identity/v3/projects/77a6cbcad4644f0689b5b28e4ca588fa/users/7ef1c19ac8c4411d9e1f1618136f99b3/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:23:17.284875 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10adc2fb-f4fd-4d11-a308-8c8a351f4cde admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:17.333523 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1007/2024] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:23:17 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:23:17.335082 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53425875-e5b0-438d-bf60-2451f96f5e3f admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:17.434805 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10adc2fb-f4fd-4d11-a308-8c8a351f4cde admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:17.476090 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53425875-e5b0-438d-bf60-2451f96f5e3f admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:17.484032 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:17.488389 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07cf03-6946-4140-87e7-8216e7337700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:17.489802 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07cf03-6946-4140-87e7-8216e7337700 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:17.491714 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07cf03-6946-4140-87e7-8216e7337700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:17.492490 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07cf03-6946-4140-87e7-8216e7337700 admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:17.493947 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07cf03-6946-4140-87e7-8216e7337700 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:17.499422 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07cf03-6946-4140-87e7-8216e7337700 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:17.520136 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77532bc2-9039-4121-b330-b0fe11cd825c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:17.521050 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77532bc2-9039-4121-b330-b0fe11cd825c admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:17.521489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77532bc2-9039-4121-b330-b0fe11cd825c admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:17.522237 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77532bc2-9039-4121-b330-b0fe11cd825c admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:17.523109 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77532bc2-9039-4121-b330-b0fe11cd825c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:17.526611 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77532bc2-9039-4121-b330-b0fe11cd825c admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:17.558982 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1008/2025] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:23:17 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:23:17.560707 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07cf03-6946-4140-87e7-8216e7337700 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:17.566843 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1018/2026] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:23:17.567758 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77532bc2-9039-4121-b330-b0fe11cd825c admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:17.592995 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77532bc2-9039-4121-b330-b0fe11cd825c admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:17.603649 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07cf03-6946-4140-87e7-8216e7337700 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:17.609200 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf91270-d5c3-4230-ac52-891e71169b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:17.610720 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf91270-d5c3-4230-ac52-891e71169b91 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:17.611205 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf91270-d5c3-4230-ac52-891e71169b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:17.612380 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf91270-d5c3-4230-ac52-891e71169b91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:17.613482 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf91270-d5c3-4230-ac52-891e71169b91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:17.615469 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de17c0-0ad8-4505-9afb-6d2c5dda7c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:17.616687 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf91270-d5c3-4230-ac52-891e71169b91 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:17.620404 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de17c0-0ad8-4505-9afb-6d2c5dda7c35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:17.622267 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de17c0-0ad8-4505-9afb-6d2c5dda7c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:17.623068 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de17c0-0ad8-4505-9afb-6d2c5dda7c35 admin admin] PATH_INFO: `/v3/projects/77a6cbcad4644f0689b5b28e4ca588fa/users/7ef1c19ac8c4411d9e1f1618136f99b3/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:17.629650 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de17c0-0ad8-4505-9afb-6d2c5dda7c35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77a6cbcad4644f0689b5b28e4ca588fa, user_id=7ef1c19ac8c4411d9e1f1618136f99b3, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:17.638885 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de17c0-0ad8-4505-9afb-6d2c5dda7c35 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:17.640568 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1019/2027] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:23:17.650532 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf91270-d5c3-4230-ac52-891e71169b91 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:17.675473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf91270-d5c3-4230-ac52-891e71169b91 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:17.678521 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1009/2028] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:23:17 2022] PUT /identity/v3/projects/77a6cbcad4644f0689b5b28e4ca588fa/users/7ef1c19ac8c4411d9e1f1618136f99b3/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:17.698140 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0ff15-ba8f-4740-aac3-80e141b931ec None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:17.699600 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0ff15-ba8f-4740-aac3-80e141b931ec None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:17.699776 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0ff15-ba8f-4740-aac3-80e141b931ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:17.752132 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-46b0ff15-ba8f-4740-aac3-80e141b931ec None None] MFA Rules not processed for user `7ef1c19ac8c4411d9e1f1618136f99b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:17.753782 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-46b0ff15-ba8f-4740-aac3-80e141b931ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:17.801110 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e72a34-7ef6-4d65-bb0c-d970ac1cc4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:17.802469 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e72a34-7ef6-4d65-bb0c-d970ac1cc4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:17.802995 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e72a34-7ef6-4d65-bb0c-d970ac1cc4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:17.803606 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e72a34-7ef6-4d65-bb0c-d970ac1cc4c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:17.804678 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e72a34-7ef6-4d65-bb0c-d970ac1cc4c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:17.808900 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e72a34-7ef6-4d65-bb0c-d970ac1cc4c9 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:17.828324 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1020/2029] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:23:17.830282 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e72a34-7ef6-4d65-bb0c-d970ac1cc4c9 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:17.836129 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:DELETE=4,keystone:SELECT=90,keystone:INSERT=6 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:17.849337 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e72a34-7ef6-4d65-bb0c-d970ac1cc4c9 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:17.857618 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6077f064-c4a3-4f06-945f-39db79584b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:17.858987 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077f064-c4a3-4f06-945f-39db79584b39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:17.859574 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077f064-c4a3-4f06-945f-39db79584b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:17.860173 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077f064-c4a3-4f06-945f-39db79584b39 admin admin] PATH_INFO: `/v3/projects/980497632caa4bf2a5707df952a33320/users/fcc00bbb39a14388a67d3e594e23307e/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:17.872727 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1010/2030] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:17 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:23:17.887536 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0ff15-ba8f-4740-aac3-80e141b931ec None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:17.889427 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-46b0ff15-ba8f-4740-aac3-80e141b931ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:17.901247 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6077f064-c4a3-4f06-945f-39db79584b39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=980497632caa4bf2a5707df952a33320, user_id=fcc00bbb39a14388a67d3e594e23307e, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:17.906261 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6077f064-c4a3-4f06-945f-39db79584b39 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:17.935528 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1021/2031] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:23:17 2022] PUT /identity/v3/projects/980497632caa4bf2a5707df952a33320/users/fcc00bbb39a14388a67d3e594e23307e/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:23:17.959103 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea298d-3cda-46fb-9a74-663f37b6659e None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:17.959857 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea298d-3cda-46fb-9a74-663f37b6659e None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:17.960950 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea298d-3cda-46fb-9a74-663f37b6659e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:18.010641 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b0ff15-ba8f-4740-aac3-80e141b931ec None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:18.051001 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-86ea298d-3cda-46fb-9a74-663f37b6659e None None] MFA Rules not processed for user `fcc00bbb39a14388a67d3e594e23307e`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:18.053956 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-86ea298d-3cda-46fb-9a74-663f37b6659e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:18.113020 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded3e25f-a4ab-4072-9e4e-040b2a8a79ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:18.115063 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3e25f-a4ab-4072-9e4e-040b2a8a79ea service cinder] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:18.115576 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3e25f-a4ab-4072-9e4e-040b2a8a79ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:18.116248 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3e25f-a4ab-4072-9e4e-040b2a8a79ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:18.254529 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1022/2032] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:23:18.260843 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded3e25f-a4ab-4072-9e4e-040b2a8a79ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:18.263467 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded3e25f-a4ab-4072-9e4e-040b2a8a79ea service cinder] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:18.277983 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea298d-3cda-46fb-9a74-663f37b6659e None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:18.280603 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-86ea298d-3cda-46fb-9a74-663f37b6659e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:18.287268 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1011/2033] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:23:17 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:23:18.302815 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea298d-3cda-46fb-9a74-663f37b6659e None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:18.307875 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3b1c6-2f81-4e8b-8802-149eeff06dac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:18.308780 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3b1c6-2f81-4e8b-8802-149eeff06dac service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:18.309476 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3b1c6-2f81-4e8b-8802-149eeff06dac service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:18.309644 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3b1c6-2f81-4e8b-8802-149eeff06dac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:18.324193 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3b1c6-2f81-4e8b-8802-149eeff06dac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:18.327474 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3b1c6-2f81-4e8b-8802-149eeff06dac service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:18.344534 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded3e25f-a4ab-4072-9e4e-040b2a8a79ea service cinder] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:18.359088 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1023/2034] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:23:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:23:18.382586 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded3e25f-a4ab-4072-9e4e-040b2a8a79ea service cinder] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:18.397034 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea84610-f619-495c-9555-eba6e7c481b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:18.398124 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea84610-f619-495c-9555-eba6e7c481b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:18.398951 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea84610-f619-495c-9555-eba6e7c481b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:18.400045 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea84610-f619-495c-9555-eba6e7c481b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:18.409654 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-aea84610-f619-495c-9555-eba6e7c481b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:18.536794 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:18.562853 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea84610-f619-495c-9555-eba6e7c481b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:18.562853 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea84610-f619-495c-9555-eba6e7c481b8 service cinder] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:18.569853 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1012/2035] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:23:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:23:21.371966 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4412c-3c12-4ec8-9069-488fcc9fb419 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:21.372656 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4412c-3c12-4ec8-9069-488fcc9fb419 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:21.373022 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4412c-3c12-4ec8-9069-488fcc9fb419 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:21.376227 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1024/2036] 10.222.0.60 () {54 vars in 921 bytes} [Wed Sep 21 12:23:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:23:21.442629 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d03166-d916-49cf-8cba-2e0b96260ee0 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:21.443367 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d03166-d916-49cf-8cba-2e0b96260ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:21.443367 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d03166-d916-49cf-8cba-2e0b96260ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:21.484688 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-96d03166-d916-49cf-8cba-2e0b96260ee0 None None] MFA Rules not processed for user `74e866f134f64644bf33e3adecf207c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:21.487333 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-96d03166-d916-49cf-8cba-2e0b96260ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:21.572506 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4412c-3c12-4ec8-9069-488fcc9fb419 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:21.577193 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b1a4412c-3c12-4ec8-9069-488fcc9fb419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:21.642412 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:21.706068 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1013/2037] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Sep 21 12:23:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:23:21.747716 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d03166-d916-49cf-8cba-2e0b96260ee0 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:21.751576 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-96d03166-d916-49cf-8cba-2e0b96260ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:21.773484 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d03166-d916-49cf-8cba-2e0b96260ee0 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:21.779988 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f066333-c7d4-4112-9031-e771586bf6a3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e866f134f64644bf33e3adecf207c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:21.781057 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f066333-c7d4-4112-9031-e771586bf6a3 service placement] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:21.781496 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f066333-c7d4-4112-9031-e771586bf6a3 service placement] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:21.781933 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f066333-c7d4-4112-9031-e771586bf6a3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:21.793728 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f066333-c7d4-4112-9031-e771586bf6a3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:21.796972 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f066333-c7d4-4112-9031-e771586bf6a3 service placement] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:21.809272 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1014/2038] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:23:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:23:21.878204 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4412c-3c12-4ec8-9069-488fcc9fb419 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:21.884881 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4448b6a7-e6da-483c-9322-1196704c0cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:21.885624 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448b6a7-e6da-483c-9322-1196704c0cea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:21.885908 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448b6a7-e6da-483c-9322-1196704c0cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:21.886458 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4448b6a7-e6da-483c-9322-1196704c0cea admin admin] PATH_INFO: `/v3/users/d71346f5c4fd4fefa706b1c66873e903` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:21.887791 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4448b6a7-e6da-483c-9322-1196704c0cea admin admin] RBAC: Authorizing `identity:delete_user(user_id=d71346f5c4fd4fefa706b1c66873e903)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:21.889821 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4448b6a7-e6da-483c-9322-1196704c0cea admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:21.971999 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-4448b6a7-e6da-483c-9322-1196704c0cea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd71346f5c4fd4fefa706b1c66873e903'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:21.987196 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-4448b6a7-e6da-483c-9322-1196704c0cea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd71346f5c4fd4fefa706b1c66873e903'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:22.040265 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-4448b6a7-e6da-483c-9322-1196704c0cea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd71346f5c4fd4fefa706b1c66873e903'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:22.041677 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-4448b6a7-e6da-483c-9322-1196704c0cea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd71346f5c4fd4fefa706b1c66873e903'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:22.058537 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-4448b6a7-e6da-483c-9322-1196704c0cea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd71346f5c4fd4fefa706b1c66873e903'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:22.074872 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1025/2039] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:23:21 2022] DELETE /identity/v3/users/d71346f5c4fd4fefa706b1c66873e903 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:23:22.422048 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f066333-c7d4-4112-9031-e771586bf6a3 service placement] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:22.444972 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f066333-c7d4-4112-9031-e771586bf6a3 service placement] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:22.486304 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4448b6a7-e6da-483c-9322-1196704c0cea admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:22.488887 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-4448b6a7-e6da-483c-9322-1196704c0cea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:22.546249 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de2664-85cd-456b-85cd-5aa53e15d07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:22.546940 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de2664-85cd-456b-85cd-5aa53e15d07a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:22.547219 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de2664-85cd-456b-85cd-5aa53e15d07a admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:22.547495 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de2664-85cd-456b-85cd-5aa53e15d07a admin admin] PATH_INFO: `/v3/projects/92b1992487614a7f80a0acbd67a4050a` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:22.549562 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9de2664-85cd-456b-85cd-5aa53e15d07a admin admin] RBAC: Authorizing `identity:delete_project(project_id=92b1992487614a7f80a0acbd67a4050a)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:22.551766 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9de2664-85cd-456b-85cd-5aa53e15d07a admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:22.591602 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4448b6a7-e6da-483c-9322-1196704c0cea admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:22.600497 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd01413f-a312-4eb3-9863-1167d4054139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:22.601605 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01413f-a312-4eb3-9863-1167d4054139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:22.602667 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01413f-a312-4eb3-9863-1167d4054139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:22.603148 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01413f-a312-4eb3-9863-1167d4054139 admin admin] PATH_INFO: `/v3/users/5f783765c3d044279f87a26b6e231171` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:22.605199 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd01413f-a312-4eb3-9863-1167d4054139 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f783765c3d044279f87a26b6e231171)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:22.609060 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd01413f-a312-4eb3-9863-1167d4054139 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:22.612858 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-a9de2664-85cd-456b-85cd-5aa53e15d07a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92b1992487614a7f80a0acbd67a4050a', 'request_id': 'req-a9de2664-85cd-456b-85cd-5aa53e15d07a'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:22.625015 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-a9de2664-85cd-456b-85cd-5aa53e15d07a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92b1992487614a7f80a0acbd67a4050a', 'request_id': 'req-a9de2664-85cd-456b-85cd-5aa53e15d07a'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:22.633422 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-a9de2664-85cd-456b-85cd-5aa53e15d07a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92b1992487614a7f80a0acbd67a4050a', 'request_id': 'req-a9de2664-85cd-456b-85cd-5aa53e15d07a'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:22.652702 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-a9de2664-85cd-456b-85cd-5aa53e15d07a admin admin] The token cache is being invalidate because project 92b1992487614a7f80a0acbd67a4050a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:23:22.653185 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-a9de2664-85cd-456b-85cd-5aa53e15d07a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:22.654334 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-a9de2664-85cd-456b-85cd-5aa53e15d07a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:22.656890 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1015/2040] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:23:22 2022] DELETE /identity/v3/projects/92b1992487614a7f80a0acbd67a4050a => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:22.663564 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b65835-a306-4b9c-8c2b-5964266be4d6 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:22.663903 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b65835-a306-4b9c-8c2b-5964266be4d6 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:22.664303 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b65835-a306-4b9c-8c2b-5964266be4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:22.671411 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:22.680407 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:22.695085 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-dd01413f-a312-4eb3-9863-1167d4054139 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f783765c3d044279f87a26b6e231171'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:22.700896 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-72b65835-a306-4b9c-8c2b-5964266be4d6 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:22.702678 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-72b65835-a306-4b9c-8c2b-5964266be4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:22.705988 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-dd01413f-a312-4eb3-9863-1167d4054139 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f783765c3d044279f87a26b6e231171'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:22.726667 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-dd01413f-a312-4eb3-9863-1167d4054139 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f783765c3d044279f87a26b6e231171'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:22.728344 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-dd01413f-a312-4eb3-9863-1167d4054139 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f783765c3d044279f87a26b6e231171'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:22.740909 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-dd01413f-a312-4eb3-9863-1167d4054139 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f783765c3d044279f87a26b6e231171'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:22.751974 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1026/2041] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:23:22 2022] DELETE /identity/v3/users/5f783765c3d044279f87a26b6e231171 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:23:22.761215 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda8ac5-56a6-4ccb-8f58-81c741d0e70c None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:22.761735 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda8ac5-56a6-4ccb-8f58-81c741d0e70c None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:22.762208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda8ac5-56a6-4ccb-8f58-81c741d0e70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:22.801933 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-cbda8ac5-56a6-4ccb-8f58-81c741d0e70c None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:22.803902 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-cbda8ac5-56a6-4ccb-8f58-81c741d0e70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:22.846686 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1016/2042] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:23:22.855968 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b65835-a306-4b9c-8c2b-5964266be4d6 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:22.857512 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-72b65835-a306-4b9c-8c2b-5964266be4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:22.872350 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b65835-a306-4b9c-8c2b-5964266be4d6 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:22.910537 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1027/2043] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:23:22.912999 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f279a-c121-4d85-8c5c-d71a472e6e97 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:22.913285 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f279a-c121-4d85-8c5c-d71a472e6e97 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:22.913723 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f279a-c121-4d85-8c5c-d71a472e6e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:22.942283 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-dd1f279a-c121-4d85-8c5c-d71a472e6e97 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:22.943618 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-dd1f279a-c121-4d85-8c5c-d71a472e6e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:22.953467 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1028/2044] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:23:22.958118 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f279a-c121-4d85-8c5c-d71a472e6e97 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:22.958118 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-dd1f279a-c121-4d85-8c5c-d71a472e6e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:22.978783 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7db81-ad65-4818-9b58-78b5b0638c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:22.979853 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7db81-ad65-4818-9b58-78b5b0638c95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:22.980340 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7db81-ad65-4818-9b58-78b5b0638c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:22.980820 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7db81-ad65-4818-9b58-78b5b0638c95 admin admin] PATH_INFO: `/v3/users/fcc00bbb39a14388a67d3e594e23307e` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:22.983060 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b7db81-ad65-4818-9b58-78b5b0638c95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcc00bbb39a14388a67d3e594e23307e)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:22.987050 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b7db81-ad65-4818-9b58-78b5b0638c95 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:23.028690 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f279a-c121-4d85-8c5c-d71a472e6e97 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:23.032880 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f3ae2-aab7-4e41-b905-3ac6cae6baf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:23.033660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f3ae2-aab7-4e41-b905-3ac6cae6baf0 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:23.033944 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f3ae2-aab7-4e41-b905-3ac6cae6baf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:23.034233 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f3ae2-aab7-4e41-b905-3ac6cae6baf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:23.048680 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f3ae2-aab7-4e41-b905-3ac6cae6baf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:23.052128 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f3ae2-aab7-4e41-b905-3ac6cae6baf0 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:23.078994 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1029/2045] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:23:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:23:23.080567 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f3ae2-aab7-4e41-b905-3ac6cae6baf0 service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:23.087724 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-d4b7db81-ad65-4818-9b58-78b5b0638c95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcc00bbb39a14388a67d3e594e23307e'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:23.103564 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f3ae2-aab7-4e41-b905-3ac6cae6baf0 service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:23.113158 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09af3e-102c-427c-8ad6-259d17d71d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:23.114249 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09af3e-102c-427c-8ad6-259d17d71d58 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:23.114845 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09af3e-102c-427c-8ad6-259d17d71d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:23.115299 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09af3e-102c-427c-8ad6-259d17d71d58 admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:23.116521 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da09af3e-102c-427c-8ad6-259d17d71d58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:23:23.117073 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da09af3e-102c-427c-8ad6-259d17d71d58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:23.123208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da09af3e-102c-427c-8ad6-259d17d71d58 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:23.124379 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-d4b7db81-ad65-4818-9b58-78b5b0638c95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcc00bbb39a14388a67d3e594e23307e'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:23.145272 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-d4b7db81-ad65-4818-9b58-78b5b0638c95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcc00bbb39a14388a67d3e594e23307e'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:23.146426 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-d4b7db81-ad65-4818-9b58-78b5b0638c95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcc00bbb39a14388a67d3e594e23307e'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:23.153398 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1030/2046] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:23:23.154698 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09af3e-102c-427c-8ad6-259d17d71d58 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:23.157807 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-da09af3e-102c-427c-8ad6-259d17d71d58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:23.165991 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-d4b7db81-ad65-4818-9b58-78b5b0638c95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcc00bbb39a14388a67d3e594e23307e'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:23.180983 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1017/2047] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:23:22 2022] DELETE /identity/v3/users/fcc00bbb39a14388a67d3e594e23307e => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:23.183177 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d4faf-893e-43ab-a2e1-454ccd817f02 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:23.184287 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d4faf-893e-43ab-a2e1-454ccd817f02 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:23.184287 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d4faf-893e-43ab-a2e1-454ccd817f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:23.184889 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09af3e-102c-427c-8ad6-259d17d71d58 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:23.224893 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-0b7d4faf-893e-43ab-a2e1-454ccd817f02 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:23.227584 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-0b7d4faf-893e-43ab-a2e1-454ccd817f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:23.245585 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:23.265372 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:23.305861 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d79f7-e66e-4b2b-9dbe-5d4e6d55270f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:23.307010 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d79f7-e66e-4b2b-9dbe-5d4e6d55270f admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:23.307419 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d79f7-e66e-4b2b-9dbe-5d4e6d55270f admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:23.307955 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d79f7-e66e-4b2b-9dbe-5d4e6d55270f admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:23.308874 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d79f7-e66e-4b2b-9dbe-5d4e6d55270f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:23.312271 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d79f7-e66e-4b2b-9dbe-5d4e6d55270f admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:23.337770 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1018/2048] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:23:23.349657 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d4faf-893e-43ab-a2e1-454ccd817f02 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:23.353067 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-0b7d4faf-893e-43ab-a2e1-454ccd817f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:23.378925 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1031/2049] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:23:23 2022] POST /identity/v3/projects => generated 373 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:23:23.381883 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d79f7-e66e-4b2b-9dbe-5d4e6d55270f admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:23.453025 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d4faf-893e-43ab-a2e1-454ccd817f02 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:23.521391 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d79f7-e66e-4b2b-9dbe-5d4e6d55270f admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:23.527756 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764584f3-9a7b-4f82-b49d-7fe862a68241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:23.528387 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764584f3-9a7b-4f82-b49d-7fe862a68241 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:23.528670 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764584f3-9a7b-4f82-b49d-7fe862a68241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:23.528942 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764584f3-9a7b-4f82-b49d-7fe862a68241 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:23.529615 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764584f3-9a7b-4f82-b49d-7fe862a68241 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:23.531981 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764584f3-9a7b-4f82-b49d-7fe862a68241 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:23.578777 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1032/2050] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:23:23 2022] POST /identity/v3/users => generated 287 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:23:23.580791 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764584f3-9a7b-4f82-b49d-7fe862a68241 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:23.582759 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a996559-6508-40e5-a57c-d9879d6c7d46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:23.583387 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a996559-6508-40e5-a57c-d9879d6c7d46 service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:23.583734 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a996559-6508-40e5-a57c-d9879d6c7d46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:23.584086 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a996559-6508-40e5-a57c-d9879d6c7d46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:23.600024 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a996559-6508-40e5-a57c-d9879d6c7d46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:23.601765 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764584f3-9a7b-4f82-b49d-7fe862a68241 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:23.602617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a996559-6508-40e5-a57c-d9879d6c7d46 service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:23.608046 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc7c9b-bde1-47b1-8b3e-a62691f406d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:23.609234 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc7c9b-bde1-47b1-8b3e-a62691f406d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:23.609538 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc7c9b-bde1-47b1-8b3e-a62691f406d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:23.610029 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc7c9b-bde1-47b1-8b3e-a62691f406d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:23.611322 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc7c9b-bde1-47b1-8b3e-a62691f406d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:23.613872 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc7c9b-bde1-47b1-8b3e-a62691f406d9 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:23.616202 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1019/2051] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:23:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:23:23.637770 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1033/2052] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:23:23.639975 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a996559-6508-40e5-a57c-d9879d6c7d46 service neutron] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:23.652207 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a996559-6508-40e5-a57c-d9879d6c7d46 service neutron] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:23.659591 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e3dcc-4a20-4f3a-95fe-df58354e2389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:23.660451 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e3dcc-4a20-4f3a-95fe-df58354e2389 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:23.660797 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e3dcc-4a20-4f3a-95fe-df58354e2389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:23.661237 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e3dcc-4a20-4f3a-95fe-df58354e2389 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:23.661987 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e3dcc-4a20-4f3a-95fe-df58354e2389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:23.665391 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e3dcc-4a20-4f3a-95fe-df58354e2389 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:23.682287 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1020/2053] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:23:23.688390 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc7c9b-bde1-47b1-8b3e-a62691f406d9 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:23.704494 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc7c9b-bde1-47b1-8b3e-a62691f406d9 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:23.715967 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e4ffc-6ed0-49a6-9bcb-95a99e2de783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:23.717446 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e4ffc-6ed0-49a6-9bcb-95a99e2de783 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:23.717864 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e4ffc-6ed0-49a6-9bcb-95a99e2de783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:23.718333 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e4ffc-6ed0-49a6-9bcb-95a99e2de783 admin admin] PATH_INFO: `/v3/projects/7b80ed9473aa4b5cb2a4a78b229977a3/users/9bb4ff78146c4b2bb76cc297cd347020/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:23.753051 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e4ffc-6ed0-49a6-9bcb-95a99e2de783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b80ed9473aa4b5cb2a4a78b229977a3, user_id=9bb4ff78146c4b2bb76cc297cd347020, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:23.759486 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e4ffc-6ed0-49a6-9bcb-95a99e2de783 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:23.786244 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1034/2054] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:23:23 2022] PUT /identity/v3/projects/7b80ed9473aa4b5cb2a4a78b229977a3/users/9bb4ff78146c4b2bb76cc297cd347020/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:23:23.804983 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a80b57-5b36-4a8c-b762-696a5b83e8f7 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:23.805639 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a80b57-5b36-4a8c-b762-696a5b83e8f7 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:23.806155 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a80b57-5b36-4a8c-b762-696a5b83e8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:23.825337 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e4ffc-6ed0-49a6-9bcb-95a99e2de783 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:23.830489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f87e4ffc-6ed0-49a6-9bcb-95a99e2de783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:23.866686 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-10a80b57-5b36-4a8c-b762-696a5b83e8f7 None None] MFA Rules not processed for user `9bb4ff78146c4b2bb76cc297cd347020`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:23.868965 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-10a80b57-5b36-4a8c-b762-696a5b83e8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:24.003287 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e4ffc-6ed0-49a6-9bcb-95a99e2de783 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:24.007717 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadfb4bf-e99c-4626-a6cf-f1351207579c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:24.008959 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfb4bf-e99c-4626-a6cf-f1351207579c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:24.009288 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfb4bf-e99c-4626-a6cf-f1351207579c admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:24.010105 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfb4bf-e99c-4626-a6cf-f1351207579c admin admin] PATH_INFO: `/v3/projects/496f9aed89df4a82aacdc414bccdf0af` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:24.011798 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadfb4bf-e99c-4626-a6cf-f1351207579c admin admin] RBAC: Authorizing `identity:delete_project(project_id=496f9aed89df4a82aacdc414bccdf0af)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:24.013418 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadfb4bf-e99c-4626-a6cf-f1351207579c admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:24.031440 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1021/2055] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:23:24.040855 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:24.052187 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a80b57-5b36-4a8c-b762-696a5b83e8f7 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:24.056141 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-10a80b57-5b36-4a8c-b762-696a5b83e8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:24.067211 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:24.105706 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-dadfb4bf-e99c-4626-a6cf-f1351207579c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '496f9aed89df4a82aacdc414bccdf0af', 'request_id': 'req-dadfb4bf-e99c-4626-a6cf-f1351207579c'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:24.122554 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-dadfb4bf-e99c-4626-a6cf-f1351207579c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '496f9aed89df4a82aacdc414bccdf0af', 'request_id': 'req-dadfb4bf-e99c-4626-a6cf-f1351207579c'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:24.135857 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-dadfb4bf-e99c-4626-a6cf-f1351207579c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '496f9aed89df4a82aacdc414bccdf0af', 'request_id': 'req-dadfb4bf-e99c-4626-a6cf-f1351207579c'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:24.159017 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-dadfb4bf-e99c-4626-a6cf-f1351207579c admin admin] The token cache is being invalidate because project 496f9aed89df4a82aacdc414bccdf0af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:23:24.159494 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-dadfb4bf-e99c-4626-a6cf-f1351207579c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:24.160908 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-dadfb4bf-e99c-4626-a6cf-f1351207579c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:24.170067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1035/2056] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:23:23 2022] DELETE /identity/v3/projects/496f9aed89df4a82aacdc414bccdf0af => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:23:24.172603 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadfb4bf-e99c-4626-a6cf-f1351207579c admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:24.175480 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-dadfb4bf-e99c-4626-a6cf-f1351207579c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:24.225486 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a80b57-5b36-4a8c-b762-696a5b83e8f7 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:24.362179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadfb4bf-e99c-4626-a6cf-f1351207579c admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:24.372515 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df85d0-c74c-4967-a123-051044c9eaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:24.373115 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df85d0-c74c-4967-a123-051044c9eaa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:24.373671 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df85d0-c74c-4967-a123-051044c9eaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:24.374244 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df85d0-c74c-4967-a123-051044c9eaa8 admin admin] PATH_INFO: `/v3/users/96b87260222e44f5ad506ec15e906078` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:24.377587 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5afc62-f21c-426d-a2de-b79acab29409 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:24.377803 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df85d0-c74c-4967-a123-051044c9eaa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96b87260222e44f5ad506ec15e906078)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:24.377903 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5afc62-f21c-426d-a2de-b79acab29409 service nova] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:24.377999 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5afc62-f21c-426d-a2de-b79acab29409 service nova] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:24.378257 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5afc62-f21c-426d-a2de-b79acab29409 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:24.380308 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-6d5afc62-f21c-426d-a2de-b79acab29409 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:24.381468 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df85d0-c74c-4967-a123-051044c9eaa8 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:24.477496 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-80df85d0-c74c-4967-a123-051044c9eaa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96b87260222e44f5ad506ec15e906078'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:24.495134 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-80df85d0-c74c-4967-a123-051044c9eaa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96b87260222e44f5ad506ec15e906078'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:24.500293 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5afc62-f21c-426d-a2de-b79acab29409 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:24.504321 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5afc62-f21c-426d-a2de-b79acab29409 service nova] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:24.531034 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1022/2057] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:23:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:23:24.532585 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5afc62-f21c-426d-a2de-b79acab29409 service nova] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:24.535992 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-6d5afc62-f21c-426d-a2de-b79acab29409 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:24.547803 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-80df85d0-c74c-4967-a123-051044c9eaa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96b87260222e44f5ad506ec15e906078'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:24.550200 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-80df85d0-c74c-4967-a123-051044c9eaa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96b87260222e44f5ad506ec15e906078'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:24.600167 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-80df85d0-c74c-4967-a123-051044c9eaa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96b87260222e44f5ad506ec15e906078'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:24.607773 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5afc62-f21c-426d-a2de-b79acab29409 service nova] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:24.646202 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1036/2058] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:23:24 2022] DELETE /identity/v3/users/96b87260222e44f5ad506ec15e906078 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:24.757420 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:24.827959 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e0f03-b617-48b3-99a2-0a24342665c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:24.828912 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e0f03-b617-48b3-99a2-0a24342665c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:24.829403 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e0f03-b617-48b3-99a2-0a24342665c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:24.829870 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e0f03-b617-48b3-99a2-0a24342665c1 admin admin] PATH_INFO: `/v3/projects/980497632caa4bf2a5707df952a33320` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:24.832622 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e0f03-b617-48b3-99a2-0a24342665c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=980497632caa4bf2a5707df952a33320)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:24.841610 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e0f03-b617-48b3-99a2-0a24342665c1 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:25.004069 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-4e8e0f03-b617-48b3-99a2-0a24342665c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '980497632caa4bf2a5707df952a33320', 'request_id': 'req-4e8e0f03-b617-48b3-99a2-0a24342665c1'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:25.008086 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df85d0-c74c-4967-a123-051044c9eaa8 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:25.011105 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-80df85d0-c74c-4967-a123-051044c9eaa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:25.019886 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-4e8e0f03-b617-48b3-99a2-0a24342665c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '980497632caa4bf2a5707df952a33320', 'request_id': 'req-4e8e0f03-b617-48b3-99a2-0a24342665c1'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:25.029596 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df85d0-c74c-4967-a123-051044c9eaa8 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:25.030519 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-4e8e0f03-b617-48b3-99a2-0a24342665c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '980497632caa4bf2a5707df952a33320', 'request_id': 'req-4e8e0f03-b617-48b3-99a2-0a24342665c1'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:25.048931 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-4e8e0f03-b617-48b3-99a2-0a24342665c1 admin admin] The token cache is being invalidate because project 980497632caa4bf2a5707df952a33320 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:23:25.051463 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-4e8e0f03-b617-48b3-99a2-0a24342665c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:25.052792 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-4e8e0f03-b617-48b3-99a2-0a24342665c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:25.054716 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:25.057317 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1023/2059] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:23:24 2022] DELETE /identity/v3/projects/980497632caa4bf2a5707df952a33320 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:25.127641 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9d06d-b1a6-4e59-9e0c-9e05a3a693f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:25.128334 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9d06d-b1a6-4e59-9e0c-9e05a3a693f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:25.128857 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9d06d-b1a6-4e59-9e0c-9e05a3a693f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:25.129148 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9d06d-b1a6-4e59-9e0c-9e05a3a693f9 admin admin] PATH_INFO: `/v3/users/9bb4ff78146c4b2bb76cc297cd347020` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:25.130671 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9d06d-b1a6-4e59-9e0c-9e05a3a693f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bb4ff78146c4b2bb76cc297cd347020)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:25.137676 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9d06d-b1a6-4e59-9e0c-9e05a3a693f9 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:25.221174 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-69a9d06d-b1a6-4e59-9e0c-9e05a3a693f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bb4ff78146c4b2bb76cc297cd347020'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:25.244299 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-69a9d06d-b1a6-4e59-9e0c-9e05a3a693f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bb4ff78146c4b2bb76cc297cd347020'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:25.273769 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-69a9d06d-b1a6-4e59-9e0c-9e05a3a693f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bb4ff78146c4b2bb76cc297cd347020'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:25.275188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-69a9d06d-b1a6-4e59-9e0c-9e05a3a693f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bb4ff78146c4b2bb76cc297cd347020'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:25.295378 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-69a9d06d-b1a6-4e59-9e0c-9e05a3a693f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bb4ff78146c4b2bb76cc297cd347020'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:25.304341 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1037/2060] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:23:25 2022] DELETE /identity/v3/users/9bb4ff78146c4b2bb76cc297cd347020 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:25.310083 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d513b19-7803-4961-81a5-3ae922fa35c1 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:25.311005 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d513b19-7803-4961-81a5-3ae922fa35c1 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:25.311005 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d513b19-7803-4961-81a5-3ae922fa35c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:25.354241 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-8d513b19-7803-4961-81a5-3ae922fa35c1 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:25.356631 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-8d513b19-7803-4961-81a5-3ae922fa35c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:25.447338 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1024/2061] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:23:25.468340 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9d06d-b1a6-4e59-9e0c-9e05a3a693f9 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:25.470738 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-69a9d06d-b1a6-4e59-9e0c-9e05a3a693f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:25.514934 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d513b19-7803-4961-81a5-3ae922fa35c1 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:25.517020 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-8d513b19-7803-4961-81a5-3ae922fa35c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:25.535326 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d513b19-7803-4961-81a5-3ae922fa35c1 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:25.541407 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72059551-84b2-46a4-9a91-98f8056efd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:25.542652 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72059551-84b2-46a4-9a91-98f8056efd7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:25.542652 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72059551-84b2-46a4-9a91-98f8056efd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:25.542974 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72059551-84b2-46a4-9a91-98f8056efd7c admin admin] PATH_INFO: `/v3/projects/f857b291fbf44384a491c35809557fc0` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:25.544929 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72059551-84b2-46a4-9a91-98f8056efd7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f857b291fbf44384a491c35809557fc0)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:25.547405 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72059551-84b2-46a4-9a91-98f8056efd7c admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:25.612360 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9d06d-b1a6-4e59-9e0c-9e05a3a693f9 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:25.619095 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e170883-d8ee-4883-bb5f-a6d71098287e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:25.620028 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e170883-d8ee-4883-bb5f-a6d71098287e service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:25.620485 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e170883-d8ee-4883-bb5f-a6d71098287e service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:25.620930 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e170883-d8ee-4883-bb5f-a6d71098287e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:25.638581 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e170883-d8ee-4883-bb5f-a6d71098287e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:25.640869 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e170883-d8ee-4883-bb5f-a6d71098287e service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:25.649769 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-72059551-84b2-46a4-9a91-98f8056efd7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f857b291fbf44384a491c35809557fc0', 'request_id': 'req-72059551-84b2-46a4-9a91-98f8056efd7c'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:25.660037 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-72059551-84b2-46a4-9a91-98f8056efd7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f857b291fbf44384a491c35809557fc0', 'request_id': 'req-72059551-84b2-46a4-9a91-98f8056efd7c'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:25.666605 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1038/2062] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:23:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:23:25.669617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:25.672018 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-72059551-84b2-46a4-9a91-98f8056efd7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f857b291fbf44384a491c35809557fc0', 'request_id': 'req-72059551-84b2-46a4-9a91-98f8056efd7c'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:25.696626 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-72059551-84b2-46a4-9a91-98f8056efd7c admin admin] The token cache is being invalidate because project f857b291fbf44384a491c35809557fc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:23:25.697159 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-72059551-84b2-46a4-9a91-98f8056efd7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:25.698613 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-72059551-84b2-46a4-9a91-98f8056efd7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:25.701654 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1025/2063] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:23:25 2022] DELETE /identity/v3/projects/f857b291fbf44384a491c35809557fc0 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:25.707005 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e170883-d8ee-4883-bb5f-a6d71098287e service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:25.724258 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e170883-d8ee-4883-bb5f-a6d71098287e service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:25.813075 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:25.848945 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e0dd5-2d80-42e0-860c-350b1c89b073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:25.851191 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e0dd5-2d80-42e0-860c-350b1c89b073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:25.851870 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e0dd5-2d80-42e0-860c-350b1c89b073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:25.853022 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e0dd5-2d80-42e0-860c-350b1c89b073 admin admin] PATH_INFO: `/v3/users/7ef1c19ac8c4411d9e1f1618136f99b3` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:25.855644 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e0dd5-2d80-42e0-860c-350b1c89b073 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ef1c19ac8c4411d9e1f1618136f99b3)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:25.858741 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e0dd5-2d80-42e0-860c-350b1c89b073 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:25.954152 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-e67e0dd5-2d80-42e0-860c-350b1c89b073 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ef1c19ac8c4411d9e1f1618136f99b3'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:25.967744 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-e67e0dd5-2d80-42e0-860c-350b1c89b073 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ef1c19ac8c4411d9e1f1618136f99b3'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:25.995390 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-e67e0dd5-2d80-42e0-860c-350b1c89b073 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ef1c19ac8c4411d9e1f1618136f99b3'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:25.996945 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-e67e0dd5-2d80-42e0-860c-350b1c89b073 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ef1c19ac8c4411d9e1f1618136f99b3'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:26.010938 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-e67e0dd5-2d80-42e0-860c-350b1c89b073 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ef1c19ac8c4411d9e1f1618136f99b3'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:26.019123 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1039/2064] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:23:25 2022] DELETE /identity/v3/users/7ef1c19ac8c4411d9e1f1618136f99b3 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:26.140293 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72059551-84b2-46a4-9a91-98f8056efd7c admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:26.142919 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-72059551-84b2-46a4-9a91-98f8056efd7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:26.183871 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72059551-84b2-46a4-9a91-98f8056efd7c admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:26.302172 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0dec14-e181-48b7-b8c5-215abc07707f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:26.303283 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0dec14-e181-48b7-b8c5-215abc07707f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:26.303644 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0dec14-e181-48b7-b8c5-215abc07707f admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:26.304081 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0dec14-e181-48b7-b8c5-215abc07707f admin admin] PATH_INFO: `/v3/projects/7b80ed9473aa4b5cb2a4a78b229977a3` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:26.306607 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0dec14-e181-48b7-b8c5-215abc07707f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b80ed9473aa4b5cb2a4a78b229977a3)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:26.310032 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0dec14-e181-48b7-b8c5-215abc07707f admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:26.406461 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-ef0dec14-e181-48b7-b8c5-215abc07707f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b80ed9473aa4b5cb2a4a78b229977a3', 'request_id': 'req-ef0dec14-e181-48b7-b8c5-215abc07707f'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:26.419089 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-ef0dec14-e181-48b7-b8c5-215abc07707f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b80ed9473aa4b5cb2a4a78b229977a3', 'request_id': 'req-ef0dec14-e181-48b7-b8c5-215abc07707f'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:26.430209 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-ef0dec14-e181-48b7-b8c5-215abc07707f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b80ed9473aa4b5cb2a4a78b229977a3', 'request_id': 'req-ef0dec14-e181-48b7-b8c5-215abc07707f'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:26.445110 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-ef0dec14-e181-48b7-b8c5-215abc07707f admin admin] The token cache is being invalidate because project 7b80ed9473aa4b5cb2a4a78b229977a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:23:26.445110 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-ef0dec14-e181-48b7-b8c5-215abc07707f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:26.445909 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-ef0dec14-e181-48b7-b8c5-215abc07707f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:26.447804 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1026/2065] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:23:26 2022] DELETE /identity/v3/projects/7b80ed9473aa4b5cb2a4a78b229977a3 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:26.452711 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05868f5f-9e5a-4eef-8985-d0cdc7ada44c None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:26.453020 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05868f5f-9e5a-4eef-8985-d0cdc7ada44c None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:26.453257 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05868f5f-9e5a-4eef-8985-d0cdc7ada44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:26.500313 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-05868f5f-9e5a-4eef-8985-d0cdc7ada44c None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:26.502566 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-05868f5f-9e5a-4eef-8985-d0cdc7ada44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:26.508144 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0dec14-e181-48b7-b8c5-215abc07707f admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:26.510119 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-ef0dec14-e181-48b7-b8c5-215abc07707f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:26.605438 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1040/2066] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:23:26.616349 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0dec14-e181-48b7-b8c5-215abc07707f admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:26.619917 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d4ed0-15c9-4734-800c-abb855dd8e8f None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:26.620648 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d4ed0-15c9-4734-800c-abb855dd8e8f None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:26.621015 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d4ed0-15c9-4734-800c-abb855dd8e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:26.622804 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47cb944-092d-4057-b68d-b08e7f1aee2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:26.623456 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47cb944-092d-4057-b68d-b08e7f1aee2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:26.623762 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47cb944-092d-4057-b68d-b08e7f1aee2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:26.624038 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47cb944-092d-4057-b68d-b08e7f1aee2d admin admin] PATH_INFO: `/v3/projects/77a6cbcad4644f0689b5b28e4ca588fa` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:26.625200 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47cb944-092d-4057-b68d-b08e7f1aee2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=77a6cbcad4644f0689b5b28e4ca588fa)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:26.627242 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47cb944-092d-4057-b68d-b08e7f1aee2d admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:26.647603 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-c60d4ed0-15c9-4734-800c-abb855dd8e8f None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:26.649113 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-c60d4ed0-15c9-4734-800c-abb855dd8e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:26.656867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:26.658954 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1041/2067] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:23:26.663992 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d4ed0-15c9-4734-800c-abb855dd8e8f None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:26.674415 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d4ed0-15c9-4734-800c-abb855dd8e8f None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:26.694937 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-d47cb944-092d-4057-b68d-b08e7f1aee2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77a6cbcad4644f0689b5b28e4ca588fa', 'request_id': 'req-d47cb944-092d-4057-b68d-b08e7f1aee2d'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:26.708742 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-d47cb944-092d-4057-b68d-b08e7f1aee2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77a6cbcad4644f0689b5b28e4ca588fa', 'request_id': 'req-d47cb944-092d-4057-b68d-b08e7f1aee2d'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:26.720028 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-d47cb944-092d-4057-b68d-b08e7f1aee2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77a6cbcad4644f0689b5b28e4ca588fa', 'request_id': 'req-d47cb944-092d-4057-b68d-b08e7f1aee2d'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:26.738076 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-d47cb944-092d-4057-b68d-b08e7f1aee2d admin admin] The token cache is being invalidate because project 77a6cbcad4644f0689b5b28e4ca588fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:23:26.738696 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-d47cb944-092d-4057-b68d-b08e7f1aee2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:26.739663 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-d47cb944-092d-4057-b68d-b08e7f1aee2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:26.742006 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1027/2068] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:23:26 2022] DELETE /identity/v3/projects/77a6cbcad4644f0689b5b28e4ca588fa => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:23:26.751771 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bc988-0d20-4714-8a15-16b51fd2bb85 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:26.752213 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bc988-0d20-4714-8a15-16b51fd2bb85 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:26.752662 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bc988-0d20-4714-8a15-16b51fd2bb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:26.753651 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:26.765643 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7983957b-71e8-407f-98ff-ae5ebd71c654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:26.766675 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983957b-71e8-407f-98ff-ae5ebd71c654 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:26.767128 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983957b-71e8-407f-98ff-ae5ebd71c654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:26.768057 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983957b-71e8-407f-98ff-ae5ebd71c654 admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:26.769641 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7983957b-71e8-407f-98ff-ae5ebd71c654 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:23:26.770607 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7983957b-71e8-407f-98ff-ae5ebd71c654 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:26.775123 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7983957b-71e8-407f-98ff-ae5ebd71c654 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:26.785878 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-b37bc988-0d20-4714-8a15-16b51fd2bb85 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:26.788035 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-b37bc988-0d20-4714-8a15-16b51fd2bb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:26.803095 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1028/2069] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:23:26.809115 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1042/2070] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:23:26.813956 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bc988-0d20-4714-8a15-16b51fd2bb85 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:26.814731 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c04c2-8692-4ec9-91f3-b5ef355450ce None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:26.815148 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c04c2-8692-4ec9-91f3-b5ef355450ce None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:26.815568 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c04c2-8692-4ec9-91f3-b5ef355450ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:26.815753 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-b37bc988-0d20-4714-8a15-16b51fd2bb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:26.828507 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bc988-0d20-4714-8a15-16b51fd2bb85 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:26.834113 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a4bae-14f4-446c-bae2-0e55e98dbc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:26.834790 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a4bae-14f4-446c-bae2-0e55e98dbc1b admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:26.835065 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a4bae-14f4-446c-bae2-0e55e98dbc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:26.835334 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a4bae-14f4-446c-bae2-0e55e98dbc1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:26.835983 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a4bae-14f4-446c-bae2-0e55e98dbc1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:26.838010 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a4bae-14f4-446c-bae2-0e55e98dbc1b admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:26.841119 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-8d3c04c2-8692-4ec9-91f3-b5ef355450ce None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:26.842728 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-8d3c04c2-8692-4ec9-91f3-b5ef355450ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:26.854758 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1043/2071] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:23:26.859578 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c04c2-8692-4ec9-91f3-b5ef355450ce None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:26.873014 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c04c2-8692-4ec9-91f3-b5ef355450ce None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:26.880339 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7e84c-a647-44ef-88f8-668cf45c9a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:26.881438 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7e84c-a647-44ef-88f8-668cf45c9a15 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:26.881852 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7e84c-a647-44ef-88f8-668cf45c9a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:26.882302 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7e84c-a647-44ef-88f8-668cf45c9a15 admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:26.882605 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1029/2072] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:23:26 2022] POST /identity/v3/projects => generated 365 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:23:26.883875 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e7e84c-a647-44ef-88f8-668cf45c9a15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:23:26.884946 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e7e84c-a647-44ef-88f8-668cf45c9a15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:26.886799 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a4bae-14f4-446c-bae2-0e55e98dbc1b admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:26.888525 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e7e84c-a647-44ef-88f8-668cf45c9a15 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:26.913685 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1044/2073] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:23:26.920035 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7e84c-a647-44ef-88f8-668cf45c9a15 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:26.933213 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7e84c-a647-44ef-88f8-668cf45c9a15 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:27.001925 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a4bae-14f4-446c-bae2-0e55e98dbc1b admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:27.010848 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f9346-434b-46ef-a19e-b69dea1b7c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:27.012106 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f9346-434b-46ef-a19e-b69dea1b7c12 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:27.012707 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f9346-434b-46ef-a19e-b69dea1b7c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:27.013254 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f9346-434b-46ef-a19e-b69dea1b7c12 admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:27.014590 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f9346-434b-46ef-a19e-b69dea1b7c12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:27.018759 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f9346-434b-46ef-a19e-b69dea1b7c12 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:27.024364 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618096a-c2cf-43e6-92d8-862e270c901e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:27.024904 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618096a-c2cf-43e6-92d8-862e270c901e admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:27.025194 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618096a-c2cf-43e6-92d8-862e270c901e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:27.025461 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618096a-c2cf-43e6-92d8-862e270c901e admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:27.026149 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0618096a-c2cf-43e6-92d8-862e270c901e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:27.028188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0618096a-c2cf-43e6-92d8-862e270c901e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:27.052859 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1030/2074] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:23:26 2022] POST /identity/v3/users => generated 283 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:23:27.059606 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f9346-434b-46ef-a19e-b69dea1b7c12 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:27.063408 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1045/2075] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:23:26 2022] POST /identity/v3/projects => generated 371 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:23:27.068328 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618096a-c2cf-43e6-92d8-862e270c901e admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:27.078749 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f9346-434b-46ef-a19e-b69dea1b7c12 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:27.164438 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618096a-c2cf-43e6-92d8-862e270c901e admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:27.176724 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e293b-c779-4eec-9b13-748c3b8fdb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:27.177921 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e293b-c779-4eec-9b13-748c3b8fdb0a admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:27.178518 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e293b-c779-4eec-9b13-748c3b8fdb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:27.179201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e293b-c779-4eec-9b13-748c3b8fdb0a admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:27.180789 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e293b-c779-4eec-9b13-748c3b8fdb0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:27.185080 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e293b-c779-4eec-9b13-748c3b8fdb0a admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:27.187708 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f60ac-b0e7-4c52-8a47-5d933cca9625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:27.188620 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f60ac-b0e7-4c52-8a47-5d933cca9625 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:27.189089 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f60ac-b0e7-4c52-8a47-5d933cca9625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:27.189691 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f60ac-b0e7-4c52-8a47-5d933cca9625 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:27.190685 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38f60ac-b0e7-4c52-8a47-5d933cca9625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:27.192953 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38f60ac-b0e7-4c52-8a47-5d933cca9625 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:27.230615 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1046/2076] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:23:27 2022] POST /identity/v3/users => generated 286 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:23:27.236011 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e293b-c779-4eec-9b13-748c3b8fdb0a admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:27.237212 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1031/2077] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:23:27.241733 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f60ac-b0e7-4c52-8a47-5d933cca9625 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:27.265564 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e293b-c779-4eec-9b13-748c3b8fdb0a admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:27.275126 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd218d4-ac59-4cc2-94a0-fece609c7a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:27.275820 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd218d4-ac59-4cc2-94a0-fece609c7a7e admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:27.276107 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd218d4-ac59-4cc2-94a0-fece609c7a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:27.276384 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd218d4-ac59-4cc2-94a0-fece609c7a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:27.277083 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd218d4-ac59-4cc2-94a0-fece609c7a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:27.278543 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f60ac-b0e7-4c52-8a47-5d933cca9625 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:27.281509 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd218d4-ac59-4cc2-94a0-fece609c7a7e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:27.297626 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1047/2078] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:23:27.300364 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7d5dc-3d26-418b-b660-09cd95d56788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:27.301046 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7d5dc-3d26-418b-b660-09cd95d56788 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:27.301422 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7d5dc-3d26-418b-b660-09cd95d56788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:27.301737 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7d5dc-3d26-418b-b660-09cd95d56788 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:27.303303 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f7d5dc-3d26-418b-b660-09cd95d56788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:27.304221 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f7d5dc-3d26-418b-b660-09cd95d56788 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:27.306680 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd218d4-ac59-4cc2-94a0-fece609c7a7e admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:27.307256 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:27.323792 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1032/2079] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:23:27.325408 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7d5dc-3d26-418b-b660-09cd95d56788 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:27.327111 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd218d4-ac59-4cc2-94a0-fece609c7a7e admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:27.335594 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb109c7-04c2-419c-a971-8f6583443f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:27.337081 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb109c7-04c2-419c-a971-8f6583443f0c admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:27.337643 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb109c7-04c2-419c-a971-8f6583443f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:27.338124 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb109c7-04c2-419c-a971-8f6583443f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:27.338476 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7d5dc-3d26-418b-b660-09cd95d56788 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:27.339303 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb109c7-04c2-419c-a971-8f6583443f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:27.341889 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb109c7-04c2-419c-a971-8f6583443f0c admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:27.345890 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0b849-e08f-4418-a348-4c199dce3e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:27.346714 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0b849-e08f-4418-a348-4c199dce3e24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:27.347065 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0b849-e08f-4418-a348-4c199dce3e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:27.347412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0b849-e08f-4418-a348-4c199dce3e24 admin admin] PATH_INFO: `/v3/projects/80d40ebe44324103be90510abe8db10c/users/849b8a86e0c5414ba38cf573a1ab5ca1/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:27.360590 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1048/2080] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:23:27.365780 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb109c7-04c2-419c-a971-8f6583443f0c admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:27.369648 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f0b849-e08f-4418-a348-4c199dce3e24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80d40ebe44324103be90510abe8db10c, user_id=849b8a86e0c5414ba38cf573a1ab5ca1, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:27.372941 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f0b849-e08f-4418-a348-4c199dce3e24 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:27.382009 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb109c7-04c2-419c-a971-8f6583443f0c admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:27.391660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43a046-ec89-4127-bef1-f1b367e93889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:27.392660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43a046-ec89-4127-bef1-f1b367e93889 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:27.393791 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43a046-ec89-4127-bef1-f1b367e93889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:27.394102 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43a046-ec89-4127-bef1-f1b367e93889 admin admin] PATH_INFO: `/v3/projects/0582ebd3369b403ca66ecf9b4cbd003e/users/b46c06d66cc14dd2ad3b33d1c9b0d641/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:27.397085 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1033/2081] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:23:27 2022] PUT /identity/v3/projects/80d40ebe44324103be90510abe8db10c/users/849b8a86e0c5414ba38cf573a1ab5ca1/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:27.413273 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687de000-4684-497d-b205-ea16d06372bf None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:27.413706 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687de000-4684-497d-b205-ea16d06372bf None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:27.414459 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687de000-4684-497d-b205-ea16d06372bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:27.424196 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db43a046-ec89-4127-bef1-f1b367e93889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0582ebd3369b403ca66ecf9b4cbd003e, user_id=b46c06d66cc14dd2ad3b33d1c9b0d641, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:27.428734 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db43a046-ec89-4127-bef1-f1b367e93889 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:27.441797 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:27.449237 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1049/2082] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:23:27 2022] PUT /identity/v3/projects/0582ebd3369b403ca66ecf9b4cbd003e/users/b46c06d66cc14dd2ad3b33d1c9b0d641/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:23:27.454320 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e6a85-c029-47e2-8b48-69a6c4ff3b97 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:27.455599 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e6a85-c029-47e2-8b48-69a6c4ff3b97 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:27.456006 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e6a85-c029-47e2-8b48-69a6c4ff3b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:27.461839 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-687de000-4684-497d-b205-ea16d06372bf None None] MFA Rules not processed for user `849b8a86e0c5414ba38cf573a1ab5ca1`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:27.464160 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-687de000-4684-497d-b205-ea16d06372bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:27.485920 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-ef1e6a85-c029-47e2-8b48-69a6c4ff3b97 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:27.487336 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ef1e6a85-c029-47e2-8b48-69a6c4ff3b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:27.566512 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1034/2083] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:23:27.578100 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687de000-4684-497d-b205-ea16d06372bf None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:27.615156 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1050/2084] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:23:27.628796 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e6a85-c029-47e2-8b48-69a6c4ff3b97 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:27.632832 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ef1e6a85-c029-47e2-8b48-69a6c4ff3b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:27.747682 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687de000-4684-497d-b205-ea16d06372bf None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:27.753823 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5619970-7c22-4032-9db9-f21fb4a8dda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:27.754494 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5619970-7c22-4032-9db9-f21fb4a8dda2 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:27.754770 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5619970-7c22-4032-9db9-f21fb4a8dda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:27.755039 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5619970-7c22-4032-9db9-f21fb4a8dda2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:27.755697 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5619970-7c22-4032-9db9-f21fb4a8dda2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:27.758775 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5619970-7c22-4032-9db9-f21fb4a8dda2 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:27.781762 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e6a85-c029-47e2-8b48-69a6c4ff3b97 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:27.790264 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420ec41-cb48-4260-8819-48c729ad78c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:27.791377 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420ec41-cb48-4260-8819-48c729ad78c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:27.792081 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420ec41-cb48-4260-8819-48c729ad78c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:27.792473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420ec41-cb48-4260-8819-48c729ad78c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:27.796552 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1035/2085] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:23:27 2022] POST /identity/v3/projects => generated 365 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:23:27.800563 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5619970-7c22-4032-9db9-f21fb4a8dda2 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:27.813442 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9420ec41-cb48-4260-8819-48c729ad78c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:27.816514 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9420ec41-cb48-4260-8819-48c729ad78c4 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:27.836222 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1051/2086] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:23:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:23:27.866744 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:27.888731 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5619970-7c22-4032-9db9-f21fb4a8dda2 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:27.894621 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43019c27-3269-4708-8d13-740162172903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:27.895259 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43019c27-3269-4708-8d13-740162172903 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:27.895558 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43019c27-3269-4708-8d13-740162172903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:27.895986 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43019c27-3269-4708-8d13-740162172903 admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:27.896482 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43019c27-3269-4708-8d13-740162172903 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:27.900315 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43019c27-3269-4708-8d13-740162172903 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:27.936775 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1036/2087] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:23:27 2022] POST /identity/v3/users => generated 289 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:23:27.940088 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420ec41-cb48-4260-8819-48c729ad78c4 service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:27.960503 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420ec41-cb48-4260-8819-48c729ad78c4 service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:27.970500 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eec6f1-700e-4e35-99e8-11c892a6e67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:27.970500 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eec6f1-700e-4e35-99e8-11c892a6e67b admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:27.970500 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eec6f1-700e-4e35-99e8-11c892a6e67b admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:27.971090 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eec6f1-700e-4e35-99e8-11c892a6e67b admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:27.971492 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eec6f1-700e-4e35-99e8-11c892a6e67b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:27.973906 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eec6f1-700e-4e35-99e8-11c892a6e67b admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:27.986501 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1052/2088] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:23:27.991834 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43019c27-3269-4708-8d13-740162172903 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:28.005006 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43019c27-3269-4708-8d13-740162172903 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:28.011463 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e80b2-d463-4a03-bbc4-4eab5ddb66ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:28.012282 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e80b2-d463-4a03-bbc4-4eab5ddb66ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:28.012754 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e80b2-d463-4a03-bbc4-4eab5ddb66ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:28.013037 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e80b2-d463-4a03-bbc4-4eab5ddb66ce admin admin] PATH_INFO: `/v3/projects/83e8acf854c642bc9f438a42e2be17a3/users/893498a81d274e05bba461a808bbe348/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:28.031739 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e80b2-d463-4a03-bbc4-4eab5ddb66ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=83e8acf854c642bc9f438a42e2be17a3, user_id=893498a81d274e05bba461a808bbe348, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:28.034636 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e80b2-d463-4a03-bbc4-4eab5ddb66ce admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:28.059559 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1037/2089] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:23:27 2022] PUT /identity/v3/projects/83e8acf854c642bc9f438a42e2be17a3/users/893498a81d274e05bba461a808bbe348/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:23:28.061518 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eec6f1-700e-4e35-99e8-11c892a6e67b admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:28.076036 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eec6f1-700e-4e35-99e8-11c892a6e67b admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:28.194725 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be33c8a-79e9-4dfe-b523-b2857fc3f5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:28.196392 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be33c8a-79e9-4dfe-b523-b2857fc3f5c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:28.198268 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be33c8a-79e9-4dfe-b523-b2857fc3f5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:28.198827 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be33c8a-79e9-4dfe-b523-b2857fc3f5c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:28.200100 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be33c8a-79e9-4dfe-b523-b2857fc3f5c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:28.203461 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be33c8a-79e9-4dfe-b523-b2857fc3f5c3 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:28.228744 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1053/2090] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:23:28.231036 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e80b2-d463-4a03-bbc4-4eab5ddb66ce admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:28.251385 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e80b2-d463-4a03-bbc4-4eab5ddb66ce admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:28.260554 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369f923-17ce-4a2c-888c-4ca0cfda35f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:28.261756 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369f923-17ce-4a2c-888c-4ca0cfda35f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:28.262777 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369f923-17ce-4a2c-888c-4ca0cfda35f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:28.262777 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369f923-17ce-4a2c-888c-4ca0cfda35f4 admin admin] PATH_INFO: `/v3/projects/83e8acf854c642bc9f438a42e2be17a3/users/893498a81d274e05bba461a808bbe348/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:28.266636 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e369f923-17ce-4a2c-888c-4ca0cfda35f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83e8acf854c642bc9f438a42e2be17a3, user_id=893498a81d274e05bba461a808bbe348, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:28.272291 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e369f923-17ce-4a2c-888c-4ca0cfda35f4 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:28.296925 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1038/2091] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:23:28 2022] PUT /identity/v3/projects/83e8acf854c642bc9f438a42e2be17a3/users/893498a81d274e05bba461a808bbe348/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:28.317993 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79fd41-60d6-41b0-8563-b3b53806b3a5 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:28.318727 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79fd41-60d6-41b0-8563-b3b53806b3a5 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:28.319335 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79fd41-60d6-41b0-8563-b3b53806b3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:28.374888 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-af79fd41-60d6-41b0-8563-b3b53806b3a5 None None] MFA Rules not processed for user `893498a81d274e05bba461a808bbe348`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:28.377269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-af79fd41-60d6-41b0-8563-b3b53806b3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:28.413919 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:28.521788 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1054/2092] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:28 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:23:28.538168 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369f923-17ce-4a2c-888c-4ca0cfda35f4 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:28.541457 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-e369f923-17ce-4a2c-888c-4ca0cfda35f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:28.733192 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369f923-17ce-4a2c-888c-4ca0cfda35f4 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:28.737949 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532ec96-8e14-45c6-b49c-3a5c7d4be906 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:28.738767 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532ec96-8e14-45c6-b49c-3a5c7d4be906 service cinder] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:28.739119 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532ec96-8e14-45c6-b49c-3a5c7d4be906 service cinder] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:28.739472 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532ec96-8e14-45c6-b49c-3a5c7d4be906 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:28.750853 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b532ec96-8e14-45c6-b49c-3a5c7d4be906 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:28.752435 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b532ec96-8e14-45c6-b49c-3a5c7d4be906 service cinder] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:28.764962 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1039/2093] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:23:28 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:23:28.896974 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79fd41-60d6-41b0-8563-b3b53806b3a5 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:28.916427 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79fd41-60d6-41b0-8563-b3b53806b3a5 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:28.925757 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39573086-7d90-49a2-aa2b-e5c0494e683c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:28.926678 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39573086-7d90-49a2-aa2b-e5c0494e683c service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:28.927148 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39573086-7d90-49a2-aa2b-e5c0494e683c service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:28.927761 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39573086-7d90-49a2-aa2b-e5c0494e683c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:29.066638 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39573086-7d90-49a2-aa2b-e5c0494e683c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:29.070585 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39573086-7d90-49a2-aa2b-e5c0494e683c service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:29.084267 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1055/2094] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:23:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:23:29.228843 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43cbaf-6127-48ad-9def-fcf0e05d233f None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:29.229378 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43cbaf-6127-48ad-9def-fcf0e05d233f None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:29.229733 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43cbaf-6127-48ad-9def-fcf0e05d233f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:29.284842 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-7b43cbaf-6127-48ad-9def-fcf0e05d233f None None] MFA Rules not processed for user `b46c06d66cc14dd2ad3b33d1c9b0d641`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:29.287185 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-7b43cbaf-6127-48ad-9def-fcf0e05d233f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:29.425092 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1040/2095] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:23:29.427752 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39573086-7d90-49a2-aa2b-e5c0494e683c service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:29.529849 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39573086-7d90-49a2-aa2b-e5c0494e683c service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:29.538982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b077bdd-e6fe-47af-bc48-a70a1d19cdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:29.539687 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b077bdd-e6fe-47af-bc48-a70a1d19cdc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:29.540077 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b077bdd-e6fe-47af-bc48-a70a1d19cdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:29.540245 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b077bdd-e6fe-47af-bc48-a70a1d19cdc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:29.540982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b077bdd-e6fe-47af-bc48-a70a1d19cdc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:29.543443 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b077bdd-e6fe-47af-bc48-a70a1d19cdc5 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:29.584737 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1056/2096] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:23:29 2022] POST /identity/v3/projects => generated 373 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:23:29.590855 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43cbaf-6127-48ad-9def-fcf0e05d233f None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:29.602840 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43cbaf-6127-48ad-9def-fcf0e05d233f None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:29.640054 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:29.670976 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eca044-a2c7-4a5c-abd5-a7e6d12094c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:29.671506 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eca044-a2c7-4a5c-abd5-a7e6d12094c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:29.671785 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eca044-a2c7-4a5c-abd5-a7e6d12094c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:29.672059 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eca044-a2c7-4a5c-abd5-a7e6d12094c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:29.672721 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eca044-a2c7-4a5c-abd5-a7e6d12094c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:29.674765 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eca044-a2c7-4a5c-abd5-a7e6d12094c6 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:29.701375 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1041/2097] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:23:29 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:23:29.707148 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b077bdd-e6fe-47af-bc48-a70a1d19cdc5 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:29.725294 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b077bdd-e6fe-47af-bc48-a70a1d19cdc5 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:29.733661 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e402da-fe49-475f-9d43-a94ef76a3d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:29.734787 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e402da-fe49-475f-9d43-a94ef76a3d7a admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:29.735293 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e402da-fe49-475f-9d43-a94ef76a3d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:29.735826 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e402da-fe49-475f-9d43-a94ef76a3d7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:29.737468 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e402da-fe49-475f-9d43-a94ef76a3d7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:29.741135 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e402da-fe49-475f-9d43-a94ef76a3d7a admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:29.759433 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1057/2098] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:23:29.764215 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eca044-a2c7-4a5c-abd5-a7e6d12094c6 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:29.778343 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eca044-a2c7-4a5c-abd5-a7e6d12094c6 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:29.783943 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3bdd47-bab1-4774-8c65-87c5560f27ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:29.784881 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3bdd47-bab1-4774-8c65-87c5560f27ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:29.785386 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3bdd47-bab1-4774-8c65-87c5560f27ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:29.785823 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3bdd47-bab1-4774-8c65-87c5560f27ca admin admin] PATH_INFO: `/v3/projects/b5f9514f34524c8092982e274624390e/users/e43e7ed267b14ba19dbcb52f800b00f5/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:29.809364 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3bdd47-bab1-4774-8c65-87c5560f27ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5f9514f34524c8092982e274624390e, user_id=e43e7ed267b14ba19dbcb52f800b00f5, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:29.812710 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3bdd47-bab1-4774-8c65-87c5560f27ca admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:29.834214 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1042/2099] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:23:29 2022] PUT /identity/v3/projects/b5f9514f34524c8092982e274624390e/users/e43e7ed267b14ba19dbcb52f800b00f5/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:23:29.839191 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e402da-fe49-475f-9d43-a94ef76a3d7a admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:29.850418 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e402da-fe49-475f-9d43-a94ef76a3d7a admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:29.881633 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:29.922539 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a744b84-dfdd-49a3-9785-3d54dfed3ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:29.923299 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a744b84-dfdd-49a3-9785-3d54dfed3ecc admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:29.923430 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a744b84-dfdd-49a3-9785-3d54dfed3ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:29.923808 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a744b84-dfdd-49a3-9785-3d54dfed3ecc admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:29.924261 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a744b84-dfdd-49a3-9785-3d54dfed3ecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:29.925924 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a744b84-dfdd-49a3-9785-3d54dfed3ecc admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:29.937951 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1058/2100] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:23:29.944888 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3bdd47-bab1-4774-8c65-87c5560f27ca admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:29.969750 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3bdd47-bab1-4774-8c65-87c5560f27ca admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:29.977542 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186a1ef-fd60-460e-9b8c-e1fb1c8ffa50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:29.978634 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186a1ef-fd60-460e-9b8c-e1fb1c8ffa50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:29.979092 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186a1ef-fd60-460e-9b8c-e1fb1c8ffa50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:29.979552 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186a1ef-fd60-460e-9b8c-e1fb1c8ffa50 admin admin] PATH_INFO: `/v3/projects/b5f9514f34524c8092982e274624390e/users/e43e7ed267b14ba19dbcb52f800b00f5/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:29.982926 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5186a1ef-fd60-460e-9b8c-e1fb1c8ffa50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5f9514f34524c8092982e274624390e, user_id=e43e7ed267b14ba19dbcb52f800b00f5, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:29.988537 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5186a1ef-fd60-460e-9b8c-e1fb1c8ffa50 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:30.009297 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1043/2101] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:23:29 2022] PUT /identity/v3/projects/b5f9514f34524c8092982e274624390e/users/e43e7ed267b14ba19dbcb52f800b00f5/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:31.330547 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ced34f-7098-4ad5-ba2e-6445d959c8b2 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:31.331411 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ced34f-7098-4ad5-ba2e-6445d959c8b2 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:31.331411 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ced34f-7098-4ad5-ba2e-6445d959c8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:31.376386 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-52ced34f-7098-4ad5-ba2e-6445d959c8b2 None None] MFA Rules not processed for user `e43e7ed267b14ba19dbcb52f800b00f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:31.377757 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-52ced34f-7098-4ad5-ba2e-6445d959c8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:31.506397 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1059/2102] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:31 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:23:31.523099 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78afc35-9f8a-4570-9de7-f7f2cf51cdfa None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:31.524480 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78afc35-9f8a-4570-9de7-f7f2cf51cdfa None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:31.524958 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78afc35-9f8a-4570-9de7-f7f2cf51cdfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:31.553008 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-b78afc35-9f8a-4570-9de7-f7f2cf51cdfa None None] MFA Rules not processed for user `b46c06d66cc14dd2ad3b33d1c9b0d641`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:31.554855 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-b78afc35-9f8a-4570-9de7-f7f2cf51cdfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:31.671775 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1044/2103] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:23:31.685936 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ced34f-7098-4ad5-ba2e-6445d959c8b2 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:31.688282 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-52ced34f-7098-4ad5-ba2e-6445d959c8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:31.795127 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ced34f-7098-4ad5-ba2e-6445d959c8b2 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:31.802642 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f808217-918d-46ba-ba63-6efeae104df9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:31.803547 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f808217-918d-46ba-ba63-6efeae104df9 service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:31.803920 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f808217-918d-46ba-ba63-6efeae104df9 service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:31.804278 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f808217-918d-46ba-ba63-6efeae104df9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:31.816454 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f808217-918d-46ba-ba63-6efeae104df9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:31.818338 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f808217-918d-46ba-ba63-6efeae104df9 service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:31.831563 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1060/2104] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:23:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:23:35.021371 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78afc35-9f8a-4570-9de7-f7f2cf51cdfa None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:35.024067 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-b78afc35-9f8a-4570-9de7-f7f2cf51cdfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:35.163664 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78afc35-9f8a-4570-9de7-f7f2cf51cdfa None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:35.172681 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c52bec-af04-48d7-ae7e-04a92ef9da77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:35.173714 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c52bec-af04-48d7-ae7e-04a92ef9da77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:35.173862 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c52bec-af04-48d7-ae7e-04a92ef9da77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:35.174054 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c52bec-af04-48d7-ae7e-04a92ef9da77 admin admin] PATH_INFO: `/v3/users/04b9f8825a6c4adeb941e987a447d1a1` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:35.175430 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c52bec-af04-48d7-ae7e-04a92ef9da77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04b9f8825a6c4adeb941e987a447d1a1)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:35.177648 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c52bec-af04-48d7-ae7e-04a92ef9da77 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:35.237024 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:35.265131 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-a0c52bec-af04-48d7-ae7e-04a92ef9da77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04b9f8825a6c4adeb941e987a447d1a1'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:35.286592 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-a0c52bec-af04-48d7-ae7e-04a92ef9da77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04b9f8825a6c4adeb941e987a447d1a1'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:35.299837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-a0c52bec-af04-48d7-ae7e-04a92ef9da77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04b9f8825a6c4adeb941e987a447d1a1'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:35.300922 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-a0c52bec-af04-48d7-ae7e-04a92ef9da77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04b9f8825a6c4adeb941e987a447d1a1'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:35.311139 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-a0c52bec-af04-48d7-ae7e-04a92ef9da77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04b9f8825a6c4adeb941e987a447d1a1'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:35.320059 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1045/2105] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:23:35 2022] DELETE /identity/v3/users/04b9f8825a6c4adeb941e987a447d1a1 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:35.329421 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a855c76-e4bc-45c5-a169-bc8b767d485c None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:35.330319 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a855c76-e4bc-45c5-a169-bc8b767d485c None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:35.330319 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a855c76-e4bc-45c5-a169-bc8b767d485c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:35.361550 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-1a855c76-e4bc-45c5-a169-bc8b767d485c None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:35.363860 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-1a855c76-e4bc-45c5-a169-bc8b767d485c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:35.405103 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:35.454082 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1061/2106] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:23:35.465864 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c52bec-af04-48d7-ae7e-04a92ef9da77 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:35.468236 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-a0c52bec-af04-48d7-ae7e-04a92ef9da77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:35.570652 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c52bec-af04-48d7-ae7e-04a92ef9da77 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:35.580541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ea0bc-b594-4109-aa15-4276ac86ca8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:35.581246 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ea0bc-b594-4109-aa15-4276ac86ca8a service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:35.581602 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ea0bc-b594-4109-aa15-4276ac86ca8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:35.581941 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ea0bc-b594-4109-aa15-4276ac86ca8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:35.604755 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ea0bc-b594-4109-aa15-4276ac86ca8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:35.607626 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461ea0bc-b594-4109-aa15-4276ac86ca8a service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:35.630000 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1046/2107] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:23:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:23:36.104120 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a855c76-e4bc-45c5-a169-bc8b767d485c None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:36.106350 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-1a855c76-e4bc-45c5-a169-bc8b767d485c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:36.129527 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a855c76-e4bc-45c5-a169-bc8b767d485c None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:36.141346 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a3dae-0753-407d-abd5-569e80209b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:36.142581 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a3dae-0753-407d-abd5-569e80209b6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:36.143356 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a3dae-0753-407d-abd5-569e80209b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:36.144167 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a3dae-0753-407d-abd5-569e80209b6c admin admin] PATH_INFO: `/v3/projects/e1162d51bdde497ea2697b89d5abcb93` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:36.146580 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a3dae-0753-407d-abd5-569e80209b6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1162d51bdde497ea2697b89d5abcb93)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:36.150906 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a3dae-0753-407d-abd5-569e80209b6c admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:36.282810 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-e71a3dae-0753-407d-abd5-569e80209b6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1162d51bdde497ea2697b89d5abcb93', 'request_id': 'req-e71a3dae-0753-407d-abd5-569e80209b6c'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:36.301469 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-e71a3dae-0753-407d-abd5-569e80209b6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1162d51bdde497ea2697b89d5abcb93', 'request_id': 'req-e71a3dae-0753-407d-abd5-569e80209b6c'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:36.311278 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-e71a3dae-0753-407d-abd5-569e80209b6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1162d51bdde497ea2697b89d5abcb93', 'request_id': 'req-e71a3dae-0753-407d-abd5-569e80209b6c'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:36.328692 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-e71a3dae-0753-407d-abd5-569e80209b6c admin admin] The token cache is being invalidate because project e1162d51bdde497ea2697b89d5abcb93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:23:36.330630 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-e71a3dae-0753-407d-abd5-569e80209b6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:36.330630 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-e71a3dae-0753-407d-abd5-569e80209b6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:36.335490 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1062/2108] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:23:36 2022] DELETE /identity/v3/projects/e1162d51bdde497ea2697b89d5abcb93 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:36.338226 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3a99c-6eb1-4fad-a3b1-ae98ebc1e238 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:36.338800 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3a99c-6eb1-4fad-a3b1-ae98ebc1e238 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:36.339003 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3a99c-6eb1-4fad-a3b1-ae98ebc1e238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:36.374797 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-e7f3a99c-6eb1-4fad-a3b1-ae98ebc1e238 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:36.376337 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-e7f3a99c-6eb1-4fad-a3b1-ae98ebc1e238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:36.470016 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1047/2109] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:23:36.479360 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20673c08-9429-43e1-9c57-da3832e45689 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:36.479660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20673c08-9429-43e1-9c57-da3832e45689 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:36.480086 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20673c08-9429-43e1-9c57-da3832e45689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:36.501668 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-20673c08-9429-43e1-9c57-da3832e45689 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:36.503111 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-20673c08-9429-43e1-9c57-da3832e45689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:36.512107 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1063/2110] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:23:36.516693 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3a99c-6eb1-4fad-a3b1-ae98ebc1e238 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:36.528177 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3a99c-6eb1-4fad-a3b1-ae98ebc1e238 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:36.533051 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24494505-7b9a-48e4-91b4-f0607671e182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:36.533688 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24494505-7b9a-48e4-91b4-f0607671e182 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:36.538011 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24494505-7b9a-48e4-91b4-f0607671e182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:36.538515 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24494505-7b9a-48e4-91b4-f0607671e182 admin admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:36.539984 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24494505-7b9a-48e4-91b4-f0607671e182 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:23:36.540689 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24494505-7b9a-48e4-91b4-f0607671e182 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:36.542354 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24494505-7b9a-48e4-91b4-f0607671e182 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:36.560771 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1048/2111] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:23:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:23:36.565256 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20673c08-9429-43e1-9c57-da3832e45689 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:36.575546 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20673c08-9429-43e1-9c57-da3832e45689 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:36.581085 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291ecd5-21f8-4210-8860-93692273d74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:36.581845 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291ecd5-21f8-4210-8860-93692273d74a admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:36.582928 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291ecd5-21f8-4210-8860-93692273d74a admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:36.582928 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291ecd5-21f8-4210-8860-93692273d74a admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:36.583388 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f291ecd5-21f8-4210-8860-93692273d74a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:36.585464 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f291ecd5-21f8-4210-8860-93692273d74a admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:36.618845 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1064/2112] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:23:36 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:23:36.623224 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24494505-7b9a-48e4-91b4-f0607671e182 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:36.637327 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24494505-7b9a-48e4-91b4-f0607671e182 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:36.696599 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:36.725244 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb464b0-8d72-44ce-8e51-fef10c262b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:36.727521 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb464b0-8d72-44ce-8e51-fef10c262b35 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:36.727780 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb464b0-8d72-44ce-8e51-fef10c262b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:36.728140 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb464b0-8d72-44ce-8e51-fef10c262b35 admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:36.728857 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb464b0-8d72-44ce-8e51-fef10c262b35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:36.731700 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb464b0-8d72-44ce-8e51-fef10c262b35 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:36.763394 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1049/2113] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:23:36 2022] POST /identity/v3/users => generated 287 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:23:36.768975 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291ecd5-21f8-4210-8860-93692273d74a admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:36.792698 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291ecd5-21f8-4210-8860-93692273d74a admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:36.801476 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5817013-f42d-49a7-a74e-66950265eb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:36.803594 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5817013-f42d-49a7-a74e-66950265eb38 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:36.804511 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5817013-f42d-49a7-a74e-66950265eb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:36.805535 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5817013-f42d-49a7-a74e-66950265eb38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:36.806738 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5817013-f42d-49a7-a74e-66950265eb38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:36.810492 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5817013-f42d-49a7-a74e-66950265eb38 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:36.830866 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1065/2114] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:23:36.839830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb464b0-8d72-44ce-8e51-fef10c262b35 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:36.856146 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb464b0-8d72-44ce-8e51-fef10c262b35 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:36.862131 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e481b-87dd-4b48-a53b-2fe4bdf57785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:36.862864 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e481b-87dd-4b48-a53b-2fe4bdf57785 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:36.863320 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e481b-87dd-4b48-a53b-2fe4bdf57785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:36.863547 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e481b-87dd-4b48-a53b-2fe4bdf57785 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:36.864262 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e481b-87dd-4b48-a53b-2fe4bdf57785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:36.866152 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e481b-87dd-4b48-a53b-2fe4bdf57785 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:36.880264 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1050/2115] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:23:36.886059 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5817013-f42d-49a7-a74e-66950265eb38 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:36.900530 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5817013-f42d-49a7-a74e-66950265eb38 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:36.906619 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ec6f5-bf8e-4e69-ae8e-28302d353454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:36.907483 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ec6f5-bf8e-4e69-ae8e-28302d353454 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:36.907773 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ec6f5-bf8e-4e69-ae8e-28302d353454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:36.908052 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ec6f5-bf8e-4e69-ae8e-28302d353454 admin admin] PATH_INFO: `/v3/projects/522adaf9c6654133be1215ab1d4e26f0/users/bcfb8c74de5c42f692e6f1b248465f3e/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:36.938081 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ec6f5-bf8e-4e69-ae8e-28302d353454 admin admin] RBAC: Authorizing `identity:create_grant(project_id=522adaf9c6654133be1215ab1d4e26f0, user_id=bcfb8c74de5c42f692e6f1b248465f3e, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:36.942834 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ec6f5-bf8e-4e69-ae8e-28302d353454 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:36.967425 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1066/2116] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:23:36 2022] PUT /identity/v3/projects/522adaf9c6654133be1215ab1d4e26f0/users/bcfb8c74de5c42f692e6f1b248465f3e/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:23:36.989123 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be82bbd9-2365-46a1-9da7-9bb51022f17d None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:36.989524 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be82bbd9-2365-46a1-9da7-9bb51022f17d None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:36.989905 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be82bbd9-2365-46a1-9da7-9bb51022f17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:37.036889 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-be82bbd9-2365-46a1-9da7-9bb51022f17d None None] MFA Rules not processed for user `bcfb8c74de5c42f692e6f1b248465f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:37.041279 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-be82bbd9-2365-46a1-9da7-9bb51022f17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:37.134303 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1051/2117] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:23:37.146135 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ec6f5-bf8e-4e69-ae8e-28302d353454 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:37.148080 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-318ec6f5-bf8e-4e69-ae8e-28302d353454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:37.231137 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ec6f5-bf8e-4e69-ae8e-28302d353454 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:37.235630 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176d5b5-3135-49eb-93fb-bb492ec2151a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:37.236181 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176d5b5-3135-49eb-93fb-bb492ec2151a service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:37.236461 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176d5b5-3135-49eb-93fb-bb492ec2151a service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:37.236732 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176d5b5-3135-49eb-93fb-bb492ec2151a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:37.244772 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:37.248243 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7176d5b5-3135-49eb-93fb-bb492ec2151a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:37.250631 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7176d5b5-3135-49eb-93fb-bb492ec2151a service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:37.263809 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1067/2118] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:23:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:23:37.608827 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be82bbd9-2365-46a1-9da7-9bb51022f17d None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:37.611759 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-be82bbd9-2365-46a1-9da7-9bb51022f17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:37.751785 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be82bbd9-2365-46a1-9da7-9bb51022f17d None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:37.758267 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78978f25-b5e4-46d6-b6f8-48d86dcada61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:37.759625 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78978f25-b5e4-46d6-b6f8-48d86dcada61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:37.760179 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78978f25-b5e4-46d6-b6f8-48d86dcada61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:37.760791 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78978f25-b5e4-46d6-b6f8-48d86dcada61 admin admin] PATH_INFO: `/v3/users/849b8a86e0c5414ba38cf573a1ab5ca1` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:37.763222 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78978f25-b5e4-46d6-b6f8-48d86dcada61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=849b8a86e0c5414ba38cf573a1ab5ca1)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:37.767642 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78978f25-b5e4-46d6-b6f8-48d86dcada61 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:37.870787 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-78978f25-b5e4-46d6-b6f8-48d86dcada61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '849b8a86e0c5414ba38cf573a1ab5ca1'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:37.873541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:37.893282 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-78978f25-b5e4-46d6-b6f8-48d86dcada61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '849b8a86e0c5414ba38cf573a1ab5ca1'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:37.905432 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-78978f25-b5e4-46d6-b6f8-48d86dcada61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '849b8a86e0c5414ba38cf573a1ab5ca1'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:37.906734 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-78978f25-b5e4-46d6-b6f8-48d86dcada61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '849b8a86e0c5414ba38cf573a1ab5ca1'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:37.917284 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-78978f25-b5e4-46d6-b6f8-48d86dcada61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '849b8a86e0c5414ba38cf573a1ab5ca1'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:37.929504 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1052/2119] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:23:37 2022] DELETE /identity/v3/users/849b8a86e0c5414ba38cf573a1ab5ca1 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:37.936303 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774a97d-e59f-403c-b60e-9577f14401ac None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:37.937265 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774a97d-e59f-403c-b60e-9577f14401ac None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:37.937265 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774a97d-e59f-403c-b60e-9577f14401ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:37.965958 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-0774a97d-e59f-403c-b60e-9577f14401ac None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:37.968206 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-0774a97d-e59f-403c-b60e-9577f14401ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:38.035130 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1068/2120] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:23:38.047000 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78978f25-b5e4-46d6-b6f8-48d86dcada61 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:38.049125 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-78978f25-b5e4-46d6-b6f8-48d86dcada61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:38.122939 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78978f25-b5e4-46d6-b6f8-48d86dcada61 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:38.127616 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d0b0c-30b6-4160-93b2-5b5723715ead service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:38.128384 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d0b0c-30b6-4160-93b2-5b5723715ead service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:38.128767 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d0b0c-30b6-4160-93b2-5b5723715ead service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:38.129135 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d0b0c-30b6-4160-93b2-5b5723715ead service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:38.141430 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d0b0c-30b6-4160-93b2-5b5723715ead service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:38.143138 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d0b0c-30b6-4160-93b2-5b5723715ead service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:38.159075 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1053/2121] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:23:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:23:38.567423 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774a97d-e59f-403c-b60e-9577f14401ac None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:38.569153 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-0774a97d-e59f-403c-b60e-9577f14401ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:38.593734 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774a97d-e59f-403c-b60e-9577f14401ac None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:38.604364 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938d0b4-5974-4213-8565-53cba1890395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:38.605338 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938d0b4-5974-4213-8565-53cba1890395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:38.605474 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938d0b4-5974-4213-8565-53cba1890395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:38.605731 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938d0b4-5974-4213-8565-53cba1890395 admin admin] PATH_INFO: `/v3/projects/80d40ebe44324103be90510abe8db10c` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:38.607911 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6938d0b4-5974-4213-8565-53cba1890395 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80d40ebe44324103be90510abe8db10c)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:38.611540 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6938d0b4-5974-4213-8565-53cba1890395 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:38.681786 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-6938d0b4-5974-4213-8565-53cba1890395 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80d40ebe44324103be90510abe8db10c', 'request_id': 'req-6938d0b4-5974-4213-8565-53cba1890395'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:38.691774 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-6938d0b4-5974-4213-8565-53cba1890395 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80d40ebe44324103be90510abe8db10c', 'request_id': 'req-6938d0b4-5974-4213-8565-53cba1890395'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:38.702453 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-6938d0b4-5974-4213-8565-53cba1890395 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80d40ebe44324103be90510abe8db10c', 'request_id': 'req-6938d0b4-5974-4213-8565-53cba1890395'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:38.719462 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-6938d0b4-5974-4213-8565-53cba1890395 admin admin] The token cache is being invalidate because project 80d40ebe44324103be90510abe8db10c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:23:38.719907 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-6938d0b4-5974-4213-8565-53cba1890395 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:38.720745 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-6938d0b4-5974-4213-8565-53cba1890395 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:38.722641 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1069/2122] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:23:38 2022] DELETE /identity/v3/projects/80d40ebe44324103be90510abe8db10c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:23:38.728251 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d0b0c-30b6-4160-93b2-5b5723715ead service neutron] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:38.744652 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d0b0c-30b6-4160-93b2-5b5723715ead service neutron] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:38.833136 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd942b06-50d7-41e0-83a1-68219336f744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:38.833900 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd942b06-50d7-41e0-83a1-68219336f744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:38.834198 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd942b06-50d7-41e0-83a1-68219336f744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:38.834682 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd942b06-50d7-41e0-83a1-68219336f744 admin admin] PATH_INFO: `/v3/users/893498a81d274e05bba461a808bbe348` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:38.837358 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd942b06-50d7-41e0-83a1-68219336f744 admin admin] RBAC: Authorizing `identity:delete_user(user_id=893498a81d274e05bba461a808bbe348)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:38.841260 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd942b06-50d7-41e0-83a1-68219336f744 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:38.920199 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-cd942b06-50d7-41e0-83a1-68219336f744 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '893498a81d274e05bba461a808bbe348'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:38.944305 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-cd942b06-50d7-41e0-83a1-68219336f744 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '893498a81d274e05bba461a808bbe348'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:38.959229 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-cd942b06-50d7-41e0-83a1-68219336f744 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '893498a81d274e05bba461a808bbe348'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:38.960284 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-cd942b06-50d7-41e0-83a1-68219336f744 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '893498a81d274e05bba461a808bbe348'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:38.963552 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:38.977604 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-cd942b06-50d7-41e0-83a1-68219336f744 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '893498a81d274e05bba461a808bbe348'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:38.985199 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1054/2123] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:23:38 2022] DELETE /identity/v3/users/893498a81d274e05bba461a808bbe348 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:39.008907 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c792626-73dd-4e20-abde-9d7b8a42fd43 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:39.009779 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c792626-73dd-4e20-abde-9d7b8a42fd43 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:39.009779 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c792626-73dd-4e20-abde-9d7b8a42fd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:39.031235 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-2c792626-73dd-4e20-abde-9d7b8a42fd43 None None] MFA Rules not processed for user `bcfb8c74de5c42f692e6f1b248465f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:39.032502 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2c792626-73dd-4e20-abde-9d7b8a42fd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:39.128545 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1070/2124] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:23:39.746581 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd942b06-50d7-41e0-83a1-68219336f744 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:39.750480 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-cd942b06-50d7-41e0-83a1-68219336f744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:39.865449 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd942b06-50d7-41e0-83a1-68219336f744 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:39.871240 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b69eb-973c-46bf-be36-1ba1b70de0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:39.872104 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b69eb-973c-46bf-be36-1ba1b70de0f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:39.872553 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b69eb-973c-46bf-be36-1ba1b70de0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:39.872991 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b69eb-973c-46bf-be36-1ba1b70de0f3 admin admin] PATH_INFO: `/v3/projects/83e8acf854c642bc9f438a42e2be17a3` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:39.874830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b69eb-973c-46bf-be36-1ba1b70de0f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83e8acf854c642bc9f438a42e2be17a3)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:39.877685 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b69eb-973c-46bf-be36-1ba1b70de0f3 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:39.956675 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-de0b69eb-973c-46bf-be36-1ba1b70de0f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83e8acf854c642bc9f438a42e2be17a3', 'request_id': 'req-de0b69eb-973c-46bf-be36-1ba1b70de0f3'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:39.984484 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-de0b69eb-973c-46bf-be36-1ba1b70de0f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83e8acf854c642bc9f438a42e2be17a3', 'request_id': 'req-de0b69eb-973c-46bf-be36-1ba1b70de0f3'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:39.995281 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-de0b69eb-973c-46bf-be36-1ba1b70de0f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83e8acf854c642bc9f438a42e2be17a3', 'request_id': 'req-de0b69eb-973c-46bf-be36-1ba1b70de0f3'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:40.020424 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-de0b69eb-973c-46bf-be36-1ba1b70de0f3 admin admin] The token cache is being invalidate because project 83e8acf854c642bc9f438a42e2be17a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:23:40.020978 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-de0b69eb-973c-46bf-be36-1ba1b70de0f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:40.021918 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-de0b69eb-973c-46bf-be36-1ba1b70de0f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:40.028548 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1055/2125] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:23:39 2022] DELETE /identity/v3/projects/83e8acf854c642bc9f438a42e2be17a3 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:40.030454 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb9aae-1071-47be-8f1f-22075fbb1c4a None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:40.031230 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb9aae-1071-47be-8f1f-22075fbb1c4a None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:40.031791 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb9aae-1071-47be-8f1f-22075fbb1c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:40.071552 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-46eb9aae-1071-47be-8f1f-22075fbb1c4a None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:40.078308 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-46eb9aae-1071-47be-8f1f-22075fbb1c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:40.113376 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:40.183967 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1071/2126] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:23:40.194787 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4b620-1b1b-436e-bf6a-38bccd437c18 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:40.196468 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4b620-1b1b-436e-bf6a-38bccd437c18 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:40.198065 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4b620-1b1b-436e-bf6a-38bccd437c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:40.237415 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-26b4b620-1b1b-436e-bf6a-38bccd437c18 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:40.239628 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-26b4b620-1b1b-436e-bf6a-38bccd437c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:40.257489 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1056/2127] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:23:40.259919 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb9aae-1071-47be-8f1f-22075fbb1c4a None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:40.276682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb9aae-1071-47be-8f1f-22075fbb1c4a None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:40.284981 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0860be5-1055-41d8-90bf-e31789c12a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:40.285952 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0860be5-1055-41d8-90bf-e31789c12a6c admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:40.286843 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0860be5-1055-41d8-90bf-e31789c12a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:40.287584 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0860be5-1055-41d8-90bf-e31789c12a6c admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:40.288921 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0860be5-1055-41d8-90bf-e31789c12a6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:23:40.289877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0860be5-1055-41d8-90bf-e31789c12a6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:40.292072 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0860be5-1055-41d8-90bf-e31789c12a6c admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:40.308580 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1072/2128] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:23:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:23:40.314526 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4b620-1b1b-436e-bf6a-38bccd437c18 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:40.328389 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4b620-1b1b-436e-bf6a-38bccd437c18 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:40.334683 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb17e6f-b0db-4c91-98a3-080c6cd0f58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:40.335497 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb17e6f-b0db-4c91-98a3-080c6cd0f58e admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:40.335924 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb17e6f-b0db-4c91-98a3-080c6cd0f58e admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:40.336943 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb17e6f-b0db-4c91-98a3-080c6cd0f58e admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:40.337739 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb17e6f-b0db-4c91-98a3-080c6cd0f58e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:40.340695 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb17e6f-b0db-4c91-98a3-080c6cd0f58e admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:40.386781 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1057/2129] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:23:40 2022] POST /identity/v3/projects => generated 379 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:23:40.391446 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0860be5-1055-41d8-90bf-e31789c12a6c admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:40.406217 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0860be5-1055-41d8-90bf-e31789c12a6c admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:40.497140 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2dc60-fd93-49d0-9b32-b291006dd5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:40.498244 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2dc60-fd93-49d0-9b32-b291006dd5ec admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:40.498774 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2dc60-fd93-49d0-9b32-b291006dd5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:40.499248 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2dc60-fd93-49d0-9b32-b291006dd5ec admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:40.500445 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2dc60-fd93-49d0-9b32-b291006dd5ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:40.504428 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2dc60-fd93-49d0-9b32-b291006dd5ec admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:40.544172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1073/2130] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:23:40 2022] POST /identity/v3/users => generated 290 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:23:40.550147 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb17e6f-b0db-4c91-98a3-080c6cd0f58e admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:40.598273 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb17e6f-b0db-4c91-98a3-080c6cd0f58e admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:40.611060 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc4a1c-2cae-4d29-ab61-d2521abbe67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:40.612257 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc4a1c-2cae-4d29-ab61-d2521abbe67b admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:40.612837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc4a1c-2cae-4d29-ab61-d2521abbe67b admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:40.613424 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc4a1c-2cae-4d29-ab61-d2521abbe67b admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:40.614726 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc4a1c-2cae-4d29-ab61-d2521abbe67b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:40.618132 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc4a1c-2cae-4d29-ab61-d2521abbe67b admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:40.643045 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1058/2131] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:23:40.645746 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2dc60-fd93-49d0-9b32-b291006dd5ec admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:40.667207 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2dc60-fd93-49d0-9b32-b291006dd5ec admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:40.674140 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c56f8-8d91-4246-a49d-ce99a3aa2df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:40.676266 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c56f8-8d91-4246-a49d-ce99a3aa2df9 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:40.676852 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c56f8-8d91-4246-a49d-ce99a3aa2df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:40.677414 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c56f8-8d91-4246-a49d-ce99a3aa2df9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:40.679109 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c56f8-8d91-4246-a49d-ce99a3aa2df9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:40.683419 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c56f8-8d91-4246-a49d-ce99a3aa2df9 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:40.711667 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1074/2132] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:23:40.717584 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc4a1c-2cae-4d29-ab61-d2521abbe67b admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:40.731435 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc4a1c-2cae-4d29-ab61-d2521abbe67b admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:40.738474 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e8505-a072-4613-a544-2dfc49c272df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:40.740270 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e8505-a072-4613-a544-2dfc49c272df admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:40.740270 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e8505-a072-4613-a544-2dfc49c272df admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:40.740625 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e8505-a072-4613-a544-2dfc49c272df admin admin] PATH_INFO: `/v3/projects/cb6aa0a20c904676b07692a9e4fd84bf/users/4b9c49a09a174cdfb7f93ddff1687b61/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:40.766862 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e8505-a072-4613-a544-2dfc49c272df admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb6aa0a20c904676b07692a9e4fd84bf, user_id=4b9c49a09a174cdfb7f93ddff1687b61, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:40.777423 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e8505-a072-4613-a544-2dfc49c272df admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:40.824132 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1059/2133] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:23:40 2022] PUT /identity/v3/projects/cb6aa0a20c904676b07692a9e4fd84bf/users/4b9c49a09a174cdfb7f93ddff1687b61/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:23:40.826675 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3603cec-f57f-4cd5-b388-3bd8c1fe1db3 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:40.827128 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3603cec-f57f-4cd5-b388-3bd8c1fe1db3 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:40.827592 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3603cec-f57f-4cd5-b388-3bd8c1fe1db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:40.914915 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-a3603cec-f57f-4cd5-b388-3bd8c1fe1db3 None None] MFA Rules not processed for user `4b9c49a09a174cdfb7f93ddff1687b61`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:40.917756 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a3603cec-f57f-4cd5-b388-3bd8c1fe1db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:41.104788 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1075/2134] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:23:41.105615 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e8505-a072-4613-a544-2dfc49c272df admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:41.165016 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:41.271725 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e8505-a072-4613-a544-2dfc49c272df admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:41.280980 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72800a8-003a-4fff-9e67-87157915cb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:41.282034 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72800a8-003a-4fff-9e67-87157915cb18 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:41.282558 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72800a8-003a-4fff-9e67-87157915cb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:41.283052 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72800a8-003a-4fff-9e67-87157915cb18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:41.286440 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72800a8-003a-4fff-9e67-87157915cb18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:41.287944 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72800a8-003a-4fff-9e67-87157915cb18 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:41.369742 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1060/2135] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:23:41 2022] POST /identity/v3/projects => generated 381 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:23:41.376712 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3603cec-f57f-4cd5-b388-3bd8c1fe1db3 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:41.394677 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3603cec-f57f-4cd5-b388-3bd8c1fe1db3 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:41.434637 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:41.535982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e175f4-b282-4221-a42a-9a0eeb3e284e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:41.537116 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e175f4-b282-4221-a42a-9a0eeb3e284e admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:41.537620 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e175f4-b282-4221-a42a-9a0eeb3e284e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:41.538105 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e175f4-b282-4221-a42a-9a0eeb3e284e admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:41.539926 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e175f4-b282-4221-a42a-9a0eeb3e284e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:41.549590 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e175f4-b282-4221-a42a-9a0eeb3e284e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:41.598176 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1076/2136] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:23:41 2022] POST /identity/v3/users => generated 297 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:23:41.612789 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72800a8-003a-4fff-9e67-87157915cb18 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:41.632583 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72800a8-003a-4fff-9e67-87157915cb18 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:41.639065 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9fea0-eb2a-4773-977f-437ee1121080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:41.639897 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9fea0-eb2a-4773-977f-437ee1121080 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:41.640211 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9fea0-eb2a-4773-977f-437ee1121080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:41.640596 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9fea0-eb2a-4773-977f-437ee1121080 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:41.641545 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a9fea0-eb2a-4773-977f-437ee1121080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:41.644850 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a9fea0-eb2a-4773-977f-437ee1121080 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:41.674028 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e175f4-b282-4221-a42a-9a0eeb3e284e admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:41.691996 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1061/2137] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:23:41.709351 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e175f4-b282-4221-a42a-9a0eeb3e284e admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:41.722392 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaca85d-4aeb-415a-b719-e67db48daae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:41.725881 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaca85d-4aeb-415a-b719-e67db48daae6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:41.726215 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaca85d-4aeb-415a-b719-e67db48daae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:41.727315 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaca85d-4aeb-415a-b719-e67db48daae6 admin admin] PATH_INFO: `/v3/projects/ebfa66b606e44b98962c125ec9243d70/users/a3b8d35170134d7381d2427adf9f41d5/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:41.764921 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaca85d-4aeb-415a-b719-e67db48daae6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebfa66b606e44b98962c125ec9243d70, user_id=a3b8d35170134d7381d2427adf9f41d5, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:41.767811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaca85d-4aeb-415a-b719-e67db48daae6 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:41.787668 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1077/2138] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:23:41 2022] PUT /identity/v3/projects/ebfa66b606e44b98962c125ec9243d70/users/a3b8d35170134d7381d2427adf9f41d5/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:41.792069 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9fea0-eb2a-4773-977f-437ee1121080 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:41.803422 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9fea0-eb2a-4773-977f-437ee1121080 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:41.886624 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b0f5a-02e1-492f-b3da-70960e0689f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:41.887673 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b0f5a-02e1-492f-b3da-70960e0689f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:41.888146 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b0f5a-02e1-492f-b3da-70960e0689f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:41.888609 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b0f5a-02e1-492f-b3da-70960e0689f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:41.889761 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b0f5a-02e1-492f-b3da-70960e0689f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:41.892852 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b0f5a-02e1-492f-b3da-70960e0689f8 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:41.913082 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1062/2139] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:23:41.917568 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaca85d-4aeb-415a-b719-e67db48daae6 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:41.935835 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaca85d-4aeb-415a-b719-e67db48daae6 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:41.943732 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53cf0b8-4b1a-42e1-bbdc-8366f46f579b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:41.944832 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cf0b8-4b1a-42e1-bbdc-8366f46f579b admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:41.945304 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cf0b8-4b1a-42e1-bbdc-8366f46f579b admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:41.946326 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cf0b8-4b1a-42e1-bbdc-8366f46f579b admin admin] PATH_INFO: `/v3/projects/ebfa66b606e44b98962c125ec9243d70/users/a3b8d35170134d7381d2427adf9f41d5/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:41.949867 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53cf0b8-4b1a-42e1-bbdc-8366f46f579b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebfa66b606e44b98962c125ec9243d70, user_id=a3b8d35170134d7381d2427adf9f41d5, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:41.954916 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53cf0b8-4b1a-42e1-bbdc-8366f46f579b admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:41.970616 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1078/2140] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:23:41 2022] PUT /identity/v3/projects/ebfa66b606e44b98962c125ec9243d70/users/a3b8d35170134d7381d2427adf9f41d5/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:23:41.982392 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7db2b-69e9-452a-a203-d6fce224535c None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:41.982682 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7db2b-69e9-452a-a203-d6fce224535c None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:41.982960 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7db2b-69e9-452a-a203-d6fce224535c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:42.013727 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-6ee7db2b-69e9-452a-a203-d6fce224535c None None] MFA Rules not processed for user `a3b8d35170134d7381d2427adf9f41d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:42.015005 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-6ee7db2b-69e9-452a-a203-d6fce224535c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:42.088688 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1063/2141] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:41 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:23:42.104911 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53cf0b8-4b1a-42e1-bbdc-8366f46f579b admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:42.106834 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b53cf0b8-4b1a-42e1-bbdc-8366f46f579b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:42.173338 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53cf0b8-4b1a-42e1-bbdc-8366f46f579b admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:42.177541 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c44f59-d240-4b6f-acb7-1d3daad81e06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:42.178275 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c44f59-d240-4b6f-acb7-1d3daad81e06 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:42.178655 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c44f59-d240-4b6f-acb7-1d3daad81e06 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:42.178995 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c44f59-d240-4b6f-acb7-1d3daad81e06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:42.189985 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c44f59-d240-4b6f-acb7-1d3daad81e06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:42.191661 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c44f59-d240-4b6f-acb7-1d3daad81e06 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:42.203159 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1079/2142] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:23:42 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:23:42.762678 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7db2b-69e9-452a-a203-d6fce224535c None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:42.786446 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:42.871885 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7db2b-69e9-452a-a203-d6fce224535c None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:42.876838 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b3e05-5dd7-4d6c-a978-3afbe9f792d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:42.877493 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b3e05-5dd7-4d6c-a978-3afbe9f792d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:42.877777 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b3e05-5dd7-4d6c-a978-3afbe9f792d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:42.878053 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b3e05-5dd7-4d6c-a978-3afbe9f792d1 admin admin] PATH_INFO: `/v3/users/4b9c49a09a174cdfb7f93ddff1687b61` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:42.879294 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b3e05-5dd7-4d6c-a978-3afbe9f792d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b9c49a09a174cdfb7f93ddff1687b61)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:42.881273 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b3e05-5dd7-4d6c-a978-3afbe9f792d1 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:42.949140 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-461b3e05-5dd7-4d6c-a978-3afbe9f792d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b9c49a09a174cdfb7f93ddff1687b61'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:42.972789 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-461b3e05-5dd7-4d6c-a978-3afbe9f792d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b9c49a09a174cdfb7f93ddff1687b61'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:42.985701 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-461b3e05-5dd7-4d6c-a978-3afbe9f792d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b9c49a09a174cdfb7f93ddff1687b61'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:42.987473 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-461b3e05-5dd7-4d6c-a978-3afbe9f792d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b9c49a09a174cdfb7f93ddff1687b61'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:43.001736 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-461b3e05-5dd7-4d6c-a978-3afbe9f792d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b9c49a09a174cdfb7f93ddff1687b61'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:43.009803 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1064/2143] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:23:42 2022] DELETE /identity/v3/users/4b9c49a09a174cdfb7f93ddff1687b61 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:43.016236 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331b877-043f-49a9-8cd0-23adf9e910b6 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:43.016681 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331b877-043f-49a9-8cd0-23adf9e910b6 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:43.017151 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331b877-043f-49a9-8cd0-23adf9e910b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:43.048711 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-c331b877-043f-49a9-8cd0-23adf9e910b6 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:43.050516 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-c331b877-043f-49a9-8cd0-23adf9e910b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:43.149318 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1080/2144] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:23:43.161235 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b3e05-5dd7-4d6c-a978-3afbe9f792d1 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:43.162910 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-461b3e05-5dd7-4d6c-a978-3afbe9f792d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:43.263689 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b3e05-5dd7-4d6c-a978-3afbe9f792d1 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:43.270110 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ef924-ce28-4bcb-a2a3-f8562a6174cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:43.271212 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ef924-ce28-4bcb-a2a3-f8562a6174cc service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:43.271713 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ef924-ce28-4bcb-a2a3-f8562a6174cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:43.272207 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ef924-ce28-4bcb-a2a3-f8562a6174cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:43.290222 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ef924-ce28-4bcb-a2a3-f8562a6174cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:43.293108 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ef924-ce28-4bcb-a2a3-f8562a6174cc service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:43.312339 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1065/2145] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:23:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:23:43.728618 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c331b877-043f-49a9-8cd0-23adf9e910b6 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:43.730983 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-c331b877-043f-49a9-8cd0-23adf9e910b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:43.751166 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c331b877-043f-49a9-8cd0-23adf9e910b6 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:43.760519 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff4bf3-89f1-44e1-914f-1c44b1697b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:43.761634 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff4bf3-89f1-44e1-914f-1c44b1697b61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:43.762131 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff4bf3-89f1-44e1-914f-1c44b1697b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:43.762683 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff4bf3-89f1-44e1-914f-1c44b1697b61 admin admin] PATH_INFO: `/v3/projects/cb6aa0a20c904676b07692a9e4fd84bf` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:43.764971 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff4bf3-89f1-44e1-914f-1c44b1697b61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb6aa0a20c904676b07692a9e4fd84bf)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:43.770244 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff4bf3-89f1-44e1-914f-1c44b1697b61 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:43.788721 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:43.842649 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-7cff4bf3-89f1-44e1-914f-1c44b1697b61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb6aa0a20c904676b07692a9e4fd84bf', 'request_id': 'req-7cff4bf3-89f1-44e1-914f-1c44b1697b61'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:43.853190 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-7cff4bf3-89f1-44e1-914f-1c44b1697b61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb6aa0a20c904676b07692a9e4fd84bf', 'request_id': 'req-7cff4bf3-89f1-44e1-914f-1c44b1697b61'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:43.861267 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-7cff4bf3-89f1-44e1-914f-1c44b1697b61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb6aa0a20c904676b07692a9e4fd84bf', 'request_id': 'req-7cff4bf3-89f1-44e1-914f-1c44b1697b61'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:43.876176 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-7cff4bf3-89f1-44e1-914f-1c44b1697b61 admin admin] The token cache is being invalidate because project cb6aa0a20c904676b07692a9e4fd84bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:23:43.876469 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-7cff4bf3-89f1-44e1-914f-1c44b1697b61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:43.877141 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-7cff4bf3-89f1-44e1-914f-1c44b1697b61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:43.879188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1081/2146] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:23:43 2022] DELETE /identity/v3/projects/cb6aa0a20c904676b07692a9e4fd84bf => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:43.885048 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ef924-ce28-4bcb-a2a3-f8562a6174cc service neutron] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:43.894797 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ef924-ce28-4bcb-a2a3-f8562a6174cc service neutron] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:43.937365 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:43.987132 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d83d8e-d58a-4374-8a4d-e3a5094ae7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:43.987795 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d83d8e-d58a-4374-8a4d-e3a5094ae7d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:43.988076 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d83d8e-d58a-4374-8a4d-e3a5094ae7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:43.988347 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d83d8e-d58a-4374-8a4d-e3a5094ae7d2 admin admin] PATH_INFO: `/v3/users/a3b8d35170134d7381d2427adf9f41d5` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:43.989598 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d83d8e-d58a-4374-8a4d-e3a5094ae7d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3b8d35170134d7381d2427adf9f41d5)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:43.992355 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d83d8e-d58a-4374-8a4d-e3a5094ae7d2 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:44.063127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-a1d83d8e-d58a-4374-8a4d-e3a5094ae7d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3b8d35170134d7381d2427adf9f41d5'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:44.093641 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-a1d83d8e-d58a-4374-8a4d-e3a5094ae7d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3b8d35170134d7381d2427adf9f41d5'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:44.099421 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-a1d83d8e-d58a-4374-8a4d-e3a5094ae7d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3b8d35170134d7381d2427adf9f41d5'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:44.101158 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-a1d83d8e-d58a-4374-8a4d-e3a5094ae7d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3b8d35170134d7381d2427adf9f41d5'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:44.115113 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-a1d83d8e-d58a-4374-8a4d-e3a5094ae7d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3b8d35170134d7381d2427adf9f41d5'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:44.126429 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1066/2147] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:23:43 2022] DELETE /identity/v3/users/a3b8d35170134d7381d2427adf9f41d5 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:44.510778 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff4bf3-89f1-44e1-914f-1c44b1697b61 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:44.513896 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7cff4bf3-89f1-44e1-914f-1c44b1697b61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:44.539814 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff4bf3-89f1-44e1-914f-1c44b1697b61 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:44.629544 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667be0d-38a2-4094-b71c-fcd2675cbc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:44.630201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667be0d-38a2-4094-b71c-fcd2675cbc69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:44.630513 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667be0d-38a2-4094-b71c-fcd2675cbc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:44.630793 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667be0d-38a2-4094-b71c-fcd2675cbc69 admin admin] PATH_INFO: `/v3/projects/ebfa66b606e44b98962c125ec9243d70` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:44.632018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667be0d-38a2-4094-b71c-fcd2675cbc69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebfa66b606e44b98962c125ec9243d70)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:44.634005 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667be0d-38a2-4094-b71c-fcd2675cbc69 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:44.694036 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-8667be0d-38a2-4094-b71c-fcd2675cbc69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebfa66b606e44b98962c125ec9243d70', 'request_id': 'req-8667be0d-38a2-4094-b71c-fcd2675cbc69'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:44.703574 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-8667be0d-38a2-4094-b71c-fcd2675cbc69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebfa66b606e44b98962c125ec9243d70', 'request_id': 'req-8667be0d-38a2-4094-b71c-fcd2675cbc69'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:44.719281 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-8667be0d-38a2-4094-b71c-fcd2675cbc69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebfa66b606e44b98962c125ec9243d70', 'request_id': 'req-8667be0d-38a2-4094-b71c-fcd2675cbc69'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:44.736164 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-8667be0d-38a2-4094-b71c-fcd2675cbc69 admin admin] The token cache is being invalidate because project ebfa66b606e44b98962c125ec9243d70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:23:44.736454 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-8667be0d-38a2-4094-b71c-fcd2675cbc69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:44.737130 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-8667be0d-38a2-4094-b71c-fcd2675cbc69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:44.738735 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1082/2148] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:23:44 2022] DELETE /identity/v3/projects/ebfa66b606e44b98962c125ec9243d70 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:23:44.743708 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008f158-64f7-4e00-903f-52b7811f8c74 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:44.744031 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008f158-64f7-4e00-903f-52b7811f8c74 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:44.744395 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008f158-64f7-4e00-903f-52b7811f8c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:44.785235 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-c008f158-64f7-4e00-903f-52b7811f8c74 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:44.787770 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-c008f158-64f7-4e00-903f-52b7811f8c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:44.931047 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1067/2149] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:23:44.954398 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1e2e8-dfef-429a-973e-e0990d9b88be None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:44.954398 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1e2e8-dfef-429a-973e-e0990d9b88be None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:44.954398 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1e2e8-dfef-429a-973e-e0990d9b88be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:44.975258 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-98d1e2e8-dfef-429a-973e-e0990d9b88be None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:44.977121 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-98d1e2e8-dfef-429a-973e-e0990d9b88be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:44.988018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1083/2150] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:23:44.993849 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008f158-64f7-4e00-903f-52b7811f8c74 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:45.005569 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008f158-64f7-4e00-903f-52b7811f8c74 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:45.013557 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527459c-3afb-4232-bf8f-22d95f9cca04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:45.014416 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527459c-3afb-4232-bf8f-22d95f9cca04 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:45.014696 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527459c-3afb-4232-bf8f-22d95f9cca04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:45.014967 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527459c-3afb-4232-bf8f-22d95f9cca04 admin admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:45.015632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1527459c-3afb-4232-bf8f-22d95f9cca04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:23:45.015934 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1527459c-3afb-4232-bf8f-22d95f9cca04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:45.017562 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1527459c-3afb-4232-bf8f-22d95f9cca04 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:45.030209 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1068/2151] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:23:45.034935 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d1e2e8-dfef-429a-973e-e0990d9b88be None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:45.045888 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d1e2e8-dfef-429a-973e-e0990d9b88be None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:45.050874 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d3ea6-d786-453f-ace6-b8050470cabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:45.051577 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d3ea6-d786-453f-ace6-b8050470cabe admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:45.051965 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d3ea6-d786-453f-ace6-b8050470cabe admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:45.052337 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d3ea6-d786-453f-ace6-b8050470cabe admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:45.053053 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8d3ea6-d786-453f-ace6-b8050470cabe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:45.056511 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8d3ea6-d786-453f-ace6-b8050470cabe admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:45.084006 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:45.092311 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1084/2152] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:23:45 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:23:45.096395 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527459c-3afb-4232-bf8f-22d95f9cca04 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:45.109518 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527459c-3afb-4232-bf8f-22d95f9cca04 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:45.157278 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:45.186142 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acf812-849c-442f-9b77-a1d9c880dc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:45.187951 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acf812-849c-442f-9b77-a1d9c880dc90 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:45.188241 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acf812-849c-442f-9b77-a1d9c880dc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:45.188733 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acf812-849c-442f-9b77-a1d9c880dc90 admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:45.189421 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40acf812-849c-442f-9b77-a1d9c880dc90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:45.191895 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40acf812-849c-442f-9b77-a1d9c880dc90 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:45.226469 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1069/2153] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:23:45 2022] POST /identity/v3/users => generated 292 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:23:45.228458 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d3ea6-d786-453f-ace6-b8050470cabe admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:45.245955 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d3ea6-d786-453f-ace6-b8050470cabe admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:45.253076 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f40f19-1d01-4d51-a8bf-437e49d8c478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:45.254070 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f40f19-1d01-4d51-a8bf-437e49d8c478 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:45.254520 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f40f19-1d01-4d51-a8bf-437e49d8c478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:45.254927 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f40f19-1d01-4d51-a8bf-437e49d8c478 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:45.255720 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f40f19-1d01-4d51-a8bf-437e49d8c478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:45.257501 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f40f19-1d01-4d51-a8bf-437e49d8c478 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:45.269916 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1085/2154] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:23:45.274994 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acf812-849c-442f-9b77-a1d9c880dc90 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:45.288583 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acf812-849c-442f-9b77-a1d9c880dc90 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:45.299950 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffe204-74a1-47d4-ac64-9f90ce2e4d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:45.299950 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffe204-74a1-47d4-ac64-9f90ce2e4d7e admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:45.299950 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffe204-74a1-47d4-ac64-9f90ce2e4d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:45.299950 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffe204-74a1-47d4-ac64-9f90ce2e4d7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:45.300305 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffe204-74a1-47d4-ac64-9f90ce2e4d7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:45.300305 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffe204-74a1-47d4-ac64-9f90ce2e4d7e admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:45.316903 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1070/2155] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:23:45.324251 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f40f19-1d01-4d51-a8bf-437e49d8c478 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:45.339284 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f40f19-1d01-4d51-a8bf-437e49d8c478 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:45.344524 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b8da0-1758-4ab3-9cbf-d4c7ab664d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:45.345388 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b8da0-1758-4ab3-9cbf-d4c7ab664d70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:45.345678 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b8da0-1758-4ab3-9cbf-d4c7ab664d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:45.345948 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b8da0-1758-4ab3-9cbf-d4c7ab664d70 admin admin] PATH_INFO: `/v3/projects/7abf2188f885477da88b847ec268818a/users/8051561e44fb4ff8a81c8f3bee77cb9c/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:45.364572 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b8da0-1758-4ab3-9cbf-d4c7ab664d70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7abf2188f885477da88b847ec268818a, user_id=8051561e44fb4ff8a81c8f3bee77cb9c, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:45.368004 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b8da0-1758-4ab3-9cbf-d4c7ab664d70 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:45.387059 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1086/2156] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:23:45 2022] PUT /identity/v3/projects/7abf2188f885477da88b847ec268818a/users/8051561e44fb4ff8a81c8f3bee77cb9c/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:45.399811 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52220bcf-2ab2-46e8-abaa-4fdd44db8621 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:45.400114 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52220bcf-2ab2-46e8-abaa-4fdd44db8621 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:45.400348 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52220bcf-2ab2-46e8-abaa-4fdd44db8621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:45.434289 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-52220bcf-2ab2-46e8-abaa-4fdd44db8621 None None] MFA Rules not processed for user `8051561e44fb4ff8a81c8f3bee77cb9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:45.435585 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-52220bcf-2ab2-46e8-abaa-4fdd44db8621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:45.519578 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1071/2157] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:23:45.524807 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b8da0-1758-4ab3-9cbf-d4c7ab664d70 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:45.618749 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b8da0-1758-4ab3-9cbf-d4c7ab664d70 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:45.624154 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6791287-45b7-45d8-b496-ca14c08e1166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:45.624787 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6791287-45b7-45d8-b496-ca14c08e1166 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:45.625069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6791287-45b7-45d8-b496-ca14c08e1166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:45.625343 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6791287-45b7-45d8-b496-ca14c08e1166 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:45.626083 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6791287-45b7-45d8-b496-ca14c08e1166 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:45.628112 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6791287-45b7-45d8-b496-ca14c08e1166 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:45.677370 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1087/2158] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:23:45 2022] POST /identity/v3/projects => generated 379 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:23:45.682847 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52220bcf-2ab2-46e8-abaa-4fdd44db8621 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:45.707775 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52220bcf-2ab2-46e8-abaa-4fdd44db8621 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:45.816507 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6d223-d6d1-4998-9d69-a0ed4cedcfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:45.817189 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6d223-d6d1-4998-9d69-a0ed4cedcfeb admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:45.817481 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6d223-d6d1-4998-9d69-a0ed4cedcfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:45.817752 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6d223-d6d1-4998-9d69-a0ed4cedcfeb admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:45.818677 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6d223-d6d1-4998-9d69-a0ed4cedcfeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:45.820985 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6d223-d6d1-4998-9d69-a0ed4cedcfeb admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:45.857282 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1072/2159] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:23:45 2022] POST /identity/v3/users => generated 296 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:23:45.861484 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6791287-45b7-45d8-b496-ca14c08e1166 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:45.876032 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6791287-45b7-45d8-b496-ca14c08e1166 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:45.881580 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bb8a5-40c2-4b01-a5d4-b24489087060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:45.882915 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bb8a5-40c2-4b01-a5d4-b24489087060 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:45.883308 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bb8a5-40c2-4b01-a5d4-b24489087060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:45.883772 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bb8a5-40c2-4b01-a5d4-b24489087060 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:45.884572 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2bb8a5-40c2-4b01-a5d4-b24489087060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:45.886522 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2bb8a5-40c2-4b01-a5d4-b24489087060 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:45.906407 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1088/2160] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:23:45 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:23:45.908384 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6d223-d6d1-4998-9d69-a0ed4cedcfeb admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:45.927523 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6d223-d6d1-4998-9d69-a0ed4cedcfeb admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:45.935649 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5f18c-fe91-4e07-9195-4fb22163f09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:45.936731 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5f18c-fe91-4e07-9195-4fb22163f09d admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:45.937155 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5f18c-fe91-4e07-9195-4fb22163f09d admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:45.937529 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5f18c-fe91-4e07-9195-4fb22163f09d admin admin] PATH_INFO: `/v3/projects/5cfc0719749e4eb2b4118f5f8ca1e520/users/99d4b8a4d6a149f6a23ca91b649485c2/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:45.974117 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a5f18c-fe91-4e07-9195-4fb22163f09d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cfc0719749e4eb2b4118f5f8ca1e520, user_id=99d4b8a4d6a149f6a23ca91b649485c2, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:45.979615 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a5f18c-fe91-4e07-9195-4fb22163f09d admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:46.002208 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1073/2161] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:23:45 2022] PUT /identity/v3/projects/5cfc0719749e4eb2b4118f5f8ca1e520/users/99d4b8a4d6a149f6a23ca91b649485c2/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:46.004181 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bb8a5-40c2-4b01-a5d4-b24489087060 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:46.029660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bb8a5-40c2-4b01-a5d4-b24489087060 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:46.138081 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a83669-1c4c-442e-96f2-2165809222af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:46.139220 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a83669-1c4c-442e-96f2-2165809222af admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:46.139641 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a83669-1c4c-442e-96f2-2165809222af admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:46.140373 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a83669-1c4c-442e-96f2-2165809222af admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:46.141462 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a83669-1c4c-442e-96f2-2165809222af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:46.147832 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a83669-1c4c-442e-96f2-2165809222af admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:46.172047 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1089/2162] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:23:46.181199 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5f18c-fe91-4e07-9195-4fb22163f09d admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:46.201178 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5f18c-fe91-4e07-9195-4fb22163f09d admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:46.211673 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5624839-3519-455e-bfb6-44b52374fcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:46.212848 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5624839-3519-455e-bfb6-44b52374fcf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:46.213565 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5624839-3519-455e-bfb6-44b52374fcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:46.214054 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5624839-3519-455e-bfb6-44b52374fcf3 admin admin] PATH_INFO: `/v3/projects/5cfc0719749e4eb2b4118f5f8ca1e520/users/99d4b8a4d6a149f6a23ca91b649485c2/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:46.217892 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5624839-3519-455e-bfb6-44b52374fcf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cfc0719749e4eb2b4118f5f8ca1e520, user_id=99d4b8a4d6a149f6a23ca91b649485c2, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:46.223330 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5624839-3519-455e-bfb6-44b52374fcf3 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:46.234815 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:46.240329 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1074/2163] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:23:46 2022] PUT /identity/v3/projects/5cfc0719749e4eb2b4118f5f8ca1e520/users/99d4b8a4d6a149f6a23ca91b649485c2/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:23:46.262201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b17550-8d7f-4b5c-ab16-df31837c03ac None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:46.262528 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b17550-8d7f-4b5c-ab16-df31837c03ac None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:46.262811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b17550-8d7f-4b5c-ab16-df31837c03ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:46.313694 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-c4b17550-8d7f-4b5c-ab16-df31837c03ac None None] MFA Rules not processed for user `99d4b8a4d6a149f6a23ca91b649485c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:46.315364 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-c4b17550-8d7f-4b5c-ab16-df31837c03ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:46.360340 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:46.443478 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1090/2164] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:46 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:23:46.455083 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5624839-3519-455e-bfb6-44b52374fcf3 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:46.456882 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-e5624839-3519-455e-bfb6-44b52374fcf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:46.525886 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5624839-3519-455e-bfb6-44b52374fcf3 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:46.529866 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642aeef5-126b-4d10-925f-7bd3537eb058 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:46.530531 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642aeef5-126b-4d10-925f-7bd3537eb058 service cinder] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:46.530810 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642aeef5-126b-4d10-925f-7bd3537eb058 service cinder] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:46.531078 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642aeef5-126b-4d10-925f-7bd3537eb058 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:46.541601 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642aeef5-126b-4d10-925f-7bd3537eb058 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:46.543080 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642aeef5-126b-4d10-925f-7bd3537eb058 service cinder] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:46.566186 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1075/2165] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:23:46 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:23:46.662653 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b17550-8d7f-4b5c-ab16-df31837c03ac None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:46.673448 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b17550-8d7f-4b5c-ab16-df31837c03ac None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:46.677243 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb17107-c56b-4a9e-903e-96f428068649 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:46.677853 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb17107-c56b-4a9e-903e-96f428068649 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:46.678129 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb17107-c56b-4a9e-903e-96f428068649 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:46.678426 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb17107-c56b-4a9e-903e-96f428068649 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:46.764858 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb17107-c56b-4a9e-903e-96f428068649 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:46.766381 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb17107-c56b-4a9e-903e-96f428068649 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:46.777455 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1091/2166] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:23:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:23:47.190925 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642aeef5-126b-4d10-925f-7bd3537eb058 service cinder] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:47.323353 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642aeef5-126b-4d10-925f-7bd3537eb058 service cinder] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:47.332599 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169ac54-3d1b-466e-8252-669975748f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:47.333480 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169ac54-3d1b-466e-8252-669975748f0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:47.333994 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169ac54-3d1b-466e-8252-669975748f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:47.334809 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169ac54-3d1b-466e-8252-669975748f0b admin admin] PATH_INFO: `/v3/users/8051561e44fb4ff8a81c8f3bee77cb9c` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:47.343649 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a169ac54-3d1b-466e-8252-669975748f0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8051561e44fb4ff8a81c8f3bee77cb9c)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:47.343649 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a169ac54-3d1b-466e-8252-669975748f0b admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:47.443666 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-a169ac54-3d1b-466e-8252-669975748f0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8051561e44fb4ff8a81c8f3bee77cb9c'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:47.473146 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-a169ac54-3d1b-466e-8252-669975748f0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8051561e44fb4ff8a81c8f3bee77cb9c'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:47.486877 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-a169ac54-3d1b-466e-8252-669975748f0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8051561e44fb4ff8a81c8f3bee77cb9c'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:47.488502 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-a169ac54-3d1b-466e-8252-669975748f0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8051561e44fb4ff8a81c8f3bee77cb9c'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:47.497889 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-a169ac54-3d1b-466e-8252-669975748f0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8051561e44fb4ff8a81c8f3bee77cb9c'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:47.506458 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1076/2167] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:23:47 2022] DELETE /identity/v3/users/8051561e44fb4ff8a81c8f3bee77cb9c => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:47.512005 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8c421-201e-40c1-b477-2dce8b1984a0 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:47.512300 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8c421-201e-40c1-b477-2dce8b1984a0 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:47.512583 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8c421-201e-40c1-b477-2dce8b1984a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:47.534841 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-87b8c421-201e-40c1-b477-2dce8b1984a0 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:47.536097 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-87b8c421-201e-40c1-b477-2dce8b1984a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:47.709798 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1092/2168] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:23:47.723745 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169ac54-3d1b-466e-8252-669975748f0b admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:47.725993 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-a169ac54-3d1b-466e-8252-669975748f0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:47.765458 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:47.802734 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169ac54-3d1b-466e-8252-669975748f0b admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:47.807501 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ef0e1-fcef-4b97-b824-669770ffea1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:47.808197 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ef0e1-fcef-4b97-b824-669770ffea1d service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:47.808550 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ef0e1-fcef-4b97-b824-669770ffea1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:47.808882 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ef0e1-fcef-4b97-b824-669770ffea1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:47.819842 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847ef0e1-fcef-4b97-b824-669770ffea1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:47.821728 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847ef0e1-fcef-4b97-b824-669770ffea1d service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:47.834605 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1077/2169] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:23:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:23:48.152854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8c421-201e-40c1-b477-2dce8b1984a0 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:48.154486 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-87b8c421-201e-40c1-b477-2dce8b1984a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:48.169330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8c421-201e-40c1-b477-2dce8b1984a0 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:48.174972 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8da261-6ae5-4aa8-915a-993090cec39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:48.175720 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8da261-6ae5-4aa8-915a-993090cec39e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:48.176093 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8da261-6ae5-4aa8-915a-993090cec39e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:48.176370 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8da261-6ae5-4aa8-915a-993090cec39e admin admin] PATH_INFO: `/v3/projects/7abf2188f885477da88b847ec268818a` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:48.177797 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8da261-6ae5-4aa8-915a-993090cec39e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7abf2188f885477da88b847ec268818a)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:48.179799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8da261-6ae5-4aa8-915a-993090cec39e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:48.235567 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ed8da261-6ae5-4aa8-915a-993090cec39e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7abf2188f885477da88b847ec268818a', 'request_id': 'req-ed8da261-6ae5-4aa8-915a-993090cec39e'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:48.240807 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:48.248325 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ed8da261-6ae5-4aa8-915a-993090cec39e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7abf2188f885477da88b847ec268818a', 'request_id': 'req-ed8da261-6ae5-4aa8-915a-993090cec39e'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:48.257332 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ed8da261-6ae5-4aa8-915a-993090cec39e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7abf2188f885477da88b847ec268818a', 'request_id': 'req-ed8da261-6ae5-4aa8-915a-993090cec39e'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:48.270562 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ed8da261-6ae5-4aa8-915a-993090cec39e admin admin] The token cache is being invalidate because project 7abf2188f885477da88b847ec268818a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:23:48.270889 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ed8da261-6ae5-4aa8-915a-993090cec39e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:48.272617 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ed8da261-6ae5-4aa8-915a-993090cec39e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:48.273308 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1093/2170] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:23:48 2022] DELETE /identity/v3/projects/7abf2188f885477da88b847ec268818a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:23:48.277767 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ef0e1-fcef-4b97-b824-669770ffea1d service neutron] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:48.288042 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ef0e1-fcef-4b97-b824-669770ffea1d service neutron] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:48.354507 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0df4c7-572a-4a2a-8180-8a874d1c211d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:48.355064 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0df4c7-572a-4a2a-8180-8a874d1c211d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:48.355344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0df4c7-572a-4a2a-8180-8a874d1c211d admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:48.355622 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0df4c7-572a-4a2a-8180-8a874d1c211d admin admin] PATH_INFO: `/v3/users/99d4b8a4d6a149f6a23ca91b649485c2` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:48.356782 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0df4c7-572a-4a2a-8180-8a874d1c211d admin admin] RBAC: Authorizing `identity:delete_user(user_id=99d4b8a4d6a149f6a23ca91b649485c2)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:48.359441 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0df4c7-572a-4a2a-8180-8a874d1c211d admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:48.415598 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-2c0df4c7-572a-4a2a-8180-8a874d1c211d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99d4b8a4d6a149f6a23ca91b649485c2'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:48.429646 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-2c0df4c7-572a-4a2a-8180-8a874d1c211d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99d4b8a4d6a149f6a23ca91b649485c2'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:48.440910 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-2c0df4c7-572a-4a2a-8180-8a874d1c211d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99d4b8a4d6a149f6a23ca91b649485c2'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:48.441662 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-2c0df4c7-572a-4a2a-8180-8a874d1c211d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99d4b8a4d6a149f6a23ca91b649485c2'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:48.458985 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-2c0df4c7-572a-4a2a-8180-8a874d1c211d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99d4b8a4d6a149f6a23ca91b649485c2'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:48.471316 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1078/2171] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:23:48 2022] DELETE /identity/v3/users/99d4b8a4d6a149f6a23ca91b649485c2 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:23:49.157282 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8da261-6ae5-4aa8-915a-993090cec39e admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:49.159842 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ed8da261-6ae5-4aa8-915a-993090cec39e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:49.183995 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8da261-6ae5-4aa8-915a-993090cec39e admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:49.334571 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592be12-7078-4c04-9e2f-58713f0dc9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:49.335492 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592be12-7078-4c04-9e2f-58713f0dc9e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:49.336175 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592be12-7078-4c04-9e2f-58713f0dc9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:49.337061 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592be12-7078-4c04-9e2f-58713f0dc9e1 admin admin] PATH_INFO: `/v3/projects/5cfc0719749e4eb2b4118f5f8ca1e520` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:49.338792 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592be12-7078-4c04-9e2f-58713f0dc9e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cfc0719749e4eb2b4118f5f8ca1e520)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:49.340977 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592be12-7078-4c04-9e2f-58713f0dc9e1 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:49.415502 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-e592be12-7078-4c04-9e2f-58713f0dc9e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cfc0719749e4eb2b4118f5f8ca1e520', 'request_id': 'req-e592be12-7078-4c04-9e2f-58713f0dc9e1'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:49.430775 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-e592be12-7078-4c04-9e2f-58713f0dc9e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cfc0719749e4eb2b4118f5f8ca1e520', 'request_id': 'req-e592be12-7078-4c04-9e2f-58713f0dc9e1'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:49.440481 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-e592be12-7078-4c04-9e2f-58713f0dc9e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cfc0719749e4eb2b4118f5f8ca1e520', 'request_id': 'req-e592be12-7078-4c04-9e2f-58713f0dc9e1'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:49.459699 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-e592be12-7078-4c04-9e2f-58713f0dc9e1 admin admin] The token cache is being invalidate because project 5cfc0719749e4eb2b4118f5f8ca1e520 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:23:49.460424 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-e592be12-7078-4c04-9e2f-58713f0dc9e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:49.462753 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-e592be12-7078-4c04-9e2f-58713f0dc9e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:49.470485 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1094/2172] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:23:49 2022] DELETE /identity/v3/projects/5cfc0719749e4eb2b4118f5f8ca1e520 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:49.472196 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eba4f2-1e42-48e3-85cc-9f8051457678 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:49.472874 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eba4f2-1e42-48e3-85cc-9f8051457678 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:49.472874 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eba4f2-1e42-48e3-85cc-9f8051457678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:49.503933 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-29eba4f2-1e42-48e3-85cc-9f8051457678 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:49.505933 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-29eba4f2-1e42-48e3-85cc-9f8051457678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:49.590404 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:49.618244 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1079/2173] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:23:49.626653 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea605bc-336a-4aaf-8fb1-3549d9003192 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:49.626915 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea605bc-336a-4aaf-8fb1-3549d9003192 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:49.627193 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea605bc-336a-4aaf-8fb1-3549d9003192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:49.651984 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-7ea605bc-336a-4aaf-8fb1-3549d9003192 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:49.653360 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7ea605bc-336a-4aaf-8fb1-3549d9003192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:49.661621 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1095/2174] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:23:49.666769 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eba4f2-1e42-48e3-85cc-9f8051457678 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:49.678556 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eba4f2-1e42-48e3-85cc-9f8051457678 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:49.684716 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0f19d-28c2-4c8b-8984-6546ceeb75ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:49.685262 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0f19d-28c2-4c8b-8984-6546ceeb75ec admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:49.685538 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0f19d-28c2-4c8b-8984-6546ceeb75ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:49.685808 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0f19d-28c2-4c8b-8984-6546ceeb75ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:49.686502 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a0f19d-28c2-4c8b-8984-6546ceeb75ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:23:49.686803 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a0f19d-28c2-4c8b-8984-6546ceeb75ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:49.688458 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a0f19d-28c2-4c8b-8984-6546ceeb75ec admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:49.705332 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1080/2175] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:23:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:23:49.710728 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea605bc-336a-4aaf-8fb1-3549d9003192 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:49.722143 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea605bc-336a-4aaf-8fb1-3549d9003192 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:49.727405 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed6264-1bac-44ab-95ef-e6b0bbc089d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:49.728024 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed6264-1bac-44ab-95ef-e6b0bbc089d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:49.728306 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed6264-1bac-44ab-95ef-e6b0bbc089d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:49.728578 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed6264-1bac-44ab-95ef-e6b0bbc089d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:49.729217 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed6264-1bac-44ab-95ef-e6b0bbc089d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:49.731634 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed6264-1bac-44ab-95ef-e6b0bbc089d6 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:49.764297 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1096/2176] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:23:49 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:23:49.769980 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0f19d-28c2-4c8b-8984-6546ceeb75ec admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:49.782068 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0f19d-28c2-4c8b-8984-6546ceeb75ec admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:49.858976 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba705b7-270f-4958-a98d-0bbb4e85907e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:49.859617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba705b7-270f-4958-a98d-0bbb4e85907e admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:49.859895 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba705b7-270f-4958-a98d-0bbb4e85907e admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:49.860167 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba705b7-270f-4958-a98d-0bbb4e85907e admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:49.860821 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba705b7-270f-4958-a98d-0bbb4e85907e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:49.862849 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba705b7-270f-4958-a98d-0bbb4e85907e admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:49.891084 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1081/2177] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:23:49 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:23:49.892375 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed6264-1bac-44ab-95ef-e6b0bbc089d6 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:49.911838 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed6264-1bac-44ab-95ef-e6b0bbc089d6 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:49.917811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c461f-1ae5-4d40-ac0b-938fa1a69b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:49.918586 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c461f-1ae5-4d40-ac0b-938fa1a69b8e admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:49.918865 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c461f-1ae5-4d40-ac0b-938fa1a69b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:49.919310 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c461f-1ae5-4d40-ac0b-938fa1a69b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:49.920073 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c461f-1ae5-4d40-ac0b-938fa1a69b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:49.921775 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c461f-1ae5-4d40-ac0b-938fa1a69b8e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:49.933880 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1097/2178] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:23:49.939012 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba705b7-270f-4958-a98d-0bbb4e85907e admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:49.958503 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba705b7-270f-4958-a98d-0bbb4e85907e admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:49.966976 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a8795-69b9-466c-8c05-01ef76efa135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:49.967801 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a8795-69b9-466c-8c05-01ef76efa135 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:49.968336 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a8795-69b9-466c-8c05-01ef76efa135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:49.968881 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a8795-69b9-466c-8c05-01ef76efa135 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:49.969815 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a8795-69b9-466c-8c05-01ef76efa135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:49.971967 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a8795-69b9-466c-8c05-01ef76efa135 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:49.989241 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1082/2179] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:23:49.993894 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c461f-1ae5-4d40-ac0b-938fa1a69b8e admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:50.012545 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c461f-1ae5-4d40-ac0b-938fa1a69b8e admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:50.017875 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7790a70-4f55-4752-b401-30877d031cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:50.018671 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7790a70-4f55-4752-b401-30877d031cd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:50.019255 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7790a70-4f55-4752-b401-30877d031cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:50.019680 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7790a70-4f55-4752-b401-30877d031cd3 admin admin] PATH_INFO: `/v3/projects/a73ad77434aa469baf81e415557ef31a/users/c2348807417345ccac9a9c70f511c90b/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:50.045352 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7790a70-4f55-4752-b401-30877d031cd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a73ad77434aa469baf81e415557ef31a, user_id=c2348807417345ccac9a9c70f511c90b, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:50.048411 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7790a70-4f55-4752-b401-30877d031cd3 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:50.064613 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1098/2180] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:23:49 2022] PUT /identity/v3/projects/a73ad77434aa469baf81e415557ef31a/users/c2348807417345ccac9a9c70f511c90b/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:50.077343 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0eacb0-f1a4-4146-b5c2-2123f4e38966 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:50.077629 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0eacb0-f1a4-4146-b5c2-2123f4e38966 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:50.077906 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0eacb0-f1a4-4146-b5c2-2123f4e38966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:50.108910 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-7e0eacb0-f1a4-4146-b5c2-2123f4e38966 None None] MFA Rules not processed for user `c2348807417345ccac9a9c70f511c90b`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:50.110167 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-7e0eacb0-f1a4-4146-b5c2-2123f4e38966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:50.191577 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1083/2181] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:23:50.204174 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7790a70-4f55-4752-b401-30877d031cd3 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:50.206190 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f7790a70-4f55-4752-b401-30877d031cd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:50.224630 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:50.287984 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7790a70-4f55-4752-b401-30877d031cd3 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:50.292661 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2c0e5-482c-4720-8f44-7cc5eda2bb87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:50.293288 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2c0e5-482c-4720-8f44-7cc5eda2bb87 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:50.293565 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2c0e5-482c-4720-8f44-7cc5eda2bb87 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:50.293841 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2c0e5-482c-4720-8f44-7cc5eda2bb87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:50.303562 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b2c0e5-482c-4720-8f44-7cc5eda2bb87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:50.305633 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b2c0e5-482c-4720-8f44-7cc5eda2bb87 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:50.317204 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1099/2182] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:23:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:23:51.301162 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0eacb0-f1a4-4146-b5c2-2123f4e38966 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:51.312140 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0eacb0-f1a4-4146-b5c2-2123f4e38966 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:51.317499 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a7c33-1013-48a7-b048-e28a7521ddd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:51.318408 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a7c33-1013-48a7-b048-e28a7521ddd7 service cinder] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:51.318922 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a7c33-1013-48a7-b048-e28a7521ddd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:51.319328 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a7c33-1013-48a7-b048-e28a7521ddd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:51.322476 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-268a7c33-1013-48a7-b048-e28a7521ddd7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:51.366227 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:51.396851 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a7c33-1013-48a7-b048-e28a7521ddd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:51.398348 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a7c33-1013-48a7-b048-e28a7521ddd7 service cinder] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:51.410104 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1084/2183] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:23:51 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:23:56.305382 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2c0e5-482c-4720-8f44-7cc5eda2bb87 service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:56.376473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2c0e5-482c-4720-8f44-7cc5eda2bb87 service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:56.382352 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4470ee-57c9-4cdd-9b9e-297465d17eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:56.383815 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4470ee-57c9-4cdd-9b9e-297465d17eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:56.384100 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4470ee-57c9-4cdd-9b9e-297465d17eee admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:56.384377 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4470ee-57c9-4cdd-9b9e-297465d17eee admin admin] PATH_INFO: `/v3/users/c2348807417345ccac9a9c70f511c90b` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:56.385630 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4470ee-57c9-4cdd-9b9e-297465d17eee admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2348807417345ccac9a9c70f511c90b)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:56.387631 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4470ee-57c9-4cdd-9b9e-297465d17eee admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:56.450742 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-dc4470ee-57c9-4cdd-9b9e-297465d17eee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2348807417345ccac9a9c70f511c90b'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:56.460695 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-dc4470ee-57c9-4cdd-9b9e-297465d17eee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2348807417345ccac9a9c70f511c90b'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:56.484276 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-dc4470ee-57c9-4cdd-9b9e-297465d17eee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2348807417345ccac9a9c70f511c90b'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:56.485628 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-dc4470ee-57c9-4cdd-9b9e-297465d17eee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2348807417345ccac9a9c70f511c90b'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:56.501198 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-dc4470ee-57c9-4cdd-9b9e-297465d17eee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2348807417345ccac9a9c70f511c90b'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:56.513964 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1100/2184] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:23:56 2022] DELETE /identity/v3/users/c2348807417345ccac9a9c70f511c90b => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:56.519870 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a747336-24e7-4c7f-8b02-04dacda14561 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:56.520735 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a747336-24e7-4c7f-8b02-04dacda14561 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:56.520893 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a747336-24e7-4c7f-8b02-04dacda14561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:56.543995 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-8a747336-24e7-4c7f-8b02-04dacda14561 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:56.546185 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-8a747336-24e7-4c7f-8b02-04dacda14561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:56.641492 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1085/2185] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:23:56.653231 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4470ee-57c9-4cdd-9b9e-297465d17eee admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:56.655828 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-dc4470ee-57c9-4cdd-9b9e-297465d17eee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:56.709595 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:56.740393 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4470ee-57c9-4cdd-9b9e-297465d17eee admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:56.744963 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d360b21-686a-4a09-9c20-75d3a4ccfd8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:56.745609 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d360b21-686a-4a09-9c20-75d3a4ccfd8c service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:56.745887 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d360b21-686a-4a09-9c20-75d3a4ccfd8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:56.746156 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d360b21-686a-4a09-9c20-75d3a4ccfd8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:56.757335 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d360b21-686a-4a09-9c20-75d3a4ccfd8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:56.759414 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d360b21-686a-4a09-9c20-75d3a4ccfd8c service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:56.773749 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1101/2186] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:23:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:23:57.159241 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a747336-24e7-4c7f-8b02-04dacda14561 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:57.160755 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-8a747336-24e7-4c7f-8b02-04dacda14561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:57.183912 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a747336-24e7-4c7f-8b02-04dacda14561 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:57.191214 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1843dcf-7208-4b7e-af1f-00f0bb67e78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:57.192653 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1843dcf-7208-4b7e-af1f-00f0bb67e78f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:57.192653 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1843dcf-7208-4b7e-af1f-00f0bb67e78f admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:57.192653 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1843dcf-7208-4b7e-af1f-00f0bb67e78f admin admin] PATH_INFO: `/v3/projects/a73ad77434aa469baf81e415557ef31a` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:57.193833 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1843dcf-7208-4b7e-af1f-00f0bb67e78f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a73ad77434aa469baf81e415557ef31a)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:57.197479 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1843dcf-7208-4b7e-af1f-00f0bb67e78f admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:57.290669 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-e1843dcf-7208-4b7e-af1f-00f0bb67e78f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a73ad77434aa469baf81e415557ef31a', 'request_id': 'req-e1843dcf-7208-4b7e-af1f-00f0bb67e78f'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:57.305285 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-e1843dcf-7208-4b7e-af1f-00f0bb67e78f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a73ad77434aa469baf81e415557ef31a', 'request_id': 'req-e1843dcf-7208-4b7e-af1f-00f0bb67e78f'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:57.317821 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-e1843dcf-7208-4b7e-af1f-00f0bb67e78f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a73ad77434aa469baf81e415557ef31a', 'request_id': 'req-e1843dcf-7208-4b7e-af1f-00f0bb67e78f'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:57.362416 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-e1843dcf-7208-4b7e-af1f-00f0bb67e78f admin admin] The token cache is being invalidate because project a73ad77434aa469baf81e415557ef31a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:23:57.362949 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-e1843dcf-7208-4b7e-af1f-00f0bb67e78f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:57.367160 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-e1843dcf-7208-4b7e-af1f-00f0bb67e78f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:23:57.370098 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1086/2187] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:23:57 2022] DELETE /identity/v3/projects/a73ad77434aa469baf81e415557ef31a => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:23:57.377739 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c9a23-dd9b-4fc2-8fcc-f28959ba3fb8 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:57.380011 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c9a23-dd9b-4fc2-8fcc-f28959ba3fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:57.380657 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c9a23-dd9b-4fc2-8fcc-f28959ba3fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:57.419405 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-966c9a23-dd9b-4fc2-8fcc-f28959ba3fb8 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:57.420804 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-966c9a23-dd9b-4fc2-8fcc-f28959ba3fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:57.497002 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1102/2188] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:23:57.506264 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b218a3c-5408-4573-a453-44cf7d32cf7f None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:57.506735 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b218a3c-5408-4573-a453-44cf7d32cf7f None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:57.507116 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b218a3c-5408-4573-a453-44cf7d32cf7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:57.533697 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-4b218a3c-5408-4573-a453-44cf7d32cf7f None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:57.535189 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-4b218a3c-5408-4573-a453-44cf7d32cf7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:57.544450 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1087/2189] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:23:57.549152 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c9a23-dd9b-4fc2-8fcc-f28959ba3fb8 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:57.563633 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c9a23-dd9b-4fc2-8fcc-f28959ba3fb8 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:57.569655 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f178ac3-56ad-4247-be17-936f35fbfc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:57.570394 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f178ac3-56ad-4247-be17-936f35fbfc69 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:57.570709 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f178ac3-56ad-4247-be17-936f35fbfc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:57.570985 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f178ac3-56ad-4247-be17-936f35fbfc69 admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:57.571677 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f178ac3-56ad-4247-be17-936f35fbfc69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:23:57.571987 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f178ac3-56ad-4247-be17-936f35fbfc69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:57.573701 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f178ac3-56ad-4247-be17-936f35fbfc69 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:57.587352 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1103/2190] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:23:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:23:57.592436 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b218a3c-5408-4573-a453-44cf7d32cf7f None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:57.603497 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b218a3c-5408-4573-a453-44cf7d32cf7f None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:57.608613 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8052d35-9eac-4283-a726-755739d01d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:57.609235 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8052d35-9eac-4283-a726-755739d01d0f admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:57.609520 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8052d35-9eac-4283-a726-755739d01d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:57.609795 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8052d35-9eac-4283-a726-755739d01d0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:57.610469 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8052d35-9eac-4283-a726-755739d01d0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:57.612465 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8052d35-9eac-4283-a726-755739d01d0f admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:57.645899 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1088/2191] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:23:57 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:23:57.649956 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f178ac3-56ad-4247-be17-936f35fbfc69 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:57.661234 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f178ac3-56ad-4247-be17-936f35fbfc69 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:57.735235 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ace568-153a-4f73-b218-885253d0be62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:57.735976 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ace568-153a-4f73-b218-885253d0be62 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:57.736329 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ace568-153a-4f73-b218-885253d0be62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:57.736675 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ace568-153a-4f73-b218-885253d0be62 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:57.737525 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ace568-153a-4f73-b218-885253d0be62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:57.740258 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ace568-153a-4f73-b218-885253d0be62 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:57.770814 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1104/2192] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:23:57 2022] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:23:57.772568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8052d35-9eac-4283-a726-755739d01d0f admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:57.784162 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8052d35-9eac-4283-a726-755739d01d0f admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:57.791011 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25772974-30a0-4343-bed0-ecebdaa71684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:57.791639 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25772974-30a0-4343-bed0-ecebdaa71684 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:57.791921 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25772974-30a0-4343-bed0-ecebdaa71684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:57.793110 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25772974-30a0-4343-bed0-ecebdaa71684 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:57.793819 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25772974-30a0-4343-bed0-ecebdaa71684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:57.795558 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25772974-30a0-4343-bed0-ecebdaa71684 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:57.808066 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1089/2193] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:23:57.812393 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ace568-153a-4f73-b218-885253d0be62 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:57.826513 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ace568-153a-4f73-b218-885253d0be62 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:57.836422 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b82b7-1a3f-46f4-bdb7-371ffea0ef33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:57.838592 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b82b7-1a3f-46f4-bdb7-371ffea0ef33 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:57.839883 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b82b7-1a3f-46f4-bdb7-371ffea0ef33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:57.839883 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b82b7-1a3f-46f4-bdb7-371ffea0ef33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:57.841022 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b82b7-1a3f-46f4-bdb7-371ffea0ef33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:57.844093 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b82b7-1a3f-46f4-bdb7-371ffea0ef33 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:57.864812 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1105/2194] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:23:57.866288 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25772974-30a0-4343-bed0-ecebdaa71684 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:57.877559 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25772974-30a0-4343-bed0-ecebdaa71684 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:57.884794 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d4a13-5b48-49d5-ae37-a73a08cbf75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:57.885856 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d4a13-5b48-49d5-ae37-a73a08cbf75c admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:57.886999 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d4a13-5b48-49d5-ae37-a73a08cbf75c admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:57.886999 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d4a13-5b48-49d5-ae37-a73a08cbf75c admin admin] PATH_INFO: `/v3/projects/aaa96fc6a8d946789e7d12a0ba2f8728/users/47e8db49a0114d1b9b4c5965736b67fc/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:57.906811 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d4a13-5b48-49d5-ae37-a73a08cbf75c admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaa96fc6a8d946789e7d12a0ba2f8728, user_id=47e8db49a0114d1b9b4c5965736b67fc, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:57.910810 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d4a13-5b48-49d5-ae37-a73a08cbf75c admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:57.913906 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:57.931024 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1090/2195] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:23:57 2022] PUT /identity/v3/projects/aaa96fc6a8d946789e7d12a0ba2f8728/users/47e8db49a0114d1b9b4c5965736b67fc/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:23:57.948260 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abe0cf-6d84-42bf-ba2a-1ac4ff90cc90 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:57.948542 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abe0cf-6d84-42bf-ba2a-1ac4ff90cc90 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:57.948916 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abe0cf-6d84-42bf-ba2a-1ac4ff90cc90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:57.996659 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-02abe0cf-6d84-42bf-ba2a-1ac4ff90cc90 None None] MFA Rules not processed for user `47e8db49a0114d1b9b4c5965736b67fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:57.997933 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-02abe0cf-6d84-42bf-ba2a-1ac4ff90cc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:58.035096 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:58.089812 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1106/2196] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:23:58.094298 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d4a13-5b48-49d5-ae37-a73a08cbf75c admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:58.170604 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d4a13-5b48-49d5-ae37-a73a08cbf75c admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:58.176854 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d9cc5-ae89-4b08-a092-ec3b6b085eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:58.177472 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d9cc5-ae89-4b08-a092-ec3b6b085eca admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:58.177757 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d9cc5-ae89-4b08-a092-ec3b6b085eca admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:58.178029 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d9cc5-ae89-4b08-a092-ec3b6b085eca admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:58.178761 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444d9cc5-ae89-4b08-a092-ec3b6b085eca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:58.181300 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444d9cc5-ae89-4b08-a092-ec3b6b085eca admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:58.216877 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1091/2197] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:23:58 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:23:58.222485 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02abe0cf-6d84-42bf-ba2a-1ac4ff90cc90 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:58.235966 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02abe0cf-6d84-42bf-ba2a-1ac4ff90cc90 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:58.360321 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62ae82-f1b6-4a16-9874-6856078fe4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:58.361711 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62ae82-f1b6-4a16-9874-6856078fe4a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:58.362301 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62ae82-f1b6-4a16-9874-6856078fe4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:58.362943 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62ae82-f1b6-4a16-9874-6856078fe4a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:58.364398 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e62ae82-f1b6-4a16-9874-6856078fe4a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:58.369252 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e62ae82-f1b6-4a16-9874-6856078fe4a7 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:58.425502 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d9cc5-ae89-4b08-a092-ec3b6b085eca admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:58.426087 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1107/2198] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:23:58 2022] POST /identity/v3/users => generated 292 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:23:58.447687 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d9cc5-ae89-4b08-a092-ec3b6b085eca admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:58.456863 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38f8c6-d961-4588-bcc4-3bf6bb20dd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:58.457940 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38f8c6-d961-4588-bcc4-3bf6bb20dd4b admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:58.458441 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38f8c6-d961-4588-bcc4-3bf6bb20dd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:58.458872 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38f8c6-d961-4588-bcc4-3bf6bb20dd4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:58.459993 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38f8c6-d961-4588-bcc4-3bf6bb20dd4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:58.464059 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38f8c6-d961-4588-bcc4-3bf6bb20dd4b admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:58.489265 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1092/2199] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:23:58.494236 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62ae82-f1b6-4a16-9874-6856078fe4a7 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:58.513975 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62ae82-f1b6-4a16-9874-6856078fe4a7 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:58.523080 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93912bd8-289a-4d19-ab62-1669f86e4803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:58.524811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93912bd8-289a-4d19-ab62-1669f86e4803 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:58.524811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93912bd8-289a-4d19-ab62-1669f86e4803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:58.525442 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93912bd8-289a-4d19-ab62-1669f86e4803 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:58.526793 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93912bd8-289a-4d19-ab62-1669f86e4803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:58.530524 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93912bd8-289a-4d19-ab62-1669f86e4803 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:58.559179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1108/2200] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:23:58.559822 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38f8c6-d961-4588-bcc4-3bf6bb20dd4b admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:58.584038 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38f8c6-d961-4588-bcc4-3bf6bb20dd4b admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:58.591293 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2768d2-b8db-48b2-a0b2-4869f6b1594a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:58.592276 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2768d2-b8db-48b2-a0b2-4869f6b1594a admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:58.592735 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2768d2-b8db-48b2-a0b2-4869f6b1594a admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:58.593200 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2768d2-b8db-48b2-a0b2-4869f6b1594a admin admin] PATH_INFO: `/v3/projects/872e817256944b7cb05ff9c096a72139/users/9a19f898cf16491bb8b5248f1e0b883e/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:58.622888 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2768d2-b8db-48b2-a0b2-4869f6b1594a admin admin] RBAC: Authorizing `identity:create_grant(project_id=872e817256944b7cb05ff9c096a72139, user_id=9a19f898cf16491bb8b5248f1e0b883e, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:58.628769 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2768d2-b8db-48b2-a0b2-4869f6b1594a admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:58.659604 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1093/2201] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:23:58 2022] PUT /identity/v3/projects/872e817256944b7cb05ff9c096a72139/users/9a19f898cf16491bb8b5248f1e0b883e/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:23:58.677625 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b018f9-d150-465b-b688-6ee992016b3d None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:58.677941 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b018f9-d150-465b-b688-6ee992016b3d None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:58.678169 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b018f9-d150-465b-b688-6ee992016b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:58.773658 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-18b018f9-d150-465b-b688-6ee992016b3d None None] MFA Rules not processed for user `9a19f898cf16491bb8b5248f1e0b883e`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:58.775763 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-18b018f9-d150-465b-b688-6ee992016b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:58.877697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1109/2202] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:23:58.883983 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2768d2-b8db-48b2-a0b2-4869f6b1594a admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:58.998639 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2768d2-b8db-48b2-a0b2-4869f6b1594a admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:59.006568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed30d17-14bc-4fcd-89d4-b2b20d252069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:59.007313 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed30d17-14bc-4fcd-89d4-b2b20d252069 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:59.008245 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed30d17-14bc-4fcd-89d4-b2b20d252069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:59.008546 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed30d17-14bc-4fcd-89d4-b2b20d252069 admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:59.009275 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed30d17-14bc-4fcd-89d4-b2b20d252069 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:59.011495 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed30d17-14bc-4fcd-89d4-b2b20d252069 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:59.044114 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1094/2203] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:23:58 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:23:59.045418 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b018f9-d150-465b-b688-6ee992016b3d None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:59.058272 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b018f9-d150-465b-b688-6ee992016b3d None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:59.109823 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:59.155464 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa9916-a1d7-4369-8104-b3dd3fdfa45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:59.156544 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa9916-a1d7-4369-8104-b3dd3fdfa45d admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:59.157054 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa9916-a1d7-4369-8104-b3dd3fdfa45d admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:59.157572 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa9916-a1d7-4369-8104-b3dd3fdfa45d admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:59.158839 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefa9916-a1d7-4369-8104-b3dd3fdfa45d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:59.162815 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefa9916-a1d7-4369-8104-b3dd3fdfa45d admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:59.192216 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1110/2204] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:23:59 2022] POST /identity/v3/users => generated 298 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:23:59.198484 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed30d17-14bc-4fcd-89d4-b2b20d252069 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:59.209449 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed30d17-14bc-4fcd-89d4-b2b20d252069 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:59.215206 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f01448-bc8a-4d2b-956c-728357dcdf68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:59.215829 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f01448-bc8a-4d2b-956c-728357dcdf68 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:59.216116 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f01448-bc8a-4d2b-956c-728357dcdf68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:59.216376 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f01448-bc8a-4d2b-956c-728357dcdf68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:59.217033 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f01448-bc8a-4d2b-956c-728357dcdf68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:59.218781 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f01448-bc8a-4d2b-956c-728357dcdf68 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:59.237735 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1095/2205] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:23:59.242628 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa9916-a1d7-4369-8104-b3dd3fdfa45d admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:59.254114 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa9916-a1d7-4369-8104-b3dd3fdfa45d admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:59.259929 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3daa91-5c38-43e4-b05f-011954b0a6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:59.260620 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3daa91-5c38-43e4-b05f-011954b0a6d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:59.260906 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3daa91-5c38-43e4-b05f-011954b0a6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:59.261187 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3daa91-5c38-43e4-b05f-011954b0a6d3 admin admin] PATH_INFO: `/v3/projects/22f5a88cf51745349b15334ab46a1f12/users/7271c1d43e7544c393fdfaafa55df300/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:59.282585 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3daa91-5c38-43e4-b05f-011954b0a6d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22f5a88cf51745349b15334ab46a1f12, user_id=7271c1d43e7544c393fdfaafa55df300, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:59.288292 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3daa91-5c38-43e4-b05f-011954b0a6d3 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:59.306569 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1111/2206] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:23:59 2022] PUT /identity/v3/projects/22f5a88cf51745349b15334ab46a1f12/users/7271c1d43e7544c393fdfaafa55df300/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:23:59.310959 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f01448-bc8a-4d2b-956c-728357dcdf68 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:59.324627 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f01448-bc8a-4d2b-956c-728357dcdf68 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:59.340323 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:23:59.393286 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23307042-2b57-413b-8a1b-c307bc9f7a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:59.393801 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23307042-2b57-413b-8a1b-c307bc9f7a9b admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:59.394331 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23307042-2b57-413b-8a1b-c307bc9f7a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:59.394630 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23307042-2b57-413b-8a1b-c307bc9f7a9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:59.395295 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23307042-2b57-413b-8a1b-c307bc9f7a9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:59.396926 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23307042-2b57-413b-8a1b-c307bc9f7a9b admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:59.418145 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1096/2207] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:23:59.422613 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3daa91-5c38-43e4-b05f-011954b0a6d3 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:59.433916 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3daa91-5c38-43e4-b05f-011954b0a6d3 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:59.439325 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d25bc-a2aa-44a8-948d-0708509435c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:59.440130 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d25bc-a2aa-44a8-948d-0708509435c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:59.440504 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d25bc-a2aa-44a8-948d-0708509435c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:59.440873 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d25bc-a2aa-44a8-948d-0708509435c9 admin admin] PATH_INFO: `/v3/projects/22f5a88cf51745349b15334ab46a1f12/users/7271c1d43e7544c393fdfaafa55df300/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:59.443154 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d25bc-a2aa-44a8-948d-0708509435c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22f5a88cf51745349b15334ab46a1f12, user_id=7271c1d43e7544c393fdfaafa55df300, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:59.446246 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d25bc-a2aa-44a8-948d-0708509435c9 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:59.465226 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1112/2208] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:23:59 2022] PUT /identity/v3/projects/22f5a88cf51745349b15334ab46a1f12/users/7271c1d43e7544c393fdfaafa55df300/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:23:59.482581 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f706344-9b2d-4ec3-969b-92f0ae9f09ec None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:59.483013 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f706344-9b2d-4ec3-969b-92f0ae9f09ec None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:59.483393 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f706344-9b2d-4ec3-969b-92f0ae9f09ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:59.518168 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-2f706344-9b2d-4ec3-969b-92f0ae9f09ec None None] MFA Rules not processed for user `7271c1d43e7544c393fdfaafa55df300`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:23:59.519701 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-2f706344-9b2d-4ec3-969b-92f0ae9f09ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:59.613235 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1097/2209] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:23:59 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:23:59.630454 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d25bc-a2aa-44a8-948d-0708509435c9 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:23:59.632298 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-e43d25bc-a2aa-44a8-948d-0708509435c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:23:59.731429 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d25bc-a2aa-44a8-948d-0708509435c9 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:23:59.737651 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b75965-8fca-4c50-a0da-3f847015c608 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:23:59.738284 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b75965-8fca-4c50-a0da-3f847015c608 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:23:59.738707 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b75965-8fca-4c50-a0da-3f847015c608 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:23:59.739249 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b75965-8fca-4c50-a0da-3f847015c608 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:23:59.819352 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b75965-8fca-4c50-a0da-3f847015c608 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:23:59.821989 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b75965-8fca-4c50-a0da-3f847015c608 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:23:59.837982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1113/2210] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:23:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:24:01.863763 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f706344-9b2d-4ec3-969b-92f0ae9f09ec None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:01.867085 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-2f706344-9b2d-4ec3-969b-92f0ae9f09ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:01.890449 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f706344-9b2d-4ec3-969b-92f0ae9f09ec None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:01.898541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c548be29-6ee8-4fa9-9fb1-7fde35821d8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:01.899956 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548be29-6ee8-4fa9-9fb1-7fde35821d8a service cinder] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:01.900709 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548be29-6ee8-4fa9-9fb1-7fde35821d8a service cinder] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:01.901392 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548be29-6ee8-4fa9-9fb1-7fde35821d8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:02.081676 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c548be29-6ee8-4fa9-9fb1-7fde35821d8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:02.083967 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c548be29-6ee8-4fa9-9fb1-7fde35821d8a service cinder] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:02.104533 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1098/2211] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:24:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:24:02.105699 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3be56-7f47-49ae-903b-be95f0050684 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:02.106476 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3be56-7f47-49ae-903b-be95f0050684 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:02.107079 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3be56-7f47-49ae-903b-be95f0050684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:02.134259 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-68d3be56-7f47-49ae-903b-be95f0050684 None None] MFA Rules not processed for user `6fd7dcb531994f118c09e661ae3c3526`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:24:02.136437 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-68d3be56-7f47-49ae-903b-be95f0050684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:02.192685 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:24:02.216439 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1114/2212] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:24:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:24:02.904946 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c548be29-6ee8-4fa9-9fb1-7fde35821d8a service cinder] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:02.916652 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c548be29-6ee8-4fa9-9fb1-7fde35821d8a service cinder] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:02.921543 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774ab4b-ce27-435a-9ed4-37ea5916083a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:02.922551 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774ab4b-ce27-435a-9ed4-37ea5916083a service cinder] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:02.922898 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774ab4b-ce27-435a-9ed4-37ea5916083a service cinder] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:02.923234 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774ab4b-ce27-435a-9ed4-37ea5916083a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:02.934909 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e774ab4b-ce27-435a-9ed4-37ea5916083a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:02.936396 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e774ab4b-ce27-435a-9ed4-37ea5916083a service cinder] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:02.947503 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1099/2213] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:24:02 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:24:07.313220 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024bea7d-0e13-427e-85cf-c0e2831aefab None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:07.313818 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024bea7d-0e13-427e-85cf-c0e2831aefab None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:07.314413 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024bea7d-0e13-427e-85cf-c0e2831aefab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:07.352697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-024bea7d-0e13-427e-85cf-c0e2831aefab None None] MFA Rules not processed for user `bbd7a1d5a8d04e3798ffcab27bad936b`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:24:07.353968 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-024bea7d-0e13-427e-85cf-c0e2831aefab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:07.427015 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1115/2214] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Sep 21 12:24:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:24:07.494166 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774ab4b-ce27-435a-9ed4-37ea5916083a service cinder] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:07.496418 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-e774ab4b-ce27-435a-9ed4-37ea5916083a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:07.542352 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:24:07.626468 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774ab4b-ce27-435a-9ed4-37ea5916083a service cinder] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:07.632597 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63894849-ed54-45e8-9321-0202c6b4c0c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc2bab11b264196859802907b93ac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:07.633241 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63894849-ed54-45e8-9321-0202c6b4c0c9 service swift] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:07.633561 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63894849-ed54-45e8-9321-0202c6b4c0c9 service swift] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:07.633797 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63894849-ed54-45e8-9321-0202c6b4c0c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:07.642507 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024bea7d-0e13-427e-85cf-c0e2831aefab None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:07.643715 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63894849-ed54-45e8-9321-0202c6b4c0c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:07.645918 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63894849-ed54-45e8-9321-0202c6b4c0c9 service swift] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:07.669262 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1100/2215] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Sep 21 12:24:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 12:24:07.743168 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024bea7d-0e13-427e-85cf-c0e2831aefab None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:07.748178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef73d13-713d-42fe-b3ed-96d4828fc6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:07.748925 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef73d13-713d-42fe-b3ed-96d4828fc6d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:07.749279 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef73d13-713d-42fe-b3ed-96d4828fc6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:07.749630 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef73d13-713d-42fe-b3ed-96d4828fc6d4 admin admin] PATH_INFO: `/v3/users/47e8db49a0114d1b9b4c5965736b67fc` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:07.751412 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef73d13-713d-42fe-b3ed-96d4828fc6d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47e8db49a0114d1b9b4c5965736b67fc)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:07.753655 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef73d13-713d-42fe-b3ed-96d4828fc6d4 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:07.824304 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-3ef73d13-713d-42fe-b3ed-96d4828fc6d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47e8db49a0114d1b9b4c5965736b67fc'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:07.834839 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-3ef73d13-713d-42fe-b3ed-96d4828fc6d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47e8db49a0114d1b9b4c5965736b67fc'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:07.856850 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-3ef73d13-713d-42fe-b3ed-96d4828fc6d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47e8db49a0114d1b9b4c5965736b67fc'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:07.857655 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-3ef73d13-713d-42fe-b3ed-96d4828fc6d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47e8db49a0114d1b9b4c5965736b67fc'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:07.866692 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-3ef73d13-713d-42fe-b3ed-96d4828fc6d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47e8db49a0114d1b9b4c5965736b67fc'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:07.874415 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1116/2216] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:24:07 2022] DELETE /identity/v3/users/47e8db49a0114d1b9b4c5965736b67fc => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:24:07.883159 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64893af5-55e1-47a8-adf1-b1d0c8e325a3 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:07.884125 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64893af5-55e1-47a8-adf1-b1d0c8e325a3 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:07.884435 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64893af5-55e1-47a8-adf1-b1d0c8e325a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:07.926178 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-64893af5-55e1-47a8-adf1-b1d0c8e325a3 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:24:07.928707 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-64893af5-55e1-47a8-adf1-b1d0c8e325a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:08.072375 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1101/2217] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:24:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:24:08.083342 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef73d13-713d-42fe-b3ed-96d4828fc6d4 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:08.088959 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-3ef73d13-713d-42fe-b3ed-96d4828fc6d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:08.143620 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:24:08.248542 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef73d13-713d-42fe-b3ed-96d4828fc6d4 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:08.253385 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23df0e-1c65-486f-994f-eeafdb3a9f01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:08.254123 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23df0e-1c65-486f-994f-eeafdb3a9f01 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:08.254506 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23df0e-1c65-486f-994f-eeafdb3a9f01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:08.254845 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23df0e-1c65-486f-994f-eeafdb3a9f01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:08.267125 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab23df0e-1c65-486f-994f-eeafdb3a9f01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:08.268733 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab23df0e-1c65-486f-994f-eeafdb3a9f01 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:08.280963 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1117/2218] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:24:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:24:08.551646 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc7c89-e977-4739-841e-f30776546bed None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:08.552505 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc7c89-e977-4739-841e-f30776546bed None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:08.552505 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc7c89-e977-4739-841e-f30776546bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:08.589483 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-f6bc7c89-e977-4739-841e-f30776546bed None None] MFA Rules not processed for user `bbd7a1d5a8d04e3798ffcab27bad936b`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:24:08.591881 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-f6bc7c89-e977-4739-841e-f30776546bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:08.676228 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1102/2219] 10.222.0.60 () {58 vars in 967 bytes} [Wed Sep 21 12:24:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:24:08.693490 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23df0e-1c65-486f-994f-eeafdb3a9f01 service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:08.695965 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ab23df0e-1c65-486f-994f-eeafdb3a9f01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:08.710243 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc7c89-e977-4739-841e-f30776546bed None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:08.713856 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-f6bc7c89-e977-4739-841e-f30776546bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:08.744530 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc7c89-e977-4739-841e-f30776546bed None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:08.753094 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854665d1-a408-40ac-af4b-aee11cf8ebb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:08.754338 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854665d1-a408-40ac-af4b-aee11cf8ebb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:08.754890 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854665d1-a408-40ac-af4b-aee11cf8ebb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:08.755329 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854665d1-a408-40ac-af4b-aee11cf8ebb7 admin admin] PATH_INFO: `/v3/projects/aaa96fc6a8d946789e7d12a0ba2f8728` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:08.759376 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854665d1-a408-40ac-af4b-aee11cf8ebb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaa96fc6a8d946789e7d12a0ba2f8728)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:08.763033 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854665d1-a408-40ac-af4b-aee11cf8ebb7 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:08.800780 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23df0e-1c65-486f-994f-eeafdb3a9f01 service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:08.808608 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3bece3-9994-4499-be77-d61368e9cf8c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc2bab11b264196859802907b93ac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:08.809245 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3bece3-9994-4499-be77-d61368e9cf8c service swift] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:08.809521 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3bece3-9994-4499-be77-d61368e9cf8c service swift] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:08.809996 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3bece3-9994-4499-be77-d61368e9cf8c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:08.819596 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3bece3-9994-4499-be77-d61368e9cf8c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:08.821825 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3bece3-9994-4499-be77-d61368e9cf8c service swift] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:08.832236 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-854665d1-a408-40ac-af4b-aee11cf8ebb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaa96fc6a8d946789e7d12a0ba2f8728', 'request_id': 'req-854665d1-a408-40ac-af4b-aee11cf8ebb7'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:08.834402 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1118/2220] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Sep 21 12:24:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 21 12:24:08.840412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:24:08.847987 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-854665d1-a408-40ac-af4b-aee11cf8ebb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaa96fc6a8d946789e7d12a0ba2f8728', 'request_id': 'req-854665d1-a408-40ac-af4b-aee11cf8ebb7'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:08.863536 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-854665d1-a408-40ac-af4b-aee11cf8ebb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaa96fc6a8d946789e7d12a0ba2f8728', 'request_id': 'req-854665d1-a408-40ac-af4b-aee11cf8ebb7'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:08.880367 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-854665d1-a408-40ac-af4b-aee11cf8ebb7 admin admin] The token cache is being invalidate because project aaa96fc6a8d946789e7d12a0ba2f8728 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:24:08.880801 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-854665d1-a408-40ac-af4b-aee11cf8ebb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:08.881639 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-854665d1-a408-40ac-af4b-aee11cf8ebb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:08.884845 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1103/2221] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:24:08 2022] DELETE /identity/v3/projects/aaa96fc6a8d946789e7d12a0ba2f8728 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:24:08.890230 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3bece3-9994-4499-be77-d61368e9cf8c service swift] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:08.912342 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3bece3-9994-4499-be77-d61368e9cf8c service swift] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:09.007298 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c653b1e-9d5d-47d9-bdaa-a70a6aa79900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:09.008246 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c653b1e-9d5d-47d9-bdaa-a70a6aa79900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:09.008695 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c653b1e-9d5d-47d9-bdaa-a70a6aa79900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:09.009047 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c653b1e-9d5d-47d9-bdaa-a70a6aa79900 admin admin] PATH_INFO: `/v3/users/9a19f898cf16491bb8b5248f1e0b883e` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:09.011031 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c653b1e-9d5d-47d9-bdaa-a70a6aa79900 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a19f898cf16491bb8b5248f1e0b883e)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:09.014168 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c653b1e-9d5d-47d9-bdaa-a70a6aa79900 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:09.095075 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-1c653b1e-9d5d-47d9-bdaa-a70a6aa79900 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a19f898cf16491bb8b5248f1e0b883e'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:09.097466 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:24:09.111185 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-1c653b1e-9d5d-47d9-bdaa-a70a6aa79900 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a19f898cf16491bb8b5248f1e0b883e'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:09.132025 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-1c653b1e-9d5d-47d9-bdaa-a70a6aa79900 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a19f898cf16491bb8b5248f1e0b883e'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:09.133070 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-1c653b1e-9d5d-47d9-bdaa-a70a6aa79900 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a19f898cf16491bb8b5248f1e0b883e'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:09.145651 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-1c653b1e-9d5d-47d9-bdaa-a70a6aa79900 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a19f898cf16491bb8b5248f1e0b883e'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:09.155442 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1119/2222] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:24:08 2022] DELETE /identity/v3/users/9a19f898cf16491bb8b5248f1e0b883e => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:24:09.236450 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3fb5d5-1860-4e40-8800-657e156d229b None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:09.237789 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3fb5d5-1860-4e40-8800-657e156d229b None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:09.238352 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3fb5d5-1860-4e40-8800-657e156d229b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:09.281358 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-ce3fb5d5-1860-4e40-8800-657e156d229b None None] MFA Rules not processed for user `bbd7a1d5a8d04e3798ffcab27bad936b`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:24:09.285028 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-ce3fb5d5-1860-4e40-8800-657e156d229b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:09.439907 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1104/2223] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Sep 21 12:24:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:24:09.474712 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c653b1e-9d5d-47d9-bdaa-a70a6aa79900 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:09.480573 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-1c653b1e-9d5d-47d9-bdaa-a70a6aa79900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:09.662639 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c653b1e-9d5d-47d9-bdaa-a70a6aa79900 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:09.673646 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cd85e-bc73-4016-a8ed-c2085e59aa78 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc2bab11b264196859802907b93ac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:09.674485 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cd85e-bc73-4016-a8ed-c2085e59aa78 service swift] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:09.674927 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cd85e-bc73-4016-a8ed-c2085e59aa78 service swift] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:09.675185 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cd85e-bc73-4016-a8ed-c2085e59aa78 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:09.691071 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462cd85e-bc73-4016-a8ed-c2085e59aa78 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:09.693001 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3fb5d5-1860-4e40-8800-657e156d229b None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:09.696164 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-ce3fb5d5-1860-4e40-8800-657e156d229b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:09.699480 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462cd85e-bc73-4016-a8ed-c2085e59aa78 service swift] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:09.723223 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1120/2224] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Sep 21 12:24:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 12:24:09.859871 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3fb5d5-1860-4e40-8800-657e156d229b None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:09.868283 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61659ed-0fde-4075-a5f8-a5e8e93495cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:09.869175 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61659ed-0fde-4075-a5f8-a5e8e93495cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:09.869635 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61659ed-0fde-4075-a5f8-a5e8e93495cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:09.870109 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61659ed-0fde-4075-a5f8-a5e8e93495cb admin admin] PATH_INFO: `/v3/projects/872e817256944b7cb05ff9c096a72139` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:09.872178 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61659ed-0fde-4075-a5f8-a5e8e93495cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=872e817256944b7cb05ff9c096a72139)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:09.875564 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61659ed-0fde-4075-a5f8-a5e8e93495cb admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:09.950899 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-b61659ed-0fde-4075-a5f8-a5e8e93495cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '872e817256944b7cb05ff9c096a72139', 'request_id': 'req-b61659ed-0fde-4075-a5f8-a5e8e93495cb'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:09.967397 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-b61659ed-0fde-4075-a5f8-a5e8e93495cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '872e817256944b7cb05ff9c096a72139', 'request_id': 'req-b61659ed-0fde-4075-a5f8-a5e8e93495cb'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:09.983753 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-b61659ed-0fde-4075-a5f8-a5e8e93495cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '872e817256944b7cb05ff9c096a72139', 'request_id': 'req-b61659ed-0fde-4075-a5f8-a5e8e93495cb'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:10.003392 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-b61659ed-0fde-4075-a5f8-a5e8e93495cb admin admin] The token cache is being invalidate because project 872e817256944b7cb05ff9c096a72139 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:24:10.003928 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-b61659ed-0fde-4075-a5f8-a5e8e93495cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:10.004936 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-b61659ed-0fde-4075-a5f8-a5e8e93495cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:10.007086 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1105/2225] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:24:09 2022] DELETE /identity/v3/projects/872e817256944b7cb05ff9c096a72139 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:24:10.012123 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cd85e-bc73-4016-a8ed-c2085e59aa78 service swift] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:10.028515 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cd85e-bc73-4016-a8ed-c2085e59aa78 service swift] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:10.121652 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874128ea-7066-4993-8b0d-8a44b3c8ace2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:10.122694 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874128ea-7066-4993-8b0d-8a44b3c8ace2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:10.123082 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874128ea-7066-4993-8b0d-8a44b3c8ace2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:10.123578 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874128ea-7066-4993-8b0d-8a44b3c8ace2 admin admin] PATH_INFO: `/v3/users/7271c1d43e7544c393fdfaafa55df300` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:10.125399 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874128ea-7066-4993-8b0d-8a44b3c8ace2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7271c1d43e7544c393fdfaafa55df300)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:10.128006 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874128ea-7066-4993-8b0d-8a44b3c8ace2 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:10.194868 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-874128ea-7066-4993-8b0d-8a44b3c8ace2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7271c1d43e7544c393fdfaafa55df300'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:10.209543 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-874128ea-7066-4993-8b0d-8a44b3c8ace2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7271c1d43e7544c393fdfaafa55df300'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:10.213739 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:24:10.235279 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-874128ea-7066-4993-8b0d-8a44b3c8ace2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7271c1d43e7544c393fdfaafa55df300'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:10.236346 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-874128ea-7066-4993-8b0d-8a44b3c8ace2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7271c1d43e7544c393fdfaafa55df300'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:10.246757 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-874128ea-7066-4993-8b0d-8a44b3c8ace2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7271c1d43e7544c393fdfaafa55df300'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:10.254284 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1121/2226] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:24:10 2022] DELETE /identity/v3/users/7271c1d43e7544c393fdfaafa55df300 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:24:10.282220 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fda084-dfb4-40cc-a9e9-1ddc4f792438 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:10.282704 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fda084-dfb4-40cc-a9e9-1ddc4f792438 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:10.283197 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fda084-dfb4-40cc-a9e9-1ddc4f792438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:10.308097 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-12fda084-dfb4-40cc-a9e9-1ddc4f792438 None None] MFA Rules not processed for user `bbd7a1d5a8d04e3798ffcab27bad936b`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:24:10.309427 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-12fda084-dfb4-40cc-a9e9-1ddc4f792438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:10.326037 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:24:10.384051 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1106/2227] 10.222.0.60 () {58 vars in 967 bytes} [Wed Sep 21 12:24:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:24:10.402991 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874128ea-7066-4993-8b0d-8a44b3c8ace2 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:10.405630 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-874128ea-7066-4993-8b0d-8a44b3c8ace2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:10.508448 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874128ea-7066-4993-8b0d-8a44b3c8ace2 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:10.514265 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e68af-3df8-434b-979d-a301139bc58b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc2bab11b264196859802907b93ac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:10.514869 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e68af-3df8-434b-979d-a301139bc58b service swift] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:10.515200 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e68af-3df8-434b-979d-a301139bc58b service swift] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:10.515469 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e68af-3df8-434b-979d-a301139bc58b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:10.527620 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e68af-3df8-434b-979d-a301139bc58b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:10.529312 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e68af-3df8-434b-979d-a301139bc58b service swift] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:10.541192 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1122/2228] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Sep 21 12:24:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 12:24:10.800974 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fda084-dfb4-40cc-a9e9-1ddc4f792438 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:10.803336 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-12fda084-dfb4-40cc-a9e9-1ddc4f792438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:10.946590 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fda084-dfb4-40cc-a9e9-1ddc4f792438 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:10.953640 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf0ebe-d974-4f4d-9fe9-a187ba9c165e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:10.954974 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf0ebe-d974-4f4d-9fe9-a187ba9c165e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:10.955280 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf0ebe-d974-4f4d-9fe9-a187ba9c165e admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:10.955558 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf0ebe-d974-4f4d-9fe9-a187ba9c165e admin admin] PATH_INFO: `/v3/projects/22f5a88cf51745349b15334ab46a1f12` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:10.956889 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf0ebe-d974-4f4d-9fe9-a187ba9c165e admin admin] RBAC: Authorizing `identity:delete_project(project_id=22f5a88cf51745349b15334ab46a1f12)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:10.959341 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf0ebe-d974-4f4d-9fe9-a187ba9c165e admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:11.063188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-5dcf0ebe-d974-4f4d-9fe9-a187ba9c165e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22f5a88cf51745349b15334ab46a1f12', 'request_id': 'req-5dcf0ebe-d974-4f4d-9fe9-a187ba9c165e'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:11.077256 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-5dcf0ebe-d974-4f4d-9fe9-a187ba9c165e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22f5a88cf51745349b15334ab46a1f12', 'request_id': 'req-5dcf0ebe-d974-4f4d-9fe9-a187ba9c165e'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:11.098496 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-5dcf0ebe-d974-4f4d-9fe9-a187ba9c165e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22f5a88cf51745349b15334ab46a1f12', 'request_id': 'req-5dcf0ebe-d974-4f4d-9fe9-a187ba9c165e'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:11.136976 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-5dcf0ebe-d974-4f4d-9fe9-a187ba9c165e admin admin] The token cache is being invalidate because project 22f5a88cf51745349b15334ab46a1f12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:24:11.138042 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-5dcf0ebe-d974-4f4d-9fe9-a187ba9c165e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:11.139929 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-5dcf0ebe-d974-4f4d-9fe9-a187ba9c165e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:11.144764 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1107/2229] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:24:10 2022] DELETE /identity/v3/projects/22f5a88cf51745349b15334ab46a1f12 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:24:11.153549 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542e384-999b-4507-a075-f90d061961f6 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:11.156278 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542e384-999b-4507-a075-f90d061961f6 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:11.157264 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542e384-999b-4507-a075-f90d061961f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:11.214301 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-5542e384-999b-4507-a075-f90d061961f6 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:24:11.218916 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-5542e384-999b-4507-a075-f90d061961f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:11.389476 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1123/2230] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:24:11.402767 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eab455-a809-48bd-a945-1c8d0ccc1560 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:11.403438 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eab455-a809-48bd-a945-1c8d0ccc1560 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:11.403874 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eab455-a809-48bd-a945-1c8d0ccc1560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:11.432821 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-b7eab455-a809-48bd-a945-1c8d0ccc1560 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:24:11.434399 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-b7eab455-a809-48bd-a945-1c8d0ccc1560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:11.444888 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1108/2231] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:24:11.451190 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542e384-999b-4507-a075-f90d061961f6 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:11.465334 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542e384-999b-4507-a075-f90d061961f6 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:11.472569 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699290c2-fa47-4e55-a6bc-46746305023c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:11.473209 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699290c2-fa47-4e55-a6bc-46746305023c admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:11.473590 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699290c2-fa47-4e55-a6bc-46746305023c admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:11.473750 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699290c2-fa47-4e55-a6bc-46746305023c admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:11.474537 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699290c2-fa47-4e55-a6bc-46746305023c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:24:11.474940 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699290c2-fa47-4e55-a6bc-46746305023c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:11.477514 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699290c2-fa47-4e55-a6bc-46746305023c admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:11.493605 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1124/2232] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:24:11.503016 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eab455-a809-48bd-a945-1c8d0ccc1560 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:11.532795 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eab455-a809-48bd-a945-1c8d0ccc1560 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:11.542824 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17adc2-55b7-4af2-ab90-c15d930bfda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:11.543838 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17adc2-55b7-4af2-ab90-c15d930bfda3 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:11.544501 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17adc2-55b7-4af2-ab90-c15d930bfda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:11.544959 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17adc2-55b7-4af2-ab90-c15d930bfda3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:11.546023 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c17adc2-55b7-4af2-ab90-c15d930bfda3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:11.549783 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c17adc2-55b7-4af2-ab90-c15d930bfda3 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:11.605061 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1109/2233] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:24:11 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:24:11.611166 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699290c2-fa47-4e55-a6bc-46746305023c admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:11.622905 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699290c2-fa47-4e55-a6bc-46746305023c admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:11.715186 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:24:11.733581 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c688a7-4f76-4102-9135-8237abbc5273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:11.734903 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c688a7-4f76-4102-9135-8237abbc5273 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:11.738214 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c688a7-4f76-4102-9135-8237abbc5273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:11.738766 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c688a7-4f76-4102-9135-8237abbc5273 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:11.739452 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c688a7-4f76-4102-9135-8237abbc5273 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:11.741454 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c688a7-4f76-4102-9135-8237abbc5273 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:11.786564 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1125/2234] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:24:11 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:24:11.789948 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17adc2-55b7-4af2-ab90-c15d930bfda3 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:11.809106 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17adc2-55b7-4af2-ab90-c15d930bfda3 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:11.820976 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5182e03-8eea-4321-9ca0-9caf0691616a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:11.822108 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5182e03-8eea-4321-9ca0-9caf0691616a admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:11.822717 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5182e03-8eea-4321-9ca0-9caf0691616a admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:11.823212 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5182e03-8eea-4321-9ca0-9caf0691616a admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:11.824408 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5182e03-8eea-4321-9ca0-9caf0691616a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:11.832332 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5182e03-8eea-4321-9ca0-9caf0691616a admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:11.857346 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1110/2235] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:24:11.859288 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c688a7-4f76-4102-9135-8237abbc5273 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:11.884017 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c688a7-4f76-4102-9135-8237abbc5273 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:11.894598 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f3dfd-7b86-4ea0-bda0-ae54b1d8516a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:11.895625 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f3dfd-7b86-4ea0-bda0-ae54b1d8516a admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:11.895919 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f3dfd-7b86-4ea0-bda0-ae54b1d8516a admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:11.896195 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f3dfd-7b86-4ea0-bda0-ae54b1d8516a admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:11.896865 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01f3dfd-7b86-4ea0-bda0-ae54b1d8516a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:11.900142 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01f3dfd-7b86-4ea0-bda0-ae54b1d8516a admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:11.922640 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1126/2236] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:24:11.926579 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5182e03-8eea-4321-9ca0-9caf0691616a admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:11.946302 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5182e03-8eea-4321-9ca0-9caf0691616a admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:11.961088 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b6be0-5e0a-4499-b6a8-9a8a27b62c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:11.962418 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b6be0-5e0a-4499-b6a8-9a8a27b62c30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:11.962983 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b6be0-5e0a-4499-b6a8-9a8a27b62c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:11.963543 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b6be0-5e0a-4499-b6a8-9a8a27b62c30 admin admin] PATH_INFO: `/v3/projects/35c6f6cfbfe9415c95f81654d4e76568/users/3d402d25606246e09b3e1310e96206b7/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:11.988921 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:24:11.994460 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b6be0-5e0a-4499-b6a8-9a8a27b62c30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35c6f6cfbfe9415c95f81654d4e76568, user_id=3d402d25606246e09b3e1310e96206b7, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:11.998405 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b6be0-5e0a-4499-b6a8-9a8a27b62c30 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:12.017768 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1111/2237] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:24:11 2022] PUT /identity/v3/projects/35c6f6cfbfe9415c95f81654d4e76568/users/3d402d25606246e09b3e1310e96206b7/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:24:12.033528 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27403ea9-76ce-448c-a62a-7ffd2cf6d7ac None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:12.033808 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27403ea9-76ce-448c-a62a-7ffd2cf6d7ac None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:12.034085 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27403ea9-76ce-448c-a62a-7ffd2cf6d7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:12.085978 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-27403ea9-76ce-448c-a62a-7ffd2cf6d7ac None None] MFA Rules not processed for user `3d402d25606246e09b3e1310e96206b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:24:12.088718 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-27403ea9-76ce-448c-a62a-7ffd2cf6d7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:12.205738 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1127/2238] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:24:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:24:12.222539 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b6be0-5e0a-4499-b6a8-9a8a27b62c30 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:12.225221 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-838b6be0-5e0a-4499-b6a8-9a8a27b62c30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:12.351856 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b6be0-5e0a-4499-b6a8-9a8a27b62c30 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:12.358959 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1120c50-3d12-4605-8fda-88ecff9031cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:12.360037 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1120c50-3d12-4605-8fda-88ecff9031cb service cinder] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:12.360543 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1120c50-3d12-4605-8fda-88ecff9031cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:12.361043 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1120c50-3d12-4605-8fda-88ecff9031cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:12.375748 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1120c50-3d12-4605-8fda-88ecff9031cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:12.377233 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1120c50-3d12-4605-8fda-88ecff9031cb service cinder] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:12.388357 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1112/2239] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:24:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:24:13.387762 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27403ea9-76ce-448c-a62a-7ffd2cf6d7ac None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:13.389699 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-27403ea9-76ce-448c-a62a-7ffd2cf6d7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:13.473106 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27403ea9-76ce-448c-a62a-7ffd2cf6d7ac None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:13.478890 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2b01f-45ef-4750-a116-0a8234808abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:13.479574 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2b01f-45ef-4750-a116-0a8234808abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:13.479859 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2b01f-45ef-4750-a116-0a8234808abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:13.480137 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2b01f-45ef-4750-a116-0a8234808abb admin admin] PATH_INFO: `/v3/users/bcfb8c74de5c42f692e6f1b248465f3e` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:13.481381 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf2b01f-45ef-4750-a116-0a8234808abb admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcfb8c74de5c42f692e6f1b248465f3e)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:13.483522 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf2b01f-45ef-4750-a116-0a8234808abb admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:13.540562 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-8bf2b01f-45ef-4750-a116-0a8234808abb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcfb8c74de5c42f692e6f1b248465f3e'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:13.550913 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-8bf2b01f-45ef-4750-a116-0a8234808abb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcfb8c74de5c42f692e6f1b248465f3e'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:13.558194 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:24:13.570759 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-8bf2b01f-45ef-4750-a116-0a8234808abb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcfb8c74de5c42f692e6f1b248465f3e'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:13.571771 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-8bf2b01f-45ef-4750-a116-0a8234808abb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcfb8c74de5c42f692e6f1b248465f3e'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:13.582818 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-8bf2b01f-45ef-4750-a116-0a8234808abb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcfb8c74de5c42f692e6f1b248465f3e'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:13.590043 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1128/2240] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:24:13 2022] DELETE /identity/v3/users/bcfb8c74de5c42f692e6f1b248465f3e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:24:13.595540 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912de4dc-2543-497b-972c-ae3fc48a20b9 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:13.596143 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912de4dc-2543-497b-972c-ae3fc48a20b9 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:13.596143 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912de4dc-2543-497b-972c-ae3fc48a20b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:13.621053 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-912de4dc-2543-497b-972c-ae3fc48a20b9 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:24:13.622521 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-912de4dc-2543-497b-972c-ae3fc48a20b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:13.697553 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1113/2241] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:24:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:24:13.711287 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2b01f-45ef-4750-a116-0a8234808abb admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:13.713669 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-8bf2b01f-45ef-4750-a116-0a8234808abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:13.799585 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2b01f-45ef-4750-a116-0a8234808abb admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:13.804422 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eaab73-4f38-4666-87fb-6fdaa1782739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:13.805055 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eaab73-4f38-4666-87fb-6fdaa1782739 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:13.805337 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eaab73-4f38-4666-87fb-6fdaa1782739 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:13.805614 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eaab73-4f38-4666-87fb-6fdaa1782739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:13.824324 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eaab73-4f38-4666-87fb-6fdaa1782739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:13.826021 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eaab73-4f38-4666-87fb-6fdaa1782739 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:13.868052 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1129/2242] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:24:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:24:14.221583 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912de4dc-2543-497b-972c-ae3fc48a20b9 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:14.223922 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-912de4dc-2543-497b-972c-ae3fc48a20b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:14.241356 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912de4dc-2543-497b-972c-ae3fc48a20b9 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:14.247321 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204d116-081b-4113-bf8a-7b26736222ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:14.248630 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204d116-081b-4113-bf8a-7b26736222ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:14.249383 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204d116-081b-4113-bf8a-7b26736222ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:14.249911 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204d116-081b-4113-bf8a-7b26736222ef admin admin] PATH_INFO: `/v3/projects/522adaf9c6654133be1215ab1d4e26f0` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:14.251754 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2204d116-081b-4113-bf8a-7b26736222ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=522adaf9c6654133be1215ab1d4e26f0)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:14.254211 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2204d116-081b-4113-bf8a-7b26736222ef admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:14.383921 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-2204d116-081b-4113-bf8a-7b26736222ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '522adaf9c6654133be1215ab1d4e26f0', 'request_id': 'req-2204d116-081b-4113-bf8a-7b26736222ef'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:14.402726 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-2204d116-081b-4113-bf8a-7b26736222ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '522adaf9c6654133be1215ab1d4e26f0', 'request_id': 'req-2204d116-081b-4113-bf8a-7b26736222ef'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:14.424629 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-2204d116-081b-4113-bf8a-7b26736222ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '522adaf9c6654133be1215ab1d4e26f0', 'request_id': 'req-2204d116-081b-4113-bf8a-7b26736222ef'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:14.456323 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-2204d116-081b-4113-bf8a-7b26736222ef admin admin] The token cache is being invalidate because project 522adaf9c6654133be1215ab1d4e26f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:24:14.458566 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-2204d116-081b-4113-bf8a-7b26736222ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:14.461432 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-2204d116-081b-4113-bf8a-7b26736222ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:14.465497 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1114/2243] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:24:14 2022] DELETE /identity/v3/projects/522adaf9c6654133be1215ab1d4e26f0 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:24:20.897666 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f4af2-158c-42dc-aeab-92f6c75c882f None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:20.903442 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f4af2-158c-42dc-aeab-92f6c75c882f None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:20.904309 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f4af2-158c-42dc-aeab-92f6c75c882f None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:20.908263 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1130/2244] 10.222.0.60 () {54 vars in 921 bytes} [Wed Sep 21 12:24:20 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:24:20.931864 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0b79a-9bda-4ed6-8fdc-8906504cc1c9 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:20.932689 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0b79a-9bda-4ed6-8fdc-8906504cc1c9 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:20.933640 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0b79a-9bda-4ed6-8fdc-8906504cc1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:20.972489 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-22d0b79a-9bda-4ed6-8fdc-8906504cc1c9 None None] MFA Rules not processed for user `74e866f134f64644bf33e3adecf207c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:24:20.974006 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-22d0b79a-9bda-4ed6-8fdc-8906504cc1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:20.997914 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:24:21.009338 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f4af2-158c-42dc-aeab-92f6c75c882f None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:21.012422 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-c03f4af2-158c-42dc-aeab-92f6c75c882f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:21.090010 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1115/2245] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Sep 21 12:24:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:24:21.104762 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0b79a-9bda-4ed6-8fdc-8906504cc1c9 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:21.106853 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-22d0b79a-9bda-4ed6-8fdc-8906504cc1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:21.134062 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0b79a-9bda-4ed6-8fdc-8906504cc1c9 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:21.141747 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9819e-5f4c-49c7-b896-f9d872b758a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e866f134f64644bf33e3adecf207c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:21.142531 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9819e-5f4c-49c7-b896-f9d872b758a4 service placement] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:21.142894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9819e-5f4c-49c7-b896-f9d872b758a4 service placement] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:21.143243 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9819e-5f4c-49c7-b896-f9d872b758a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:21.172148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9819e-5f4c-49c7-b896-f9d872b758a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:21.175563 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9819e-5f4c-49c7-b896-f9d872b758a4 service placement] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:21.196043 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f4af2-158c-42dc-aeab-92f6c75c882f None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:21.201688 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1116/2246] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:24:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:24:21.204870 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9402606c-0c6c-4548-8ab3-620e41743001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:21.206195 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9402606c-0c6c-4548-8ab3-620e41743001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:21.206933 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9402606c-0c6c-4548-8ab3-620e41743001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:21.207630 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9402606c-0c6c-4548-8ab3-620e41743001 admin admin] PATH_INFO: `/v3/users/b46c06d66cc14dd2ad3b33d1c9b0d641` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:21.210036 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9402606c-0c6c-4548-8ab3-620e41743001 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b46c06d66cc14dd2ad3b33d1c9b0d641)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:21.219408 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9402606c-0c6c-4548-8ab3-620e41743001 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:21.328104 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-9402606c-0c6c-4548-8ab3-620e41743001 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b46c06d66cc14dd2ad3b33d1c9b0d641'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:21.339426 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-9402606c-0c6c-4548-8ab3-620e41743001 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b46c06d66cc14dd2ad3b33d1c9b0d641'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:21.366393 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-9402606c-0c6c-4548-8ab3-620e41743001 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b46c06d66cc14dd2ad3b33d1c9b0d641'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:21.368969 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-9402606c-0c6c-4548-8ab3-620e41743001 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b46c06d66cc14dd2ad3b33d1c9b0d641'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:21.384467 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-9402606c-0c6c-4548-8ab3-620e41743001 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b46c06d66cc14dd2ad3b33d1c9b0d641'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:21.392589 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:24:21.395343 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1131/2247] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:24:21 2022] DELETE /identity/v3/users/b46c06d66cc14dd2ad3b33d1c9b0d641 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:24:21.669396 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9819e-5f4c-49c7-b896-f9d872b758a4 service placement] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:21.685889 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9819e-5f4c-49c7-b896-f9d872b758a4 service placement] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:21.793426 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f5e12-5f10-4c5e-a236-169421c64ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:21.794575 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f5e12-5f10-4c5e-a236-169421c64ed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:21.795280 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f5e12-5f10-4c5e-a236-169421c64ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:21.795521 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f5e12-5f10-4c5e-a236-169421c64ed6 admin admin] PATH_INFO: `/v3/projects/0582ebd3369b403ca66ecf9b4cbd003e` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:21.797860 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f5e12-5f10-4c5e-a236-169421c64ed6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0582ebd3369b403ca66ecf9b4cbd003e)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:21.801997 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f5e12-5f10-4c5e-a236-169421c64ed6 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:21.878113 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-812f5e12-5f10-4c5e-a236-169421c64ed6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0582ebd3369b403ca66ecf9b4cbd003e', 'request_id': 'req-812f5e12-5f10-4c5e-a236-169421c64ed6'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:21.890703 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-812f5e12-5f10-4c5e-a236-169421c64ed6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0582ebd3369b403ca66ecf9b4cbd003e', 'request_id': 'req-812f5e12-5f10-4c5e-a236-169421c64ed6'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:21.909135 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-812f5e12-5f10-4c5e-a236-169421c64ed6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0582ebd3369b403ca66ecf9b4cbd003e', 'request_id': 'req-812f5e12-5f10-4c5e-a236-169421c64ed6'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:21.931053 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-812f5e12-5f10-4c5e-a236-169421c64ed6 admin admin] The token cache is being invalidate because project 0582ebd3369b403ca66ecf9b4cbd003e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:24:21.931346 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-812f5e12-5f10-4c5e-a236-169421c64ed6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:21.932059 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-812f5e12-5f10-4c5e-a236-169421c64ed6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:21.942235 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1117/2248] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:24:21 2022] DELETE /identity/v3/projects/0582ebd3369b403ca66ecf9b4cbd003e => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:24:21.948370 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9402606c-0c6c-4548-8ab3-620e41743001 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:21.950830 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-9402606c-0c6c-4548-8ab3-620e41743001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:21.974110 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9402606c-0c6c-4548-8ab3-620e41743001 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:22.057008 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150123d-e39e-4f97-9886-8d349eb0623e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:22.057720 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150123d-e39e-4f97-9886-8d349eb0623e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:22.058071 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150123d-e39e-4f97-9886-8d349eb0623e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:22.058463 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150123d-e39e-4f97-9886-8d349eb0623e admin admin] PATH_INFO: `/v3/users/e43e7ed267b14ba19dbcb52f800b00f5` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:22.060131 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7150123d-e39e-4f97-9886-8d349eb0623e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e43e7ed267b14ba19dbcb52f800b00f5)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:22.063200 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7150123d-e39e-4f97-9886-8d349eb0623e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:22.127564 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-7150123d-e39e-4f97-9886-8d349eb0623e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e43e7ed267b14ba19dbcb52f800b00f5'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:22.137484 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-7150123d-e39e-4f97-9886-8d349eb0623e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e43e7ed267b14ba19dbcb52f800b00f5'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:22.154687 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-7150123d-e39e-4f97-9886-8d349eb0623e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e43e7ed267b14ba19dbcb52f800b00f5'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:22.155544 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-7150123d-e39e-4f97-9886-8d349eb0623e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e43e7ed267b14ba19dbcb52f800b00f5'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:22.164533 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-7150123d-e39e-4f97-9886-8d349eb0623e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e43e7ed267b14ba19dbcb52f800b00f5'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:22.174454 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1132/2249] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:24:21 2022] DELETE /identity/v3/users/e43e7ed267b14ba19dbcb52f800b00f5 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:24:22.447051 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f5e12-5f10-4c5e-a236-169421c64ed6 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:22.449471 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-812f5e12-5f10-4c5e-a236-169421c64ed6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:22.480784 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f5e12-5f10-4c5e-a236-169421c64ed6 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:22.535094 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:24:22.603311 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d3f25-0667-4c08-8643-261578924b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:22.603972 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d3f25-0667-4c08-8643-261578924b52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:22.604261 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d3f25-0667-4c08-8643-261578924b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:22.604541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d3f25-0667-4c08-8643-261578924b52 admin admin] PATH_INFO: `/v3/projects/b5f9514f34524c8092982e274624390e` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:22.605967 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d3f25-0667-4c08-8643-261578924b52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5f9514f34524c8092982e274624390e)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:22.608228 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d3f25-0667-4c08-8643-261578924b52 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:22.671696 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-6b8d3f25-0667-4c08-8643-261578924b52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5f9514f34524c8092982e274624390e', 'request_id': 'req-6b8d3f25-0667-4c08-8643-261578924b52'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:22.684904 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-6b8d3f25-0667-4c08-8643-261578924b52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5f9514f34524c8092982e274624390e', 'request_id': 'req-6b8d3f25-0667-4c08-8643-261578924b52'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:22.692220 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-6b8d3f25-0667-4c08-8643-261578924b52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5f9514f34524c8092982e274624390e', 'request_id': 'req-6b8d3f25-0667-4c08-8643-261578924b52'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:22.714078 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-6b8d3f25-0667-4c08-8643-261578924b52 admin admin] The token cache is being invalidate because project b5f9514f34524c8092982e274624390e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:24:22.714635 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-6b8d3f25-0667-4c08-8643-261578924b52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:22.715757 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-6b8d3f25-0667-4c08-8643-261578924b52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:22.718465 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1118/2250] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:24:22 2022] DELETE /identity/v3/projects/b5f9514f34524c8092982e274624390e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:24:22.725900 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007c1ea-e8a8-4d8f-b8d4-8e613d4ee061 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:22.726275 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007c1ea-e8a8-4d8f-b8d4-8e613d4ee061 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:22.726697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007c1ea-e8a8-4d8f-b8d4-8e613d4ee061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:22.760219 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-7007c1ea-e8a8-4d8f-b8d4-8e613d4ee061 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:24:22.762225 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7007c1ea-e8a8-4d8f-b8d4-8e613d4ee061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:22.874119 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1133/2251] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:24:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:24:22.876901 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fdabe6-ae2f-484d-83f8-4898d8b189db None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:22.877447 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fdabe6-ae2f-484d-83f8-4898d8b189db None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:22.877943 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fdabe6-ae2f-484d-83f8-4898d8b189db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:22.910002 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-33fdabe6-ae2f-484d-83f8-4898d8b189db None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:24:22.911565 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-33fdabe6-ae2f-484d-83f8-4898d8b189db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:22.920907 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1119/2252] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:24:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:24:22.925676 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007c1ea-e8a8-4d8f-b8d4-8e613d4ee061 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:22.937099 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007c1ea-e8a8-4d8f-b8d4-8e613d4ee061 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:22.942353 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c0b99-01e2-4fad-8409-983eaf93a07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:22.943174 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c0b99-01e2-4fad-8409-983eaf93a07a admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:22.943451 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c0b99-01e2-4fad-8409-983eaf93a07a admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:22.943722 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c0b99-01e2-4fad-8409-983eaf93a07a admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:22.944720 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c0b99-01e2-4fad-8409-983eaf93a07a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:24:22.944905 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c0b99-01e2-4fad-8409-983eaf93a07a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:22.946571 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c0b99-01e2-4fad-8409-983eaf93a07a admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:22.962175 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1134/2253] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:24:22.968889 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fdabe6-ae2f-484d-83f8-4898d8b189db None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:22.981306 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fdabe6-ae2f-484d-83f8-4898d8b189db None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:22.988104 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16da4d-4650-4d8f-a189-5b85d98ac681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:22.988835 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16da4d-4650-4d8f-a189-5b85d98ac681 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:22.989215 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16da4d-4650-4d8f-a189-5b85d98ac681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:22.989571 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16da4d-4650-4d8f-a189-5b85d98ac681 admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:22.990610 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e16da4d-4650-4d8f-a189-5b85d98ac681 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:22.994672 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e16da4d-4650-4d8f-a189-5b85d98ac681 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:23.041350 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1120/2254] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:24:22 2022] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:24:23.043257 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c0b99-01e2-4fad-8409-983eaf93a07a admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:23.057944 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c0b99-01e2-4fad-8409-983eaf93a07a admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:23.064133 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:24:23.173690 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79869fa-e906-48cd-bd78-ea78565195c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:23.174511 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79869fa-e906-48cd-bd78-ea78565195c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:23.174892 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79869fa-e906-48cd-bd78-ea78565195c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:23.175167 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79869fa-e906-48cd-bd78-ea78565195c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:23.175970 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79869fa-e906-48cd-bd78-ea78565195c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:23.178001 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79869fa-e906-48cd-bd78-ea78565195c1 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:23.203331 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1135/2255] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:24:23 2022] POST /identity/v3/users => generated 292 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:24:23.207486 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16da4d-4650-4d8f-a189-5b85d98ac681 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:23.222807 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16da4d-4650-4d8f-a189-5b85d98ac681 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:23.229720 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2e77c-e9cd-421d-95e1-f8716906b844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:23.231306 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2e77c-e9cd-421d-95e1-f8716906b844 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:23.231306 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2e77c-e9cd-421d-95e1-f8716906b844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:23.231665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2e77c-e9cd-421d-95e1-f8716906b844 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:23.232505 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2e77c-e9cd-421d-95e1-f8716906b844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:23.234429 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2e77c-e9cd-421d-95e1-f8716906b844 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:23.249124 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1121/2256] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:24:23.253821 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79869fa-e906-48cd-bd78-ea78565195c1 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:23.267441 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79869fa-e906-48cd-bd78-ea78565195c1 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:23.273135 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237dea4-5f5a-4b0f-b342-8ce9cdb2751b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:23.273787 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237dea4-5f5a-4b0f-b342-8ce9cdb2751b admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:23.274087 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237dea4-5f5a-4b0f-b342-8ce9cdb2751b admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:23.274342 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237dea4-5f5a-4b0f-b342-8ce9cdb2751b admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:23.275049 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0237dea4-5f5a-4b0f-b342-8ce9cdb2751b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:23.276708 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0237dea4-5f5a-4b0f-b342-8ce9cdb2751b admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:23.292303 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1136/2257] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:24:23.298323 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2e77c-e9cd-421d-95e1-f8716906b844 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:23.311289 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2e77c-e9cd-421d-95e1-f8716906b844 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:23.316504 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee456d-2831-4eab-a16d-c24fbe126ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:23.317334 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee456d-2831-4eab-a16d-c24fbe126ba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:23.317757 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee456d-2831-4eab-a16d-c24fbe126ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:23.318171 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee456d-2831-4eab-a16d-c24fbe126ba4 admin admin] PATH_INFO: `/v3/projects/44162da7af20419f9accc5a84c3f6fac/users/9983c33c17a04d7eaf7614917390043f/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:23.337276 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee456d-2831-4eab-a16d-c24fbe126ba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44162da7af20419f9accc5a84c3f6fac, user_id=9983c33c17a04d7eaf7614917390043f, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:23.340425 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee456d-2831-4eab-a16d-c24fbe126ba4 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:23.359556 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1122/2258] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:24:23 2022] PUT /identity/v3/projects/44162da7af20419f9accc5a84c3f6fac/users/9983c33c17a04d7eaf7614917390043f/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:24:23.432322 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d806f-d143-4208-95bc-eb6e710d8bfe None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:23.432592 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d806f-d143-4208-95bc-eb6e710d8bfe None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:23.432750 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d806f-d143-4208-95bc-eb6e710d8bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:23.467448 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-798d806f-d143-4208-95bc-eb6e710d8bfe None None] MFA Rules not processed for user `9983c33c17a04d7eaf7614917390043f`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:24:23.468695 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-798d806f-d143-4208-95bc-eb6e710d8bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:23.545185 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1137/2259] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:24:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:24:23.551548 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee456d-2831-4eab-a16d-c24fbe126ba4 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:23.619884 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:24:23.628003 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee456d-2831-4eab-a16d-c24fbe126ba4 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:23.635793 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400b60c7-0ab9-496d-87b7-bd7cb56a51ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:23.636417 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b60c7-0ab9-496d-87b7-bd7cb56a51ae admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:23.636690 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b60c7-0ab9-496d-87b7-bd7cb56a51ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:23.636955 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b60c7-0ab9-496d-87b7-bd7cb56a51ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:23.637606 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400b60c7-0ab9-496d-87b7-bd7cb56a51ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:23.639670 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400b60c7-0ab9-496d-87b7-bd7cb56a51ae admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:23.671884 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1123/2260] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:24:23 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:24:23.676312 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d806f-d143-4208-95bc-eb6e710d8bfe None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:23.688966 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d806f-d143-4208-95bc-eb6e710d8bfe None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:23.754614 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac6c7c-ffec-467f-9661-5e913fcb8538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:23.755578 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac6c7c-ffec-467f-9661-5e913fcb8538 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:23.755955 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac6c7c-ffec-467f-9661-5e913fcb8538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:23.756375 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac6c7c-ffec-467f-9661-5e913fcb8538 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:23.757859 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac6c7c-ffec-467f-9661-5e913fcb8538 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:23.760230 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac6c7c-ffec-467f-9661-5e913fcb8538 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:23.787407 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1138/2261] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:24:23 2022] POST /identity/v3/users => generated 299 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:24:23.791639 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400b60c7-0ab9-496d-87b7-bd7cb56a51ae admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:23.802718 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400b60c7-0ab9-496d-87b7-bd7cb56a51ae admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:23.807762 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305dd98-4d50-4fed-8fdc-1953782cfd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:23.808418 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305dd98-4d50-4fed-8fdc-1953782cfd3c admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:23.808692 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305dd98-4d50-4fed-8fdc-1953782cfd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:23.808960 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305dd98-4d50-4fed-8fdc-1953782cfd3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:23.809643 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305dd98-4d50-4fed-8fdc-1953782cfd3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:23.811339 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305dd98-4d50-4fed-8fdc-1953782cfd3c admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:23.823994 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1124/2262] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:24:23.828458 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac6c7c-ffec-467f-9661-5e913fcb8538 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:23.836134 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:24:23.840559 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac6c7c-ffec-467f-9661-5e913fcb8538 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:23.847314 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca96d4b-e629-4df3-adc4-77dab8134b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:23.848220 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca96d4b-e629-4df3-adc4-77dab8134b0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:23.848535 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca96d4b-e629-4df3-adc4-77dab8134b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:23.848864 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca96d4b-e629-4df3-adc4-77dab8134b0d admin admin] PATH_INFO: `/v3/projects/fd181ebb457d42478adb4b5fd50f92d8/users/4d5c3d60a0d04968a97b642497f46418/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:23.867771 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca96d4b-e629-4df3-adc4-77dab8134b0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd181ebb457d42478adb4b5fd50f92d8, user_id=4d5c3d60a0d04968a97b642497f46418, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:23.870485 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca96d4b-e629-4df3-adc4-77dab8134b0d admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:23.886762 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1139/2263] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:24:23 2022] PUT /identity/v3/projects/fd181ebb457d42478adb4b5fd50f92d8/users/4d5c3d60a0d04968a97b642497f46418/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:24:23.891061 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305dd98-4d50-4fed-8fdc-1953782cfd3c admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:23.905873 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305dd98-4d50-4fed-8fdc-1953782cfd3c admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:23.978849 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332bb925-5940-48f9-a836-d76950af475c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:23.979897 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bb925-5940-48f9-a836-d76950af475c admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:23.979897 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bb925-5940-48f9-a836-d76950af475c admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:23.979897 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bb925-5940-48f9-a836-d76950af475c admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:23.980518 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332bb925-5940-48f9-a836-d76950af475c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:23.982192 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332bb925-5940-48f9-a836-d76950af475c admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:23.998440 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1125/2264] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:24:24.002014 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca96d4b-e629-4df3-adc4-77dab8134b0d admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:24.020618 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca96d4b-e629-4df3-adc4-77dab8134b0d admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:24.028644 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d7be0-b486-4c9f-a74c-522b52807c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:24.029775 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d7be0-b486-4c9f-a74c-522b52807c7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:24.030262 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d7be0-b486-4c9f-a74c-522b52807c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:24.030775 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d7be0-b486-4c9f-a74c-522b52807c7c admin admin] PATH_INFO: `/v3/projects/fd181ebb457d42478adb4b5fd50f92d8/users/4d5c3d60a0d04968a97b642497f46418/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:24.034236 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d7be0-b486-4c9f-a74c-522b52807c7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd181ebb457d42478adb4b5fd50f92d8, user_id=4d5c3d60a0d04968a97b642497f46418, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:24.040096 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d7be0-b486-4c9f-a74c-522b52807c7c admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:24.060087 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1140/2265] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:24:24 2022] PUT /identity/v3/projects/fd181ebb457d42478adb4b5fd50f92d8/users/4d5c3d60a0d04968a97b642497f46418/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:24:24.076860 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab0024-b6f3-4360-8df9-5a9a782820ec None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:24.077269 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab0024-b6f3-4360-8df9-5a9a782820ec None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:24.077610 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab0024-b6f3-4360-8df9-5a9a782820ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:24.109273 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-73ab0024-b6f3-4360-8df9-5a9a782820ec None None] MFA Rules not processed for user `4d5c3d60a0d04968a97b642497f46418`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:24:24.110705 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-73ab0024-b6f3-4360-8df9-5a9a782820ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:24.200218 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1126/2266] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:24:24 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:24:24.212378 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d7be0-b486-4c9f-a74c-522b52807c7c admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:24.214137 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ce2d7be0-b486-4c9f-a74c-522b52807c7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:24.285345 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d7be0-b486-4c9f-a74c-522b52807c7c admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:24.294272 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c864bca-5a12-43c6-8688-6a4e29db545c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:24.295162 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c864bca-5a12-43c6-8688-6a4e29db545c service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:24.295539 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c864bca-5a12-43c6-8688-6a4e29db545c service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:24.296035 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c864bca-5a12-43c6-8688-6a4e29db545c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:24.386176 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c864bca-5a12-43c6-8688-6a4e29db545c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:24.387878 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c864bca-5a12-43c6-8688-6a4e29db545c service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:24.399093 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1141/2267] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:24:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:24:25.413191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab0024-b6f3-4360-8df9-5a9a782820ec None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:25.414802 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-73ab0024-b6f3-4360-8df9-5a9a782820ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:25.509712 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:24:25.539313 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab0024-b6f3-4360-8df9-5a9a782820ec None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:25.547111 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c7d83-a573-41e7-a106-15ad2bbdc6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:25.547819 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c7d83-a573-41e7-a106-15ad2bbdc6cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:25.548144 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c7d83-a573-41e7-a106-15ad2bbdc6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:25.548483 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c7d83-a573-41e7-a106-15ad2bbdc6cb admin admin] PATH_INFO: `/v3/users/3d402d25606246e09b3e1310e96206b7` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:25.549776 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c7d83-a573-41e7-a106-15ad2bbdc6cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d402d25606246e09b3e1310e96206b7)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:25.551837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c7d83-a573-41e7-a106-15ad2bbdc6cb admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:25.624133 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-484c7d83-a573-41e7-a106-15ad2bbdc6cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d402d25606246e09b3e1310e96206b7'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:25.642154 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-484c7d83-a573-41e7-a106-15ad2bbdc6cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d402d25606246e09b3e1310e96206b7'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:25.655673 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-484c7d83-a573-41e7-a106-15ad2bbdc6cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d402d25606246e09b3e1310e96206b7'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:25.656331 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-484c7d83-a573-41e7-a106-15ad2bbdc6cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d402d25606246e09b3e1310e96206b7'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:25.665495 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-484c7d83-a573-41e7-a106-15ad2bbdc6cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d402d25606246e09b3e1310e96206b7'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:25.672711 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1127/2268] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:24:25 2022] DELETE /identity/v3/users/3d402d25606246e09b3e1310e96206b7 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:24:25.677676 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614e091-b039-4be1-a61d-6a9afa77ee2f None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:25.678253 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614e091-b039-4be1-a61d-6a9afa77ee2f None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:25.678936 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614e091-b039-4be1-a61d-6a9afa77ee2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:25.703324 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-d614e091-b039-4be1-a61d-6a9afa77ee2f None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:24:25.704803 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d614e091-b039-4be1-a61d-6a9afa77ee2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:25.772124 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1142/2269] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:24:25.784827 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c7d83-a573-41e7-a106-15ad2bbdc6cb admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:25.787189 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-484c7d83-a573-41e7-a106-15ad2bbdc6cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:25.869695 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c7d83-a573-41e7-a106-15ad2bbdc6cb admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:25.876542 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683ae9e-3df3-4bb8-96fa-57a48ef7d47b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:25.877702 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683ae9e-3df3-4bb8-96fa-57a48ef7d47b service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:25.878287 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683ae9e-3df3-4bb8-96fa-57a48ef7d47b service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:25.878865 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683ae9e-3df3-4bb8-96fa-57a48ef7d47b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:25.898245 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1683ae9e-3df3-4bb8-96fa-57a48ef7d47b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:25.901280 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1683ae9e-3df3-4bb8-96fa-57a48ef7d47b service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:25.919351 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1128/2270] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:24:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:24:26.382968 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614e091-b039-4be1-a61d-6a9afa77ee2f None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:26.386713 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d614e091-b039-4be1-a61d-6a9afa77ee2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:26.403225 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614e091-b039-4be1-a61d-6a9afa77ee2f None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:26.409309 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c4197-41ca-42f0-aa9a-4b939f1dcd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:26.410240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c4197-41ca-42f0-aa9a-4b939f1dcd39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:26.410711 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c4197-41ca-42f0-aa9a-4b939f1dcd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:26.411101 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c4197-41ca-42f0-aa9a-4b939f1dcd39 admin admin] PATH_INFO: `/v3/projects/35c6f6cfbfe9415c95f81654d4e76568` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:26.412915 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8c4197-41ca-42f0-aa9a-4b939f1dcd39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35c6f6cfbfe9415c95f81654d4e76568)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:26.416258 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8c4197-41ca-42f0-aa9a-4b939f1dcd39 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:26.442292 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:24:26.494433 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-8b8c4197-41ca-42f0-aa9a-4b939f1dcd39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35c6f6cfbfe9415c95f81654d4e76568', 'request_id': 'req-8b8c4197-41ca-42f0-aa9a-4b939f1dcd39'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:26.509092 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-8b8c4197-41ca-42f0-aa9a-4b939f1dcd39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35c6f6cfbfe9415c95f81654d4e76568', 'request_id': 'req-8b8c4197-41ca-42f0-aa9a-4b939f1dcd39'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:26.523272 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-8b8c4197-41ca-42f0-aa9a-4b939f1dcd39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35c6f6cfbfe9415c95f81654d4e76568', 'request_id': 'req-8b8c4197-41ca-42f0-aa9a-4b939f1dcd39'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:26.552375 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-8b8c4197-41ca-42f0-aa9a-4b939f1dcd39 admin admin] The token cache is being invalidate because project 35c6f6cfbfe9415c95f81654d4e76568 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:24:26.559687 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-8b8c4197-41ca-42f0-aa9a-4b939f1dcd39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:26.562514 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-8b8c4197-41ca-42f0-aa9a-4b939f1dcd39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:26.564624 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1143/2271] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:24:26 2022] DELETE /identity/v3/projects/35c6f6cfbfe9415c95f81654d4e76568 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:24:29.139186 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683ae9e-3df3-4bb8-96fa-57a48ef7d47b service neutron] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:29.141134 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-1683ae9e-3df3-4bb8-96fa-57a48ef7d47b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:29.207134 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683ae9e-3df3-4bb8-96fa-57a48ef7d47b service neutron] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:29.238878 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:24:29.274057 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d68b12-43e5-4351-a3ad-58162583266d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:29.274622 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d68b12-43e5-4351-a3ad-58162583266d service cinder] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:29.274893 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d68b12-43e5-4351-a3ad-58162583266d service cinder] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:29.275178 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d68b12-43e5-4351-a3ad-58162583266d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:29.277140 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-81d68b12-43e5-4351-a3ad-58162583266d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:29.349661 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d68b12-43e5-4351-a3ad-58162583266d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:29.351873 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d68b12-43e5-4351-a3ad-58162583266d service cinder] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:29.363715 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1129/2272] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:24:29 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:24:34.486698 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c4197-41ca-42f0-aa9a-4b939f1dcd39 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:34.488349 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-8b8c4197-41ca-42f0-aa9a-4b939f1dcd39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:34.565229 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c4197-41ca-42f0-aa9a-4b939f1dcd39 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:34.571762 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f4102-ee11-4001-945c-567e2c24491f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:34.572518 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f4102-ee11-4001-945c-567e2c24491f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:34.572858 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f4102-ee11-4001-945c-567e2c24491f admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:34.573221 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f4102-ee11-4001-945c-567e2c24491f admin admin] PATH_INFO: `/v3/users/9983c33c17a04d7eaf7614917390043f` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:34.575142 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f4102-ee11-4001-945c-567e2c24491f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9983c33c17a04d7eaf7614917390043f)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:34.578503 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f4102-ee11-4001-945c-567e2c24491f admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:34.640630 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-9a3f4102-ee11-4001-945c-567e2c24491f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9983c33c17a04d7eaf7614917390043f'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:34.650114 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-9a3f4102-ee11-4001-945c-567e2c24491f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9983c33c17a04d7eaf7614917390043f'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:34.665251 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-9a3f4102-ee11-4001-945c-567e2c24491f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9983c33c17a04d7eaf7614917390043f'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:34.666019 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-9a3f4102-ee11-4001-945c-567e2c24491f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9983c33c17a04d7eaf7614917390043f'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:34.674859 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-9a3f4102-ee11-4001-945c-567e2c24491f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9983c33c17a04d7eaf7614917390043f'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:34.682433 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1144/2273] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:24:34 2022] DELETE /identity/v3/users/9983c33c17a04d7eaf7614917390043f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:24:34.688670 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd4ed8-ed81-44b4-a648-e84fb4ad2d68 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:34.689494 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd4ed8-ed81-44b4-a648-e84fb4ad2d68 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:34.689494 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd4ed8-ed81-44b4-a648-e84fb4ad2d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:34.710584 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-e0dd4ed8-ed81-44b4-a648-e84fb4ad2d68 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:24:34.712007 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-e0dd4ed8-ed81-44b4-a648-e84fb4ad2d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:34.783019 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1130/2274] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:24:34.794525 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f4102-ee11-4001-945c-567e2c24491f admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:34.796177 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-9a3f4102-ee11-4001-945c-567e2c24491f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:34.833775 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:24:34.874200 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f4102-ee11-4001-945c-567e2c24491f admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:34.878519 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc5711-1aab-40c5-8d03-4c4bc1de98d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:34.879165 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc5711-1aab-40c5-8d03-4c4bc1de98d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:34.879449 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc5711-1aab-40c5-8d03-4c4bc1de98d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:34.879726 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc5711-1aab-40c5-8d03-4c4bc1de98d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:34.890597 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cc5711-1aab-40c5-8d03-4c4bc1de98d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:34.892082 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cc5711-1aab-40c5-8d03-4c4bc1de98d9 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:34.904571 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1145/2275] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:24:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:24:35.240365 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd4ed8-ed81-44b4-a648-e84fb4ad2d68 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:35.241999 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-e0dd4ed8-ed81-44b4-a648-e84fb4ad2d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:35.268896 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd4ed8-ed81-44b4-a648-e84fb4ad2d68 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:35.277428 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af368207-443a-469b-af89-b7365ad97f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:35.278177 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af368207-443a-469b-af89-b7365ad97f4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:35.278551 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af368207-443a-469b-af89-b7365ad97f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:35.278860 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af368207-443a-469b-af89-b7365ad97f4d admin admin] PATH_INFO: `/v3/projects/44162da7af20419f9accc5a84c3f6fac` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:35.280494 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af368207-443a-469b-af89-b7365ad97f4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=44162da7af20419f9accc5a84c3f6fac)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:35.282552 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af368207-443a-469b-af89-b7365ad97f4d admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:35.342726 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-af368207-443a-469b-af89-b7365ad97f4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44162da7af20419f9accc5a84c3f6fac', 'request_id': 'req-af368207-443a-469b-af89-b7365ad97f4d'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:35.352938 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-af368207-443a-469b-af89-b7365ad97f4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44162da7af20419f9accc5a84c3f6fac', 'request_id': 'req-af368207-443a-469b-af89-b7365ad97f4d'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:35.360902 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-af368207-443a-469b-af89-b7365ad97f4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44162da7af20419f9accc5a84c3f6fac', 'request_id': 'req-af368207-443a-469b-af89-b7365ad97f4d'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:35.375141 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-af368207-443a-469b-af89-b7365ad97f4d admin admin] The token cache is being invalidate because project 44162da7af20419f9accc5a84c3f6fac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:24:35.375455 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-af368207-443a-469b-af89-b7365ad97f4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:35.376125 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-af368207-443a-469b-af89-b7365ad97f4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:35.377688 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1131/2276] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:24:35 2022] DELETE /identity/v3/projects/44162da7af20419f9accc5a84c3f6fac => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:24:35.382227 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc5711-1aab-40c5-8d03-4c4bc1de98d9 service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:35.392920 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc5711-1aab-40c5-8d03-4c4bc1de98d9 service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:35.464105 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385124fa-293a-4785-bdf7-514d7d11ac8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:35.464820 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385124fa-293a-4785-bdf7-514d7d11ac8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:35.465192 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385124fa-293a-4785-bdf7-514d7d11ac8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:35.465547 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385124fa-293a-4785-bdf7-514d7d11ac8a admin admin] PATH_INFO: `/v3/users/4d5c3d60a0d04968a97b642497f46418` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:35.466999 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385124fa-293a-4785-bdf7-514d7d11ac8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d5c3d60a0d04968a97b642497f46418)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:35.469085 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385124fa-293a-4785-bdf7-514d7d11ac8a admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:35.527730 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-385124fa-293a-4785-bdf7-514d7d11ac8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d5c3d60a0d04968a97b642497f46418'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:35.537249 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-385124fa-293a-4785-bdf7-514d7d11ac8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d5c3d60a0d04968a97b642497f46418'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:35.553997 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-385124fa-293a-4785-bdf7-514d7d11ac8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d5c3d60a0d04968a97b642497f46418'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:35.554978 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-385124fa-293a-4785-bdf7-514d7d11ac8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d5c3d60a0d04968a97b642497f46418'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:35.565311 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-385124fa-293a-4785-bdf7-514d7d11ac8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d5c3d60a0d04968a97b642497f46418'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:35.573421 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1146/2277] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:24:35 2022] DELETE /identity/v3/users/4d5c3d60a0d04968a97b642497f46418 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:24:35.912830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af368207-443a-469b-af89-b7365ad97f4d admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:35.915073 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-af368207-443a-469b-af89-b7365ad97f4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:35.924965 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:24:35.936181 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af368207-443a-469b-af89-b7365ad97f4d admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:36.056102 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834f4d4-cd63-498b-9cf8-a01c3fe5e4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:36.057238 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834f4d4-cd63-498b-9cf8-a01c3fe5e4fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:36.057738 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834f4d4-cd63-498b-9cf8-a01c3fe5e4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:36.058224 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834f4d4-cd63-498b-9cf8-a01c3fe5e4fb admin admin] PATH_INFO: `/v3/projects/fd181ebb457d42478adb4b5fd50f92d8` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:36.060566 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834f4d4-cd63-498b-9cf8-a01c3fe5e4fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd181ebb457d42478adb4b5fd50f92d8)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:36.064269 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834f4d4-cd63-498b-9cf8-a01c3fe5e4fb admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:36.142845 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-5834f4d4-cd63-498b-9cf8-a01c3fe5e4fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd181ebb457d42478adb4b5fd50f92d8', 'request_id': 'req-5834f4d4-cd63-498b-9cf8-a01c3fe5e4fb'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:36.153653 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-5834f4d4-cd63-498b-9cf8-a01c3fe5e4fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd181ebb457d42478adb4b5fd50f92d8', 'request_id': 'req-5834f4d4-cd63-498b-9cf8-a01c3fe5e4fb'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:36.161393 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-5834f4d4-cd63-498b-9cf8-a01c3fe5e4fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd181ebb457d42478adb4b5fd50f92d8', 'request_id': 'req-5834f4d4-cd63-498b-9cf8-a01c3fe5e4fb'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:36.176464 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-5834f4d4-cd63-498b-9cf8-a01c3fe5e4fb admin admin] The token cache is being invalidate because project fd181ebb457d42478adb4b5fd50f92d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:24:36.176944 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-5834f4d4-cd63-498b-9cf8-a01c3fe5e4fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:36.178122 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-5834f4d4-cd63-498b-9cf8-a01c3fe5e4fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:36.181992 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1132/2278] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:24:35 2022] DELETE /identity/v3/projects/fd181ebb457d42478adb4b5fd50f92d8 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:24:36.189227 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c765cc-1030-4e42-b154-85b5adfc535f None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:36.189725 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c765cc-1030-4e42-b154-85b5adfc535f None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:36.190222 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c765cc-1030-4e42-b154-85b5adfc535f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:36.223171 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-78c765cc-1030-4e42-b154-85b5adfc535f None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:24:36.224458 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-78c765cc-1030-4e42-b154-85b5adfc535f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:36.275244 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:24:36.317952 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1147/2279] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:24:36.321866 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597133b-4900-4228-b9a5-fa272389ec29 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:36.322212 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597133b-4900-4228-b9a5-fa272389ec29 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:36.322881 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597133b-4900-4228-b9a5-fa272389ec29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:36.358325 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-d597133b-4900-4228-b9a5-fa272389ec29 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:24:36.360146 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-d597133b-4900-4228-b9a5-fa272389ec29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:36.370075 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1133/2280] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:24:36.375561 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c765cc-1030-4e42-b154-85b5adfc535f None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:36.392202 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c765cc-1030-4e42-b154-85b5adfc535f None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:36.399809 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5223d8f-5090-4b00-9f14-b9b141c196db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:36.401206 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5223d8f-5090-4b00-9f14-b9b141c196db admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:36.401558 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5223d8f-5090-4b00-9f14-b9b141c196db admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:36.401903 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5223d8f-5090-4b00-9f14-b9b141c196db admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:36.402691 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5223d8f-5090-4b00-9f14-b9b141c196db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:24:36.403093 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5223d8f-5090-4b00-9f14-b9b141c196db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:36.404836 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5223d8f-5090-4b00-9f14-b9b141c196db admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:36.420098 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1148/2281] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:24:36.425564 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d597133b-4900-4228-b9a5-fa272389ec29 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:36.437147 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d597133b-4900-4228-b9a5-fa272389ec29 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:36.442129 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271d279-46c6-4bd8-8730-229ebe9bf1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:36.442783 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271d279-46c6-4bd8-8730-229ebe9bf1b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:36.443073 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271d279-46c6-4bd8-8730-229ebe9bf1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:36.443339 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271d279-46c6-4bd8-8730-229ebe9bf1b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:36.443986 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5271d279-46c6-4bd8-8730-229ebe9bf1b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:36.446153 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5271d279-46c6-4bd8-8730-229ebe9bf1b5 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:36.478393 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1134/2282] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:24:36 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:24:36.483446 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5223d8f-5090-4b00-9f14-b9b141c196db admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:36.499783 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5223d8f-5090-4b00-9f14-b9b141c196db admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:36.603285 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25488e-3e2d-4b0a-a9a6-b012dfb389ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:36.604303 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25488e-3e2d-4b0a-a9a6-b012dfb389ad admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:36.604750 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25488e-3e2d-4b0a-a9a6-b012dfb389ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:36.605142 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c25488e-3e2d-4b0a-a9a6-b012dfb389ad admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:36.605973 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c25488e-3e2d-4b0a-a9a6-b012dfb389ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:36.608352 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c25488e-3e2d-4b0a-a9a6-b012dfb389ad admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:36.643771 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1149/2283] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:24:36 2022] POST /identity/v3/users => generated 287 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:24:36.648332 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271d279-46c6-4bd8-8730-229ebe9bf1b5 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:36.661606 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271d279-46c6-4bd8-8730-229ebe9bf1b5 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:36.678570 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d3032-50ec-4567-9076-4357461fb944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:36.679860 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d3032-50ec-4567-9076-4357461fb944 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:36.680245 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d3032-50ec-4567-9076-4357461fb944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:36.680656 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d3032-50ec-4567-9076-4357461fb944 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:36.681364 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d3032-50ec-4567-9076-4357461fb944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:36.683452 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d3032-50ec-4567-9076-4357461fb944 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:36.702111 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1135/2284] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:24:36.705099 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25488e-3e2d-4b0a-a9a6-b012dfb389ad admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:36.724570 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c25488e-3e2d-4b0a-a9a6-b012dfb389ad admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:36.733448 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f239b-7506-4d98-9e85-c9ad1915e0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:36.734208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f239b-7506-4d98-9e85-c9ad1915e0cb admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:36.734870 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f239b-7506-4d98-9e85-c9ad1915e0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:36.735426 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f239b-7506-4d98-9e85-c9ad1915e0cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:36.736232 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f239b-7506-4d98-9e85-c9ad1915e0cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:36.738137 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f239b-7506-4d98-9e85-c9ad1915e0cb admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:36.759028 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1150/2285] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:24:36.761130 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d3032-50ec-4567-9076-4357461fb944 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:36.779445 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d3032-50ec-4567-9076-4357461fb944 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:36.788473 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269dd277-ebb7-47e5-a7d8-6a54db30439c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:36.789702 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dd277-ebb7-47e5-a7d8-6a54db30439c admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:36.790221 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dd277-ebb7-47e5-a7d8-6a54db30439c admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:36.790775 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dd277-ebb7-47e5-a7d8-6a54db30439c admin admin] PATH_INFO: `/v3/projects/1190f8fae67b4a3ea207f37dee0cadba/users/bfe6e982e0d84f04b32ae473077da642/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:36.815507 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269dd277-ebb7-47e5-a7d8-6a54db30439c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1190f8fae67b4a3ea207f37dee0cadba, user_id=bfe6e982e0d84f04b32ae473077da642, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:36.818720 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269dd277-ebb7-47e5-a7d8-6a54db30439c admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:36.839175 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1136/2286] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:24:36 2022] PUT /identity/v3/projects/1190f8fae67b4a3ea207f37dee0cadba/users/bfe6e982e0d84f04b32ae473077da642/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:24:36.854586 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2efbc4-198e-4dc0-9890-d3446349d383 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:36.854891 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2efbc4-198e-4dc0-9890-d3446349d383 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:36.855357 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2efbc4-198e-4dc0-9890-d3446349d383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:36.891411 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-ed2efbc4-198e-4dc0-9890-d3446349d383 None None] MFA Rules not processed for user `bfe6e982e0d84f04b32ae473077da642`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:24:36.892665 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ed2efbc4-198e-4dc0-9890-d3446349d383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:36.971105 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1151/2287] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:24:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:24:36.976048 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269dd277-ebb7-47e5-a7d8-6a54db30439c admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:37.014266 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:24:37.074751 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269dd277-ebb7-47e5-a7d8-6a54db30439c admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:37.084484 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc9f074-d0bb-42b7-9368-2eb145b4c2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:37.085675 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9f074-d0bb-42b7-9368-2eb145b4c2a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:37.086238 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9f074-d0bb-42b7-9368-2eb145b4c2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:37.086759 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9f074-d0bb-42b7-9368-2eb145b4c2a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:37.088489 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc9f074-d0bb-42b7-9368-2eb145b4c2a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:37.093511 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc9f074-d0bb-42b7-9368-2eb145b4c2a2 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:37.149327 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1137/2288] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:24:36 2022] POST /identity/v3/projects => generated 375 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:24:37.151228 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2efbc4-198e-4dc0-9890-d3446349d383 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:37.164618 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2efbc4-198e-4dc0-9890-d3446349d383 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:37.211523 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:24:37.233565 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25588d49-14e0-43cd-a244-ec442ef0c56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:37.234095 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25588d49-14e0-43cd-a244-ec442ef0c56f admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:37.234394 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25588d49-14e0-43cd-a244-ec442ef0c56f admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:37.234671 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25588d49-14e0-43cd-a244-ec442ef0c56f admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:37.235325 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25588d49-14e0-43cd-a244-ec442ef0c56f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:37.237266 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25588d49-14e0-43cd-a244-ec442ef0c56f admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:37.262934 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1152/2289] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:24:37 2022] POST /identity/v3/users => generated 294 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:24:37.268420 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc9f074-d0bb-42b7-9368-2eb145b4c2a2 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:37.282835 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc9f074-d0bb-42b7-9368-2eb145b4c2a2 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:37.289742 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06cce1-5c38-4b10-8976-97c2bd994554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:37.291125 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06cce1-5c38-4b10-8976-97c2bd994554 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:37.291693 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06cce1-5c38-4b10-8976-97c2bd994554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:37.292114 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06cce1-5c38-4b10-8976-97c2bd994554 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:37.293051 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e06cce1-5c38-4b10-8976-97c2bd994554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:37.295017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e06cce1-5c38-4b10-8976-97c2bd994554 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:37.308254 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1138/2290] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:24:37.313424 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25588d49-14e0-43cd-a244-ec442ef0c56f admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:37.327396 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25588d49-14e0-43cd-a244-ec442ef0c56f admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:37.332967 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd5e3d-0703-4962-a096-b737fb23c15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:37.333857 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd5e3d-0703-4962-a096-b737fb23c15f admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:37.334269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd5e3d-0703-4962-a096-b737fb23c15f admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:37.334627 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd5e3d-0703-4962-a096-b737fb23c15f admin admin] PATH_INFO: `/v3/projects/cc2c9e7194ce4970a69cd4cf97de495d/users/1836ab35e8384469a33f640c9c1f3bba/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:37.359334 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd5e3d-0703-4962-a096-b737fb23c15f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc2c9e7194ce4970a69cd4cf97de495d, user_id=1836ab35e8384469a33f640c9c1f3bba, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:37.363551 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd5e3d-0703-4962-a096-b737fb23c15f admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:37.380830 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1153/2291] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:24:37 2022] PUT /identity/v3/projects/cc2c9e7194ce4970a69cd4cf97de495d/users/1836ab35e8384469a33f640c9c1f3bba/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:24:37.385722 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06cce1-5c38-4b10-8976-97c2bd994554 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:37.397568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06cce1-5c38-4b10-8976-97c2bd994554 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:37.469668 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70624d70-2ec5-4cf5-aa8e-3fe3c0bee4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:37.470295 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70624d70-2ec5-4cf5-aa8e-3fe3c0bee4fc admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:37.470623 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70624d70-2ec5-4cf5-aa8e-3fe3c0bee4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:37.470894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70624d70-2ec5-4cf5-aa8e-3fe3c0bee4fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:37.471563 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70624d70-2ec5-4cf5-aa8e-3fe3c0bee4fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:37.473222 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70624d70-2ec5-4cf5-aa8e-3fe3c0bee4fc admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:37.486093 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1139/2292] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:24:37.490852 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd5e3d-0703-4962-a096-b737fb23c15f admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:37.505175 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd5e3d-0703-4962-a096-b737fb23c15f admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:37.510222 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b48e6-fabb-4b07-9a26-84f5bff7d68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:37.510994 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b48e6-fabb-4b07-9a26-84f5bff7d68d admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:37.511313 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b48e6-fabb-4b07-9a26-84f5bff7d68d admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:37.511647 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b48e6-fabb-4b07-9a26-84f5bff7d68d admin admin] PATH_INFO: `/v3/projects/cc2c9e7194ce4970a69cd4cf97de495d/users/1836ab35e8384469a33f640c9c1f3bba/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:37.514135 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b48e6-fabb-4b07-9a26-84f5bff7d68d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc2c9e7194ce4970a69cd4cf97de495d, user_id=1836ab35e8384469a33f640c9c1f3bba, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:37.517104 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b48e6-fabb-4b07-9a26-84f5bff7d68d admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:37.530641 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1154/2293] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:24:37 2022] PUT /identity/v3/projects/cc2c9e7194ce4970a69cd4cf97de495d/users/1836ab35e8384469a33f640c9c1f3bba/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:24:37.542912 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fe43f-b0ed-4c4b-9504-dc5fa2f881e5 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:37.543331 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fe43f-b0ed-4c4b-9504-dc5fa2f881e5 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:37.543656 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fe43f-b0ed-4c4b-9504-dc5fa2f881e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:37.584301 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-321fe43f-b0ed-4c4b-9504-dc5fa2f881e5 None None] MFA Rules not processed for user `1836ab35e8384469a33f640c9c1f3bba`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:24:37.585804 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-321fe43f-b0ed-4c4b-9504-dc5fa2f881e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:37.677720 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1140/2294] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:24:37 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:24:37.690693 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b48e6-fabb-4b07-9a26-84f5bff7d68d admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:37.692763 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ff7b48e6-fabb-4b07-9a26-84f5bff7d68d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:37.775000 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b48e6-fabb-4b07-9a26-84f5bff7d68d admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:37.779514 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76c75c-50bf-4812-a953-6215dabdac08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:37.780147 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76c75c-50bf-4812-a953-6215dabdac08 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:37.780430 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76c75c-50bf-4812-a953-6215dabdac08 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:37.780712 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76c75c-50bf-4812-a953-6215dabdac08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:37.866192 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76c75c-50bf-4812-a953-6215dabdac08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:37.867711 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76c75c-50bf-4812-a953-6215dabdac08 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:37.879644 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1155/2295] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:24:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:24:40.596480 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fe43f-b0ed-4c4b-9504-dc5fa2f881e5 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:40.627866 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:24:40.671658 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fe43f-b0ed-4c4b-9504-dc5fa2f881e5 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:40.676523 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2a8c3-4d42-4741-b0c4-cbc2b9fec09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:40.677185 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2a8c3-4d42-4741-b0c4-cbc2b9fec09b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:40.677479 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2a8c3-4d42-4741-b0c4-cbc2b9fec09b admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:40.677756 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2a8c3-4d42-4741-b0c4-cbc2b9fec09b admin admin] PATH_INFO: `/v3/users/bfe6e982e0d84f04b32ae473077da642` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:40.679703 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a2a8c3-4d42-4741-b0c4-cbc2b9fec09b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfe6e982e0d84f04b32ae473077da642)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:40.681685 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a2a8c3-4d42-4741-b0c4-cbc2b9fec09b admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:40.748338 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-42a2a8c3-4d42-4741-b0c4-cbc2b9fec09b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfe6e982e0d84f04b32ae473077da642'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:40.764555 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-42a2a8c3-4d42-4741-b0c4-cbc2b9fec09b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfe6e982e0d84f04b32ae473077da642'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:40.773496 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-42a2a8c3-4d42-4741-b0c4-cbc2b9fec09b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfe6e982e0d84f04b32ae473077da642'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:40.774146 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-42a2a8c3-4d42-4741-b0c4-cbc2b9fec09b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfe6e982e0d84f04b32ae473077da642'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:40.783016 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-42a2a8c3-4d42-4741-b0c4-cbc2b9fec09b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfe6e982e0d84f04b32ae473077da642'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:40.790234 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1141/2296] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:24:40 2022] DELETE /identity/v3/users/bfe6e982e0d84f04b32ae473077da642 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:24:40.795073 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f92e6-6da7-434b-8166-e2cd0bc00e32 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:40.795672 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f92e6-6da7-434b-8166-e2cd0bc00e32 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:40.795672 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f92e6-6da7-434b-8166-e2cd0bc00e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:40.817536 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-3d6f92e6-6da7-434b-8166-e2cd0bc00e32 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:24:40.818852 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-3d6f92e6-6da7-434b-8166-e2cd0bc00e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:40.874181 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:24:40.892110 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1156/2297] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:24:40.903896 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2a8c3-4d42-4741-b0c4-cbc2b9fec09b admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:40.905921 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-42a2a8c3-4d42-4741-b0c4-cbc2b9fec09b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:40.976120 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2a8c3-4d42-4741-b0c4-cbc2b9fec09b admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:40.980086 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d891d7e5-194a-41b9-9d06-72ec2ece6d19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:40.980712 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891d7e5-194a-41b9-9d06-72ec2ece6d19 service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:40.980990 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891d7e5-194a-41b9-9d06-72ec2ece6d19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:40.981260 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891d7e5-194a-41b9-9d06-72ec2ece6d19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:40.992085 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d891d7e5-194a-41b9-9d06-72ec2ece6d19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:40.993574 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d891d7e5-194a-41b9-9d06-72ec2ece6d19 service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:41.004727 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1142/2298] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:24:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:24:41.406172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f92e6-6da7-434b-8166-e2cd0bc00e32 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:41.407246 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-3d6f92e6-6da7-434b-8166-e2cd0bc00e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:41.430640 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f92e6-6da7-434b-8166-e2cd0bc00e32 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:41.439118 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2324b-ca5d-4a91-a538-86c48b4236de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:41.440328 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2324b-ca5d-4a91-a538-86c48b4236de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:41.440652 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2324b-ca5d-4a91-a538-86c48b4236de admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:41.441126 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2324b-ca5d-4a91-a538-86c48b4236de admin admin] PATH_INFO: `/v3/projects/1190f8fae67b4a3ea207f37dee0cadba` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:41.443296 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2324b-ca5d-4a91-a538-86c48b4236de admin admin] RBAC: Authorizing `identity:delete_project(project_id=1190f8fae67b4a3ea207f37dee0cadba)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:41.447854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2324b-ca5d-4a91-a538-86c48b4236de admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:41.514768 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-1ae2324b-ca5d-4a91-a538-86c48b4236de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1190f8fae67b4a3ea207f37dee0cadba', 'request_id': 'req-1ae2324b-ca5d-4a91-a538-86c48b4236de'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:41.524658 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-1ae2324b-ca5d-4a91-a538-86c48b4236de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1190f8fae67b4a3ea207f37dee0cadba', 'request_id': 'req-1ae2324b-ca5d-4a91-a538-86c48b4236de'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:41.532076 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-1ae2324b-ca5d-4a91-a538-86c48b4236de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1190f8fae67b4a3ea207f37dee0cadba', 'request_id': 'req-1ae2324b-ca5d-4a91-a538-86c48b4236de'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:41.545884 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-1ae2324b-ca5d-4a91-a538-86c48b4236de admin admin] The token cache is being invalidate because project 1190f8fae67b4a3ea207f37dee0cadba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:24:41.546227 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-1ae2324b-ca5d-4a91-a538-86c48b4236de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:41.546992 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-1ae2324b-ca5d-4a91-a538-86c48b4236de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:41.548690 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1157/2299] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:24:41 2022] DELETE /identity/v3/projects/1190f8fae67b4a3ea207f37dee0cadba => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:24:41.553207 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d891d7e5-194a-41b9-9d06-72ec2ece6d19 service neutron] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:41.566007 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d891d7e5-194a-41b9-9d06-72ec2ece6d19 service neutron] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:41.620148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:24:41.637094 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560691e6-9dc8-42dc-9f38-2a0ca8184fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:41.637786 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560691e6-9dc8-42dc-9f38-2a0ca8184fa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:41.638065 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560691e6-9dc8-42dc-9f38-2a0ca8184fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:41.638400 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560691e6-9dc8-42dc-9f38-2a0ca8184fa6 admin admin] PATH_INFO: `/v3/users/1836ab35e8384469a33f640c9c1f3bba` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:41.639642 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560691e6-9dc8-42dc-9f38-2a0ca8184fa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1836ab35e8384469a33f640c9c1f3bba)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:41.641600 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560691e6-9dc8-42dc-9f38-2a0ca8184fa6 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:41.700537 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-560691e6-9dc8-42dc-9f38-2a0ca8184fa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1836ab35e8384469a33f640c9c1f3bba'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:41.714643 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-560691e6-9dc8-42dc-9f38-2a0ca8184fa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1836ab35e8384469a33f640c9c1f3bba'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:41.724337 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-560691e6-9dc8-42dc-9f38-2a0ca8184fa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1836ab35e8384469a33f640c9c1f3bba'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:41.725010 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-560691e6-9dc8-42dc-9f38-2a0ca8184fa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1836ab35e8384469a33f640c9c1f3bba'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:41.737914 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-560691e6-9dc8-42dc-9f38-2a0ca8184fa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1836ab35e8384469a33f640c9c1f3bba'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:41.748862 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1143/2300] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:24:41 2022] DELETE /identity/v3/users/1836ab35e8384469a33f640c9c1f3bba => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:24:42.102832 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2324b-ca5d-4a91-a538-86c48b4236de admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:42.105381 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-1ae2324b-ca5d-4a91-a538-86c48b4236de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:42.129567 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2324b-ca5d-4a91-a538-86c48b4236de admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:42.235225 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f07058-ae7b-44c0-ba2e-bd0781d90345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:42.236353 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f07058-ae7b-44c0-ba2e-bd0781d90345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:42.236841 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f07058-ae7b-44c0-ba2e-bd0781d90345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:42.237307 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f07058-ae7b-44c0-ba2e-bd0781d90345 admin admin] PATH_INFO: `/v3/projects/cc2c9e7194ce4970a69cd4cf97de495d` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:42.239439 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f07058-ae7b-44c0-ba2e-bd0781d90345 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc2c9e7194ce4970a69cd4cf97de495d)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:42.243303 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f07058-ae7b-44c0-ba2e-bd0781d90345 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:42.308023 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-61f07058-ae7b-44c0-ba2e-bd0781d90345 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc2c9e7194ce4970a69cd4cf97de495d', 'request_id': 'req-61f07058-ae7b-44c0-ba2e-bd0781d90345'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:42.317251 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-61f07058-ae7b-44c0-ba2e-bd0781d90345 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc2c9e7194ce4970a69cd4cf97de495d', 'request_id': 'req-61f07058-ae7b-44c0-ba2e-bd0781d90345'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:42.326644 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-61f07058-ae7b-44c0-ba2e-bd0781d90345 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc2c9e7194ce4970a69cd4cf97de495d', 'request_id': 'req-61f07058-ae7b-44c0-ba2e-bd0781d90345'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:42.340381 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-61f07058-ae7b-44c0-ba2e-bd0781d90345 admin admin] The token cache is being invalidate because project cc2c9e7194ce4970a69cd4cf97de495d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:24:42.340666 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-61f07058-ae7b-44c0-ba2e-bd0781d90345 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:42.341384 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-61f07058-ae7b-44c0-ba2e-bd0781d90345 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:24:42.343010 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1158/2301] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:24:42 2022] DELETE /identity/v3/projects/cc2c9e7194ce4970a69cd4cf97de495d => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:24:51.741695 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=32,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:24:52.336837 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:24:56.453966 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce6f95-81b2-48d0-ae4f-ce08197e8d33 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:56.454656 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce6f95-81b2-48d0-ae4f-ce08197e8d33 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:56.454656 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce6f95-81b2-48d0-ae4f-ce08197e8d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:56.475511 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-0cce6f95-81b2-48d0-ae4f-ce08197e8d33 None None] MFA Rules not processed for user `cf20489fb7624e34b71ed9f03c2f50d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:24:56.476816 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-0cce6f95-81b2-48d0-ae4f-ce08197e8d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:56.568401 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1144/2302] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:24:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:24:58.132595 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f07058-ae7b-44c0-ba2e-bd0781d90345 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:24:58.134645 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-61f07058-ae7b-44c0-ba2e-bd0781d90345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:58.266907 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f07058-ae7b-44c0-ba2e-bd0781d90345 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:24:58.273590 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102db1f-bc57-4658-9f73-030a69e206bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e866f134f64644bf33e3adecf207c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:24:58.274160 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102db1f-bc57-4658-9f73-030a69e206bb service placement] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:24:58.274584 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102db1f-bc57-4658-9f73-030a69e206bb service placement] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:24:58.275029 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102db1f-bc57-4658-9f73-030a69e206bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:24:58.277131 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-5102db1f-bc57-4658-9f73-030a69e206bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:24:58.290350 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5102db1f-bc57-4658-9f73-030a69e206bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:24:58.292066 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5102db1f-bc57-4658-9f73-030a69e206bb service placement] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:24:58.304552 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1159/2303] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:24:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:25:06.558093 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=25 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:25:07.803048 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb657b7-835c-4371-a110-979ab50443dd None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:25:07.804188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb657b7-835c-4371-a110-979ab50443dd None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:25:07.804188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb657b7-835c-4371-a110-979ab50443dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:25:07.836651 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-2cb657b7-835c-4371-a110-979ab50443dd None None] MFA Rules not processed for user `bbd7a1d5a8d04e3798ffcab27bad936b`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:25:07.839046 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-2cb657b7-835c-4371-a110-979ab50443dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:25:07.964557 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1145/2304] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Sep 21 12:25:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:25:07.990011 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102db1f-bc57-4658-9f73-030a69e206bb service placement] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:25:07.992783 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-5102db1f-bc57-4658-9f73-030a69e206bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:25:08.116687 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102db1f-bc57-4658-9f73-030a69e206bb service placement] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:25:08.122090 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6e65a-1450-4138-a892-50e2d5744dc4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc2bab11b264196859802907b93ac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:25:08.122753 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6e65a-1450-4138-a892-50e2d5744dc4 service swift] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:25:08.123031 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6e65a-1450-4138-a892-50e2d5744dc4 service swift] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:25:08.123304 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6e65a-1450-4138-a892-50e2d5744dc4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:25:08.132421 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d6e65a-1450-4138-a892-50e2d5744dc4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:25:08.134034 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d6e65a-1450-4138-a892-50e2d5744dc4 service swift] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:25:08.143475 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1160/2305] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Sep 21 12:25:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 12:25:17.935456 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=25 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:25:18.139933 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=64 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:25:27.023114 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad5573-eaca-421e-99bd-c5343c376a51 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:25:27.023921 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad5573-eaca-421e-99bd-c5343c376a51 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:25:27.024073 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad5573-eaca-421e-99bd-c5343c376a51 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:25:27.026667 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1146/2306] 10.222.0.60 () {54 vars in 921 bytes} [Wed Sep 21 12:25:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:25:27.042430 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6437c-e350-4df0-91ed-6ec7718d7e64 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:25:27.042430 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6437c-e350-4df0-91ed-6ec7718d7e64 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:25:27.042430 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6437c-e350-4df0-91ed-6ec7718d7e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:25:27.065571 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-cbc6437c-e350-4df0-91ed-6ec7718d7e64 None None] MFA Rules not processed for user `6cb4001f94b8439180ca2a93d3b279b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:25:27.067055 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-cbc6437c-e350-4df0-91ed-6ec7718d7e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:25:27.202143 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1161/2307] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Sep 21 12:25:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:25:27.221025 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad5573-eaca-421e-99bd-c5343c376a51 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:25:27.223546 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-e2ad5573-eaca-421e-99bd-c5343c376a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:25:27.317415 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad5573-eaca-421e-99bd-c5343c376a51 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:25:27.324533 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63072a13-040b-497b-898a-b009c469b2e9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c513a6c91a0240de87c7b51b07617827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:25:27.325664 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63072a13-040b-497b-898a-b009c469b2e9 service glance] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:25:27.326260 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63072a13-040b-497b-898a-b009c469b2e9 service glance] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:25:27.326849 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63072a13-040b-497b-898a-b009c469b2e9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:25:27.346100 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63072a13-040b-497b-898a-b009c469b2e9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:25:27.347831 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63072a13-040b-497b-898a-b009c469b2e9 service glance] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:25:27.361750 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1147/2308] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:25:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:25:27.459385 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e541fd-1171-4e7c-a80b-136358faddb4 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:25:27.460006 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e541fd-1171-4e7c-a80b-136358faddb4 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:25:27.460410 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e541fd-1171-4e7c-a80b-136358faddb4 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:25:27.461972 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1162/2309] 10.222.0.60 () {54 vars in 921 bytes} [Wed Sep 21 12:25:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:25:27.469563 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991ebbb-6e7c-4799-b55c-326f1c0efdbe None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:25:27.470229 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991ebbb-6e7c-4799-b55c-326f1c0efdbe None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:25:27.470882 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991ebbb-6e7c-4799-b55c-326f1c0efdbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:25:27.508081 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-d991ebbb-6e7c-4799-b55c-326f1c0efdbe None None] MFA Rules not processed for user `ab0521c25c2d4417944efa4745588f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:25:27.510682 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-d991ebbb-6e7c-4799-b55c-326f1c0efdbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:25:27.603709 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1148/2310] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Sep 21 12:25:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:25:27.619271 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e541fd-1171-4e7c-a80b-136358faddb4 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:25:27.622105 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-66e541fd-1171-4e7c-a80b-136358faddb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:25:27.639651 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e541fd-1171-4e7c-a80b-136358faddb4 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:25:27.644768 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61f2d8-2fc2-406e-a8b4-af846d9bf06c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:25:27.645884 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61f2d8-2fc2-406e-a8b4-af846d9bf06c service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:25:27.646962 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61f2d8-2fc2-406e-a8b4-af846d9bf06c service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:25:27.647333 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61f2d8-2fc2-406e-a8b4-af846d9bf06c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:25:27.657163 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc61f2d8-2fc2-406e-a8b4-af846d9bf06c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:25:27.659123 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc61f2d8-2fc2-406e-a8b4-af846d9bf06c service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:25:27.673142 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1163/2311] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:25:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:25:27.814764 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08018a4-8869-4f2a-b99f-9fe742b6d4df None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:25:27.815255 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08018a4-8869-4f2a-b99f-9fe742b6d4df None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:25:27.815987 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08018a4-8869-4f2a-b99f-9fe742b6d4df None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:25:27.818586 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1149/2312] 10.222.0.60 () {54 vars in 921 bytes} [Wed Sep 21 12:25:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:25:27.827523 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b2790-d665-4967-8864-f34ab1eab40c None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:25:27.828012 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b2790-d665-4967-8864-f34ab1eab40c None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:25:27.828455 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b2790-d665-4967-8864-f34ab1eab40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:25:27.852760 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-ed3b2790-d665-4967-8864-f34ab1eab40c None None] MFA Rules not processed for user `6cb4001f94b8439180ca2a93d3b279b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:25:27.854276 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ed3b2790-d665-4967-8864-f34ab1eab40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:25:27.867041 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1164/2313] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Sep 21 12:25:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:25:27.879113 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08018a4-8869-4f2a-b99f-9fe742b6d4df None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:25:27.893514 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08018a4-8869-4f2a-b99f-9fe742b6d4df None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:25:27.898185 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145e83a-9fb2-4d6d-84ec-8eee6832d019 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:25:27.899131 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145e83a-9fb2-4d6d-84ec-8eee6832d019 service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:25:27.899506 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145e83a-9fb2-4d6d-84ec-8eee6832d019 service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:25:27.899874 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145e83a-9fb2-4d6d-84ec-8eee6832d019 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:25:27.913191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145e83a-9fb2-4d6d-84ec-8eee6832d019 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:25:27.914811 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145e83a-9fb2-4d6d-84ec-8eee6832d019 service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:25:27.929052 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1150/2314] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:25:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:25:30.917003 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f794cf3-249c-48ae-bbbd-a8addfba4715 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:25:30.917653 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f794cf3-249c-48ae-bbbd-a8addfba4715 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:25:30.917653 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f794cf3-249c-48ae-bbbd-a8addfba4715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:25:30.938855 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-1f794cf3-249c-48ae-bbbd-a8addfba4715 None None] MFA Rules not processed for user `bbd7a1d5a8d04e3798ffcab27bad936b`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:25:30.940125 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-1f794cf3-249c-48ae-bbbd-a8addfba4715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:25:30.947696 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1165/2315] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Sep 21 12:25:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:25:30.961784 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145e83a-9fb2-4d6d-84ec-8eee6832d019 service neutron] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:25:30.978593 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145e83a-9fb2-4d6d-84ec-8eee6832d019 service neutron] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:25:30.984238 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ffb33-e372-4a2e-88a1-d24d92e60c04 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc2bab11b264196859802907b93ac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:25:30.984876 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ffb33-e372-4a2e-88a1-d24d92e60c04 service swift] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:25:30.985149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ffb33-e372-4a2e-88a1-d24d92e60c04 service swift] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:25:30.985420 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ffb33-e372-4a2e-88a1-d24d92e60c04 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:25:30.995367 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229ffb33-e372-4a2e-88a1-d24d92e60c04 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:25:30.996986 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229ffb33-e372-4a2e-88a1-d24d92e60c04 service swift] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:25:31.007301 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1151/2316] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Sep 21 12:25:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 12:25:40.932978 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=43 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:25:41.002843 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=61 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:25:56.005301 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2588ad7-8b8b-475f-8300-571e0ffe9f8a None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:25:56.006234 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2588ad7-8b8b-475f-8300-571e0ffe9f8a None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:25:56.008592 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2588ad7-8b8b-475f-8300-571e0ffe9f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:25:56.046485 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-f2588ad7-8b8b-475f-8300-571e0ffe9f8a None None] MFA Rules not processed for user `bbd7a1d5a8d04e3798ffcab27bad936b`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:25:56.047960 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f2588ad7-8b8b-475f-8300-571e0ffe9f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:25:56.061932 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1166/2317] 10.222.0.60 () {58 vars in 967 bytes} [Wed Sep 21 12:25:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:25:56.076890 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ffb33-e372-4a2e-88a1-d24d92e60c04 service swift] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:25:56.088651 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ffb33-e372-4a2e-88a1-d24d92e60c04 service swift] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:25:56.094418 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3eb78a-b938-4413-90d3-95b540fbef03 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc2bab11b264196859802907b93ac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:25:56.095083 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3eb78a-b938-4413-90d3-95b540fbef03 service swift] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:25:56.095361 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3eb78a-b938-4413-90d3-95b540fbef03 service swift] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:25:56.095657 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3eb78a-b938-4413-90d3-95b540fbef03 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:25:56.105283 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3eb78a-b938-4413-90d3-95b540fbef03 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:25:56.106954 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3eb78a-b938-4413-90d3-95b540fbef03 service swift] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:25:56.116384 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1152/2318] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Sep 21 12:25:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 21 12:26:06.036409 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:26:06.112515 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=6 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:26:21.304236 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c03eac-011e-4bee-bbba-95abd7821014 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:26:21.304905 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c03eac-011e-4bee-bbba-95abd7821014 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:26:21.304905 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c03eac-011e-4bee-bbba-95abd7821014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:26:21.335053 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-f5c03eac-011e-4bee-bbba-95abd7821014 None None] MFA Rules not processed for user `6fd7dcb531994f118c09e661ae3c3526`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:26:21.337153 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f5c03eac-011e-4bee-bbba-95abd7821014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:26:21.414199 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1167/2319] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:26:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:26:31.406999 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=25 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:26:35.643715 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3eb78a-b938-4413-90d3-95b540fbef03 service swift] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:26:35.654774 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3eb78a-b938-4413-90d3-95b540fbef03 service swift] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:26:35.658782 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223584b2-21b2-4403-8137-94e758af88e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:26:35.659399 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223584b2-21b2-4403-8137-94e758af88e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:26:35.659677 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223584b2-21b2-4403-8137-94e758af88e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:26:35.659947 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223584b2-21b2-4403-8137-94e758af88e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:26:35.661969 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-223584b2-21b2-4403-8137-94e758af88e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:26:35.677714 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223584b2-21b2-4403-8137-94e758af88e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:26:35.679218 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223584b2-21b2-4403-8137-94e758af88e4 service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:26:35.693119 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1153/2320] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:26:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:26:36.917680 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c03eac-011e-4bee-bbba-95abd7821014 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:26:36.929741 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c03eac-011e-4bee-bbba-95abd7821014 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:26:36.933962 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6a301-b7a6-43be-a659-8811d818b79a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:26:36.934634 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6a301-b7a6-43be-a659-8811d818b79a service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:26:36.934915 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6a301-b7a6-43be-a659-8811d818b79a service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:26:36.935188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6a301-b7a6-43be-a659-8811d818b79a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:26:36.937094 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-18d6a301-b7a6-43be-a659-8811d818b79a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:26:36.952174 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6a301-b7a6-43be-a659-8811d818b79a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:26:36.953641 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6a301-b7a6-43be-a659-8811d818b79a service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:26:36.967322 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1168/2321] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:26:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:26:45.686694 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=6 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:26:46.961484 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=6 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:26:59.312380 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223584b2-21b2-4403-8137-94e758af88e4 service neutron] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:26:59.314040 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-223584b2-21b2-4403-8137-94e758af88e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:26:59.331365 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223584b2-21b2-4403-8137-94e758af88e4 service neutron] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:26:59.338144 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8604fdc-689e-40cd-814c-97a3644f07ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:26:59.338768 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8604fdc-689e-40cd-814c-97a3644f07ea service nova] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:26:59.339059 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8604fdc-689e-40cd-814c-97a3644f07ea service nova] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:26:59.339464 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8604fdc-689e-40cd-814c-97a3644f07ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:26:59.341743 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-a8604fdc-689e-40cd-814c-97a3644f07ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:26:59.353492 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8604fdc-689e-40cd-814c-97a3644f07ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:26:59.355145 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8604fdc-689e-40cd-814c-97a3644f07ea service nova] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:26:59.366142 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1154/2322] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:26:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:27:04.757845 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6a301-b7a6-43be-a659-8811d818b79a service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:27:04.770658 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6a301-b7a6-43be-a659-8811d818b79a service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:27:04.777102 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b312567-99e0-4ba6-84f9-01ea97489185 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:27:04.777729 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b312567-99e0-4ba6-84f9-01ea97489185 service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:27:04.778006 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b312567-99e0-4ba6-84f9-01ea97489185 service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:27:04.778286 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b312567-99e0-4ba6-84f9-01ea97489185 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:27:04.780286 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-9b312567-99e0-4ba6-84f9-01ea97489185 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:27:04.849103 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b312567-99e0-4ba6-84f9-01ea97489185 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:27:04.851111 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b312567-99e0-4ba6-84f9-01ea97489185 service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:27:04.864182 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1169/2323] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:27:04 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:27:09.360999 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=6 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:27:14.858209 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=28 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:27:15.056566 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a16b3-20db-47c1-8c74-dcfbc7ff75e3 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:27:15.057562 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a16b3-20db-47c1-8c74-dcfbc7ff75e3 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:27:15.057836 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a16b3-20db-47c1-8c74-dcfbc7ff75e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:27:15.079032 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-9a4a16b3-20db-47c1-8c74-dcfbc7ff75e3 None None] MFA Rules not processed for user `cf20489fb7624e34b71ed9f03c2f50d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:27:15.080353 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-9a4a16b3-20db-47c1-8c74-dcfbc7ff75e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:27:15.095845 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1155/2324] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:27:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:27:15.664717 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b312567-99e0-4ba6-84f9-01ea97489185 service nova] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:27:15.678412 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b312567-99e0-4ba6-84f9-01ea97489185 service nova] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:27:15.684771 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e931bdd-3d5b-40a4-86bb-cf18b4c30c51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:27:15.686162 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e931bdd-3d5b-40a4-86bb-cf18b4c30c51 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:27:15.686700 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e931bdd-3d5b-40a4-86bb-cf18b4c30c51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:27:15.687194 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e931bdd-3d5b-40a4-86bb-cf18b4c30c51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:27:15.690320 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-8e931bdd-3d5b-40a4-86bb-cf18b4c30c51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:27:15.706347 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e931bdd-3d5b-40a4-86bb-cf18b4c30c51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:27:15.708527 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e931bdd-3d5b-40a4-86bb-cf18b4c30c51 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:27:15.720178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1170/2325] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:27:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:27:16.428321 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a16b3-20db-47c1-8c74-dcfbc7ff75e3 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:27:16.443324 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a16b3-20db-47c1-8c74-dcfbc7ff75e3 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:27:16.448949 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3957ea2-c71f-4d7c-9d5d-4b8d16b79441 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e866f134f64644bf33e3adecf207c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:27:16.449622 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3957ea2-c71f-4d7c-9d5d-4b8d16b79441 service placement] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:27:16.449958 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3957ea2-c71f-4d7c-9d5d-4b8d16b79441 service placement] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:27:16.450306 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3957ea2-c71f-4d7c-9d5d-4b8d16b79441 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:27:16.452385 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-f3957ea2-c71f-4d7c-9d5d-4b8d16b79441 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:27:16.466068 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3957ea2-c71f-4d7c-9d5d-4b8d16b79441 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:27:16.467797 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3957ea2-c71f-4d7c-9d5d-4b8d16b79441 service placement] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:27:16.479444 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1156/2326] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:27:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:27:17.201500 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07facadd-c034-4ac1-810c-2f90656a0455 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:27:17.202202 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07facadd-c034-4ac1-810c-2f90656a0455 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:27:17.202545 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07facadd-c034-4ac1-810c-2f90656a0455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:27:17.230450 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-07facadd-c034-4ac1-810c-2f90656a0455 None None] MFA Rules not processed for user `e82cb48b04eb42b99160934b1c8b1f7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:27:17.231963 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-07facadd-c034-4ac1-810c-2f90656a0455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:27:17.245109 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1171/2327] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:27:17 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:27:19.180351 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3957ea2-c71f-4d7c-9d5d-4b8d16b79441 service placement] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:27:19.184537 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-f3957ea2-c71f-4d7c-9d5d-4b8d16b79441 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:27:19.204203 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3957ea2-c71f-4d7c-9d5d-4b8d16b79441 service placement] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:27:19.210777 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553e69e-c70a-4edc-abbf-ff26901da6b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:27:19.211631 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553e69e-c70a-4edc-abbf-ff26901da6b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:27:19.212008 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553e69e-c70a-4edc-abbf-ff26901da6b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:27:19.212381 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553e69e-c70a-4edc-abbf-ff26901da6b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:27:19.214700 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-0553e69e-c70a-4edc-abbf-ff26901da6b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:27:19.233283 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0553e69e-c70a-4edc-abbf-ff26901da6b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:27:19.236479 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0553e69e-c70a-4edc-abbf-ff26901da6b7 service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:27:19.249863 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1157/2328] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:27:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:27:25.240803 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07facadd-c034-4ac1-810c-2f90656a0455 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:27:25.267714 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07facadd-c034-4ac1-810c-2f90656a0455 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:27:25.282656 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02c7ba-afbf-4513-8a78-9319a7aab2aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:27:25.286105 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02c7ba-afbf-4513-8a78-9319a7aab2aa service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:27:25.286913 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02c7ba-afbf-4513-8a78-9319a7aab2aa service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:27:25.287257 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02c7ba-afbf-4513-8a78-9319a7aab2aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:27:25.289518 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-8c02c7ba-afbf-4513-8a78-9319a7aab2aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:27:25.305599 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c02c7ba-afbf-4513-8a78-9319a7aab2aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:27:25.307614 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c02c7ba-afbf-4513-8a78-9319a7aab2aa service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:27:25.327359 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1172/2329] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:27:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:27:29.244734 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=15 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:27:33.133650 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553e69e-c70a-4edc-abbf-ff26901da6b7 service neutron] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:27:33.148712 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553e69e-c70a-4edc-abbf-ff26901da6b7 service neutron] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:27:33.157367 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54be95d-1eb0-44da-8d1c-c8084679a503 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:27:33.158321 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54be95d-1eb0-44da-8d1c-c8084679a503 service nova] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:27:33.158846 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54be95d-1eb0-44da-8d1c-c8084679a503 service nova] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:27:33.159846 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54be95d-1eb0-44da-8d1c-c8084679a503 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:27:33.163298 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-e54be95d-1eb0-44da-8d1c-c8084679a503 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:27:33.186434 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54be95d-1eb0-44da-8d1c-c8084679a503 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:27:33.189086 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54be95d-1eb0-44da-8d1c-c8084679a503 service nova] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:27:33.211680 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1158/2330] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:27:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:27:34.564738 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02c7ba-afbf-4513-8a78-9319a7aab2aa service nova] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:27:34.567035 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-8c02c7ba-afbf-4513-8a78-9319a7aab2aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:27:34.654988 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02c7ba-afbf-4513-8a78-9319a7aab2aa service nova] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:27:34.667063 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759daaa-28bf-45f6-ad39-290fe3587b7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:27:34.667743 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759daaa-28bf-45f6-ad39-290fe3587b7d service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:27:34.668016 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759daaa-28bf-45f6-ad39-290fe3587b7d service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:27:34.668589 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759daaa-28bf-45f6-ad39-290fe3587b7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:27:34.676000 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-c759daaa-28bf-45f6-ad39-290fe3587b7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:27:34.703976 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759daaa-28bf-45f6-ad39-290fe3587b7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:27:34.709493 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759daaa-28bf-45f6-ad39-290fe3587b7d service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:27:34.731069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1173/2331] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:27:34 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:27:43.203229 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=6 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:27:44.727034 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=41 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:27:50.841250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54be95d-1eb0-44da-8d1c-c8084679a503 service nova] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:27:50.843258 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-e54be95d-1eb0-44da-8d1c-c8084679a503 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:27:50.927150 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54be95d-1eb0-44da-8d1c-c8084679a503 service nova] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:27:50.933812 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9442ff3-09ca-40e3-bfed-13b845063bc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:27:50.934603 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9442ff3-09ca-40e3-bfed-13b845063bc0 service cinder] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:27:50.934960 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9442ff3-09ca-40e3-bfed-13b845063bc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:27:50.935240 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9442ff3-09ca-40e3-bfed-13b845063bc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:27:50.938384 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-d9442ff3-09ca-40e3-bfed-13b845063bc0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:27:51.032871 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9442ff3-09ca-40e3-bfed-13b845063bc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:27:51.034520 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9442ff3-09ca-40e3-bfed-13b845063bc0 service cinder] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:27:51.044963 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1159/2332] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:27:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:27:57.374703 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759daaa-28bf-45f6-ad39-290fe3587b7d service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:27:57.416040 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759daaa-28bf-45f6-ad39-290fe3587b7d service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:27:57.427572 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f18bda-842f-45bf-b2c2-688685df6168 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:27:57.428549 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f18bda-842f-45bf-b2c2-688685df6168 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:27:57.428949 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f18bda-842f-45bf-b2c2-688685df6168 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:27:57.429360 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f18bda-842f-45bf-b2c2-688685df6168 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:27:57.431952 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-57f18bda-842f-45bf-b2c2-688685df6168 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:27:57.601489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f18bda-842f-45bf-b2c2-688685df6168 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:27:57.603627 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f18bda-842f-45bf-b2c2-688685df6168 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:27:57.626519 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1174/2333] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:27:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:28:01.040151 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=56 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:28:01.935626 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a464c67-b4dc-4379-ac7e-dcfadd117baa None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:01.936388 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a464c67-b4dc-4379-ac7e-dcfadd117baa None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:01.937371 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a464c67-b4dc-4379-ac7e-dcfadd117baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:01.969308 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-1a464c67-b4dc-4379-ac7e-dcfadd117baa None None] MFA Rules not processed for user `a55997792b7843439d62ef7d5245382b`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:28:01.971888 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-1a464c67-b4dc-4379-ac7e-dcfadd117baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:01.984831 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1160/2334] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:28:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:28:02.594046 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f18bda-842f-45bf-b2c2-688685df6168 service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:02.604892 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f18bda-842f-45bf-b2c2-688685df6168 service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:02.609303 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27bec3c-9b00-4e1b-a75c-837e1ff587b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:02.610048 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27bec3c-9b00-4e1b-a75c-837e1ff587b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:02.610437 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27bec3c-9b00-4e1b-a75c-837e1ff587b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:02.610791 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27bec3c-9b00-4e1b-a75c-837e1ff587b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:02.613393 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-c27bec3c-9b00-4e1b-a75c-837e1ff587b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:02.643942 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27bec3c-9b00-4e1b-a75c-837e1ff587b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:02.645846 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27bec3c-9b00-4e1b-a75c-837e1ff587b4 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:02.673596 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1175/2335] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:28:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:28:02.923495 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a464c67-b4dc-4379-ac7e-dcfadd117baa None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:02.927695 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-1a464c67-b4dc-4379-ac7e-dcfadd117baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:02.963590 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a464c67-b4dc-4379-ac7e-dcfadd117baa None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:02.969946 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1dfa6-4bcb-410a-9750-bc4b78078fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:02.970870 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1dfa6-4bcb-410a-9750-bc4b78078fd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:02.971260 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1dfa6-4bcb-410a-9750-bc4b78078fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:02.971696 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1dfa6-4bcb-410a-9750-bc4b78078fd6 admin admin] PATH_INFO: `/v3/users/6fd7dcb531994f118c09e661ae3c3526` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:02.973516 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1dfa6-4bcb-410a-9750-bc4b78078fd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fd7dcb531994f118c09e661ae3c3526)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:02.976226 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1dfa6-4bcb-410a-9750-bc4b78078fd6 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:03.056547 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-93a1dfa6-4bcb-410a-9750-bc4b78078fd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fd7dcb531994f118c09e661ae3c3526'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:03.077456 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-93a1dfa6-4bcb-410a-9750-bc4b78078fd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fd7dcb531994f118c09e661ae3c3526'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:03.088093 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-93a1dfa6-4bcb-410a-9750-bc4b78078fd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fd7dcb531994f118c09e661ae3c3526'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:03.089089 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-93a1dfa6-4bcb-410a-9750-bc4b78078fd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fd7dcb531994f118c09e661ae3c3526'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:03.100586 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-93a1dfa6-4bcb-410a-9750-bc4b78078fd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fd7dcb531994f118c09e661ae3c3526'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:03.107536 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1161/2336] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:28:02 2022] DELETE /identity/v3/users/6fd7dcb531994f118c09e661ae3c3526 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:28:03.313356 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27bec3c-9b00-4e1b-a75c-837e1ff587b4 service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:03.331574 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27bec3c-9b00-4e1b-a75c-837e1ff587b4 service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:03.412222 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47e8e8-6f40-4c34-af4a-d06e4f0f3223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:03.412869 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47e8e8-6f40-4c34-af4a-d06e4f0f3223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:03.413149 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47e8e8-6f40-4c34-af4a-d06e4f0f3223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:03.413424 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47e8e8-6f40-4c34-af4a-d06e4f0f3223 admin admin] PATH_INFO: `/v3/projects/7b259e7393694c4e8f88a6f0590ce393` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:03.414692 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae47e8e8-6f40-4c34-af4a-d06e4f0f3223 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b259e7393694c4e8f88a6f0590ce393)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:03.416678 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae47e8e8-6f40-4c34-af4a-d06e4f0f3223 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:03.438116 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:28:03.480669 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ae47e8e8-6f40-4c34-af4a-d06e4f0f3223 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b259e7393694c4e8f88a6f0590ce393', 'request_id': 'req-ae47e8e8-6f40-4c34-af4a-d06e4f0f3223'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:03.492966 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ae47e8e8-6f40-4c34-af4a-d06e4f0f3223 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b259e7393694c4e8f88a6f0590ce393', 'request_id': 'req-ae47e8e8-6f40-4c34-af4a-d06e4f0f3223'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:03.504302 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ae47e8e8-6f40-4c34-af4a-d06e4f0f3223 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b259e7393694c4e8f88a6f0590ce393', 'request_id': 'req-ae47e8e8-6f40-4c34-af4a-d06e4f0f3223'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:03.518701 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ae47e8e8-6f40-4c34-af4a-d06e4f0f3223 admin admin] The token cache is being invalidate because project 7b259e7393694c4e8f88a6f0590ce393 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:28:03.519043 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ae47e8e8-6f40-4c34-af4a-d06e4f0f3223 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:03.520143 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ae47e8e8-6f40-4c34-af4a-d06e4f0f3223 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:03.523313 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1176/2337] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:28:03 2022] DELETE /identity/v3/projects/7b259e7393694c4e8f88a6f0590ce393 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:28:03.531716 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002080a-b615-4eb5-91d8-870edf4b137d None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:03.532221 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002080a-b615-4eb5-91d8-870edf4b137d None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:03.532721 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002080a-b615-4eb5-91d8-870edf4b137d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:03.636625 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-f002080a-b615-4eb5-91d8-870edf4b137d None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:28:03.638210 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-f002080a-b615-4eb5-91d8-870edf4b137d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:03.715039 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1162/2338] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:28:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:28:03.723932 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3f647-fdb7-4939-a43c-cba895f5ffa3 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:03.724528 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3f647-fdb7-4939-a43c-cba895f5ffa3 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:03.724528 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3f647-fdb7-4939-a43c-cba895f5ffa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:03.759381 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-e2b3f647-fdb7-4939-a43c-cba895f5ffa3 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:28:03.761139 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-e2b3f647-fdb7-4939-a43c-cba895f5ffa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:03.777944 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1177/2339] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:28:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:28:03.784137 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002080a-b615-4eb5-91d8-870edf4b137d None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:03.796679 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002080a-b615-4eb5-91d8-870edf4b137d None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:03.802707 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d20a04-7619-4dbf-bb2e-80cc03ad84d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:03.803335 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d20a04-7619-4dbf-bb2e-80cc03ad84d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:03.803611 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d20a04-7619-4dbf-bb2e-80cc03ad84d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:03.803880 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d20a04-7619-4dbf-bb2e-80cc03ad84d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:03.804540 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d20a04-7619-4dbf-bb2e-80cc03ad84d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:28:03.804838 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d20a04-7619-4dbf-bb2e-80cc03ad84d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:03.806560 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d20a04-7619-4dbf-bb2e-80cc03ad84d8 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:03.823042 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1163/2340] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:28:03.830666 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3f647-fdb7-4939-a43c-cba895f5ffa3 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:03.846469 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3f647-fdb7-4939-a43c-cba895f5ffa3 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:03.851557 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de11ab0-09a7-40a1-aa60-242e39781639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:03.852271 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de11ab0-09a7-40a1-aa60-242e39781639 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:03.852669 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de11ab0-09a7-40a1-aa60-242e39781639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:03.853007 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de11ab0-09a7-40a1-aa60-242e39781639 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:03.853704 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de11ab0-09a7-40a1-aa60-242e39781639 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:03.855772 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de11ab0-09a7-40a1-aa60-242e39781639 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:03.901645 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1178/2341] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:28:03 2022] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:28:03.907047 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d20a04-7619-4dbf-bb2e-80cc03ad84d8 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:03.919476 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d20a04-7619-4dbf-bb2e-80cc03ad84d8 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:03.942263 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:28:03.993400 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc3504-9b33-44f7-a785-50e795efb623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:03.994027 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc3504-9b33-44f7-a785-50e795efb623 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:03.994311 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc3504-9b33-44f7-a785-50e795efb623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:03.994623 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc3504-9b33-44f7-a785-50e795efb623 admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:03.995272 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cc3504-9b33-44f7-a785-50e795efb623 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:03.997341 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cc3504-9b33-44f7-a785-50e795efb623 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:04.024012 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1164/2342] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:28:03 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:28:04.028704 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de11ab0-09a7-40a1-aa60-242e39781639 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:04.040414 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de11ab0-09a7-40a1-aa60-242e39781639 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:04.045839 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4ea08-dc34-4ac4-b354-2e8b182c6a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:04.046566 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4ea08-dc34-4ac4-b354-2e8b182c6a42 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:04.046992 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4ea08-dc34-4ac4-b354-2e8b182c6a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:04.047329 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4ea08-dc34-4ac4-b354-2e8b182c6a42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:04.048121 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b4ea08-dc34-4ac4-b354-2e8b182c6a42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:04.050467 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b4ea08-dc34-4ac4-b354-2e8b182c6a42 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:04.062905 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1179/2343] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:28:04.068487 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc3504-9b33-44f7-a785-50e795efb623 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:04.079988 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc3504-9b33-44f7-a785-50e795efb623 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:04.085419 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba33ac-6530-4b35-86bd-d39c3217c878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:04.086135 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba33ac-6530-4b35-86bd-d39c3217c878 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:04.086545 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba33ac-6530-4b35-86bd-d39c3217c878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:04.086869 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba33ac-6530-4b35-86bd-d39c3217c878 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:04.087586 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba33ac-6530-4b35-86bd-d39c3217c878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:04.089441 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba33ac-6530-4b35-86bd-d39c3217c878 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:04.105925 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1165/2344] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:28:04.112000 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4ea08-dc34-4ac4-b354-2e8b182c6a42 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:04.122828 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4ea08-dc34-4ac4-b354-2e8b182c6a42 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:04.129371 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16352602-3d77-441e-a30d-1333c0f22f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:04.130151 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16352602-3d77-441e-a30d-1333c0f22f8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:04.130463 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16352602-3d77-441e-a30d-1333c0f22f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:04.130866 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16352602-3d77-441e-a30d-1333c0f22f8e admin admin] PATH_INFO: `/v3/projects/513e99e9b5d747eb9b5a748337654764/users/bde3dbc2a9cd4f228d83c1ff23895da4/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:04.171765 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16352602-3d77-441e-a30d-1333c0f22f8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=513e99e9b5d747eb9b5a748337654764, user_id=bde3dbc2a9cd4f228d83c1ff23895da4, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:04.179582 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16352602-3d77-441e-a30d-1333c0f22f8e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:04.222962 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1180/2345] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:28:04 2022] PUT /identity/v3/projects/513e99e9b5d747eb9b5a748337654764/users/bde3dbc2a9cd4f228d83c1ff23895da4/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:28:04.231867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1bcdf-ada0-4cbb-974e-60122aa7fccf None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:04.231867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1bcdf-ada0-4cbb-974e-60122aa7fccf None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:04.232423 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1bcdf-ada0-4cbb-974e-60122aa7fccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:04.298292 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-d3c1bcdf-ada0-4cbb-974e-60122aa7fccf None None] MFA Rules not processed for user `bde3dbc2a9cd4f228d83c1ff23895da4`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:28:04.300152 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-d3c1bcdf-ada0-4cbb-974e-60122aa7fccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:04.383941 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1166/2346] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:28:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:28:04.397932 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16352602-3d77-441e-a30d-1333c0f22f8e admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:04.400243 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-16352602-3d77-441e-a30d-1333c0f22f8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:04.511961 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16352602-3d77-441e-a30d-1333c0f22f8e admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:04.520565 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b736d196-0472-468f-aac8-17e9493e572a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:04.521342 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736d196-0472-468f-aac8-17e9493e572a service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:04.521738 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736d196-0472-468f-aac8-17e9493e572a service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:04.522103 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736d196-0472-468f-aac8-17e9493e572a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:04.535903 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b736d196-0472-468f-aac8-17e9493e572a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:04.539100 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b736d196-0472-468f-aac8-17e9493e572a service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:04.557534 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1181/2347] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:28:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:28:10.434620 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1bcdf-ada0-4cbb-974e-60122aa7fccf None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:10.511085 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1bcdf-ada0-4cbb-974e-60122aa7fccf None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:10.520045 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e198f3-f497-4482-be34-cbdd60bcccff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:10.521106 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e198f3-f497-4482-be34-cbdd60bcccff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:10.521528 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e198f3-f497-4482-be34-cbdd60bcccff admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:10.522255 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e198f3-f497-4482-be34-cbdd60bcccff admin admin] PATH_INFO: `/v3/users/bde3dbc2a9cd4f228d83c1ff23895da4` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:10.525107 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e198f3-f497-4482-be34-cbdd60bcccff admin admin] RBAC: Authorizing `identity:delete_user(user_id=bde3dbc2a9cd4f228d83c1ff23895da4)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:10.528736 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e198f3-f497-4482-be34-cbdd60bcccff admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:10.589180 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:28:10.607997 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-33e198f3-f497-4482-be34-cbdd60bcccff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bde3dbc2a9cd4f228d83c1ff23895da4'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:10.622855 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-33e198f3-f497-4482-be34-cbdd60bcccff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bde3dbc2a9cd4f228d83c1ff23895da4'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:10.632476 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-33e198f3-f497-4482-be34-cbdd60bcccff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bde3dbc2a9cd4f228d83c1ff23895da4'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:10.633215 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-33e198f3-f497-4482-be34-cbdd60bcccff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bde3dbc2a9cd4f228d83c1ff23895da4'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:10.642975 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-33e198f3-f497-4482-be34-cbdd60bcccff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bde3dbc2a9cd4f228d83c1ff23895da4'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:10.650939 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1167/2348] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:28:10 2022] DELETE /identity/v3/users/bde3dbc2a9cd4f228d83c1ff23895da4 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:28:10.655814 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97b0df-1ade-4130-a90a-31b5408cb73a None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:10.656634 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97b0df-1ade-4130-a90a-31b5408cb73a None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:10.656634 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97b0df-1ade-4130-a90a-31b5408cb73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:10.678586 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-fe97b0df-1ade-4130-a90a-31b5408cb73a None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:28:10.679838 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-fe97b0df-1ade-4130-a90a-31b5408cb73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:10.694183 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:28:10.760994 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1182/2349] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:28:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:28:10.772073 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e198f3-f497-4482-be34-cbdd60bcccff admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:10.773854 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-33e198f3-f497-4482-be34-cbdd60bcccff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:10.842883 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e198f3-f497-4482-be34-cbdd60bcccff admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:10.847501 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478aca1-036e-4571-9d61-b13deb927270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:10.848128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478aca1-036e-4571-9d61-b13deb927270 service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:10.848405 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478aca1-036e-4571-9d61-b13deb927270 service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:10.848676 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478aca1-036e-4571-9d61-b13deb927270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:10.858998 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4478aca1-036e-4571-9d61-b13deb927270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:10.860486 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4478aca1-036e-4571-9d61-b13deb927270 service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:10.871680 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1168/2350] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:28:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:28:11.295024 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97b0df-1ade-4130-a90a-31b5408cb73a None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:11.296747 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-fe97b0df-1ade-4130-a90a-31b5408cb73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:11.316407 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97b0df-1ade-4130-a90a-31b5408cb73a None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:11.327253 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7336130-6b5a-4b90-a807-49895dad294a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:11.328814 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7336130-6b5a-4b90-a807-49895dad294a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:11.329222 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7336130-6b5a-4b90-a807-49895dad294a admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:11.329828 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7336130-6b5a-4b90-a807-49895dad294a admin admin] PATH_INFO: `/v3/projects/513e99e9b5d747eb9b5a748337654764` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:11.332076 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7336130-6b5a-4b90-a807-49895dad294a admin admin] RBAC: Authorizing `identity:delete_project(project_id=513e99e9b5d747eb9b5a748337654764)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:11.335037 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7336130-6b5a-4b90-a807-49895dad294a admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:11.447397 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a7336130-6b5a-4b90-a807-49895dad294a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '513e99e9b5d747eb9b5a748337654764', 'request_id': 'req-a7336130-6b5a-4b90-a807-49895dad294a'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:11.472668 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a7336130-6b5a-4b90-a807-49895dad294a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '513e99e9b5d747eb9b5a748337654764', 'request_id': 'req-a7336130-6b5a-4b90-a807-49895dad294a'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:11.485624 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a7336130-6b5a-4b90-a807-49895dad294a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '513e99e9b5d747eb9b5a748337654764', 'request_id': 'req-a7336130-6b5a-4b90-a807-49895dad294a'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:11.508635 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a7336130-6b5a-4b90-a807-49895dad294a admin admin] The token cache is being invalidate because project 513e99e9b5d747eb9b5a748337654764 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:28:11.509193 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a7336130-6b5a-4b90-a807-49895dad294a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:11.510224 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a7336130-6b5a-4b90-a807-49895dad294a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:11.512301 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1183/2351] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:28:11 2022] DELETE /identity/v3/projects/513e99e9b5d747eb9b5a748337654764 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:28:11.520340 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743dd730-cc24-4214-97f6-6875c84eac20 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:11.521199 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743dd730-cc24-4214-97f6-6875c84eac20 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:11.521354 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743dd730-cc24-4214-97f6-6875c84eac20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:11.558835 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-743dd730-cc24-4214-97f6-6875c84eac20 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:28:11.561197 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-743dd730-cc24-4214-97f6-6875c84eac20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:11.708975 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1169/2352] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:28:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:28:11.711740 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454c533-748e-46a0-a464-053f18887e90 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:11.712489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454c533-748e-46a0-a464-053f18887e90 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:11.713560 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454c533-748e-46a0-a464-053f18887e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:11.749437 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-8454c533-748e-46a0-a464-053f18887e90 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:28:11.752158 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-8454c533-748e-46a0-a464-053f18887e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:11.766414 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1184/2353] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:28:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:28:11.770253 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743dd730-cc24-4214-97f6-6875c84eac20 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:11.784848 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743dd730-cc24-4214-97f6-6875c84eac20 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:11.791770 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95813c0d-a031-4ec3-b8f5-c9280722e517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:11.791770 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95813c0d-a031-4ec3-b8f5-c9280722e517 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:11.792310 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95813c0d-a031-4ec3-b8f5-c9280722e517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:11.792310 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95813c0d-a031-4ec3-b8f5-c9280722e517 admin admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:11.792936 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95813c0d-a031-4ec3-b8f5-c9280722e517 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:28:11.793244 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95813c0d-a031-4ec3-b8f5-c9280722e517 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:11.794965 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95813c0d-a031-4ec3-b8f5-c9280722e517 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:11.811705 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1170/2354] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:28:11.819139 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8454c533-748e-46a0-a464-053f18887e90 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:11.834311 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8454c533-748e-46a0-a464-053f18887e90 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:11.839270 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f5872-da8a-446c-8e4e-eb7e08e63cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:11.839898 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f5872-da8a-446c-8e4e-eb7e08e63cff admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:11.840172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f5872-da8a-446c-8e4e-eb7e08e63cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:11.840441 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f5872-da8a-446c-8e4e-eb7e08e63cff admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:11.841095 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f5872-da8a-446c-8e4e-eb7e08e63cff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:11.843095 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f5872-da8a-446c-8e4e-eb7e08e63cff admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:11.889124 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1185/2355] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:28:11 2022] POST /identity/v3/projects => generated 363 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:28:11.894510 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95813c0d-a031-4ec3-b8f5-c9280722e517 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:11.905835 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95813c0d-a031-4ec3-b8f5-c9280722e517 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:11.952542 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:28:11.980481 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c924a9-9221-49db-b086-72a0a5251ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:11.981121 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c924a9-9221-49db-b086-72a0a5251ead admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:11.981401 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c924a9-9221-49db-b086-72a0a5251ead admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:11.981674 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c924a9-9221-49db-b086-72a0a5251ead admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:11.982335 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c924a9-9221-49db-b086-72a0a5251ead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:11.984453 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c924a9-9221-49db-b086-72a0a5251ead admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:12.011044 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1171/2356] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:28:11 2022] POST /identity/v3/users => generated 282 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:28:12.015825 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f5872-da8a-446c-8e4e-eb7e08e63cff admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:12.029522 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f5872-da8a-446c-8e4e-eb7e08e63cff admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:12.037324 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b72319-4f5c-447d-85d3-3cb5677b47d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:12.038271 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b72319-4f5c-447d-85d3-3cb5677b47d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:12.038734 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b72319-4f5c-447d-85d3-3cb5677b47d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:12.039125 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b72319-4f5c-447d-85d3-3cb5677b47d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:12.040249 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b72319-4f5c-447d-85d3-3cb5677b47d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:12.043255 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b72319-4f5c-447d-85d3-3cb5677b47d0 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:12.065696 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1186/2357] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:28:12.069868 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c924a9-9221-49db-b086-72a0a5251ead admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:12.093426 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c924a9-9221-49db-b086-72a0a5251ead admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:12.100243 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89574712-7740-46a6-a5a5-807aca8076a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:12.100944 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89574712-7740-46a6-a5a5-807aca8076a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:12.101312 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89574712-7740-46a6-a5a5-807aca8076a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:12.101632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89574712-7740-46a6-a5a5-807aca8076a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:12.102477 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89574712-7740-46a6-a5a5-807aca8076a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:12.104277 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89574712-7740-46a6-a5a5-807aca8076a4 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:12.120994 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1172/2358] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:28:12.127517 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b72319-4f5c-447d-85d3-3cb5677b47d0 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:12.144961 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b72319-4f5c-447d-85d3-3cb5677b47d0 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:12.152775 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938dd5e-94e4-49a7-b1ad-d9a29496bd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:12.153855 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938dd5e-94e4-49a7-b1ad-d9a29496bd82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:12.154324 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938dd5e-94e4-49a7-b1ad-d9a29496bd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:12.154815 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938dd5e-94e4-49a7-b1ad-d9a29496bd82 admin admin] PATH_INFO: `/v3/projects/02e72b8c5aea47a7b2aefd7393d30913/users/eac3486adf774df0acf26b28132025a8/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:12.185711 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4938dd5e-94e4-49a7-b1ad-d9a29496bd82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02e72b8c5aea47a7b2aefd7393d30913, user_id=eac3486adf774df0acf26b28132025a8, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:12.190399 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4938dd5e-94e4-49a7-b1ad-d9a29496bd82 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:12.218714 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1187/2359] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:28:12 2022] PUT /identity/v3/projects/02e72b8c5aea47a7b2aefd7393d30913/users/eac3486adf774df0acf26b28132025a8/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:28:12.231416 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fa890-3105-48cc-95af-fade593f5dd3 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:12.231945 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fa890-3105-48cc-95af-fade593f5dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:12.232367 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fa890-3105-48cc-95af-fade593f5dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:12.271683 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-346fa890-3105-48cc-95af-fade593f5dd3 None None] MFA Rules not processed for user `eac3486adf774df0acf26b28132025a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:28:12.273379 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-346fa890-3105-48cc-95af-fade593f5dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:12.371851 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1173/2360] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:28:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:28:12.376570 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938dd5e-94e4-49a7-b1ad-d9a29496bd82 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:12.428730 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:28:12.464345 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938dd5e-94e4-49a7-b1ad-d9a29496bd82 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:12.473071 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287dcb65-45a3-4a3d-aead-b32e58b6fb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:12.474116 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287dcb65-45a3-4a3d-aead-b32e58b6fb9a admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:12.474646 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287dcb65-45a3-4a3d-aead-b32e58b6fb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:12.475135 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287dcb65-45a3-4a3d-aead-b32e58b6fb9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:12.476323 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287dcb65-45a3-4a3d-aead-b32e58b6fb9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:12.480085 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287dcb65-45a3-4a3d-aead-b32e58b6fb9a admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:12.524276 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1188/2361] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:28:12 2022] POST /identity/v3/projects => generated 363 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:28:12.528788 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346fa890-3105-48cc-95af-fade593f5dd3 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:12.542326 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346fa890-3105-48cc-95af-fade593f5dd3 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:12.631621 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1705d00a-ebd9-4a47-b83d-8bdb789de813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:12.632145 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705d00a-ebd9-4a47-b83d-8bdb789de813 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:12.632427 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705d00a-ebd9-4a47-b83d-8bdb789de813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:12.632701 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705d00a-ebd9-4a47-b83d-8bdb789de813 admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:12.633367 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1705d00a-ebd9-4a47-b83d-8bdb789de813 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:12.635430 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1705d00a-ebd9-4a47-b83d-8bdb789de813 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:12.661963 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1174/2362] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:28:12 2022] POST /identity/v3/users => generated 288 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:28:12.666962 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287dcb65-45a3-4a3d-aead-b32e58b6fb9a admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:12.679498 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287dcb65-45a3-4a3d-aead-b32e58b6fb9a admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:12.685008 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588311dc-de18-40fa-b988-df1e18dc1aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:12.685646 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588311dc-de18-40fa-b988-df1e18dc1aaa admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:12.685928 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588311dc-de18-40fa-b988-df1e18dc1aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:12.686200 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588311dc-de18-40fa-b988-df1e18dc1aaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:12.686916 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588311dc-de18-40fa-b988-df1e18dc1aaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:12.688619 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588311dc-de18-40fa-b988-df1e18dc1aaa admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:12.701380 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1189/2363] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:28:12.706066 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1705d00a-ebd9-4a47-b83d-8bdb789de813 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:12.717947 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1705d00a-ebd9-4a47-b83d-8bdb789de813 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:12.724097 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34649b-10c1-4b32-8096-8882a9ffb109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:12.724852 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34649b-10c1-4b32-8096-8882a9ffb109 admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:12.725206 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34649b-10c1-4b32-8096-8882a9ffb109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:12.725606 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34649b-10c1-4b32-8096-8882a9ffb109 admin admin] PATH_INFO: `/v3/projects/1c6649aad1fd43b68e746c6dbf0ea97d/users/8d60595ae16e4cab94d82e92a9f08b52/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:12.744949 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d34649b-10c1-4b32-8096-8882a9ffb109 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c6649aad1fd43b68e746c6dbf0ea97d, user_id=8d60595ae16e4cab94d82e92a9f08b52, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:12.747757 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d34649b-10c1-4b32-8096-8882a9ffb109 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:12.768876 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1175/2364] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:28:12 2022] PUT /identity/v3/projects/1c6649aad1fd43b68e746c6dbf0ea97d/users/8d60595ae16e4cab94d82e92a9f08b52/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:28:12.775304 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588311dc-de18-40fa-b988-df1e18dc1aaa admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:12.793885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588311dc-de18-40fa-b988-df1e18dc1aaa admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:12.889033 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d083c-934e-4841-8157-c96836772575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:12.889763 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d083c-934e-4841-8157-c96836772575 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:12.890148 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d083c-934e-4841-8157-c96836772575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:12.890584 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d083c-934e-4841-8157-c96836772575 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:12.891469 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d083c-934e-4841-8157-c96836772575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:12.893588 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d083c-934e-4841-8157-c96836772575 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:12.906583 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1190/2365] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:28:12.911890 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34649b-10c1-4b32-8096-8882a9ffb109 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:12.928891 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34649b-10c1-4b32-8096-8882a9ffb109 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:12.937405 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8354c-580b-4654-bd3c-79a44e3a40ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:12.938608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8354c-580b-4654-bd3c-79a44e3a40ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:12.939111 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8354c-580b-4654-bd3c-79a44e3a40ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:12.940293 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8354c-580b-4654-bd3c-79a44e3a40ea admin admin] PATH_INFO: `/v3/projects/1c6649aad1fd43b68e746c6dbf0ea97d/users/8d60595ae16e4cab94d82e92a9f08b52/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:12.944049 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e8354c-580b-4654-bd3c-79a44e3a40ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c6649aad1fd43b68e746c6dbf0ea97d, user_id=8d60595ae16e4cab94d82e92a9f08b52, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:12.949255 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e8354c-580b-4654-bd3c-79a44e3a40ea admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:12.961034 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:28:12.969863 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1176/2366] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:28:12 2022] PUT /identity/v3/projects/1c6649aad1fd43b68e746c6dbf0ea97d/users/8d60595ae16e4cab94d82e92a9f08b52/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:28:12.982745 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108c8c3-5629-4ddd-93d0-0b7e80365f2a None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:12.983191 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108c8c3-5629-4ddd-93d0-0b7e80365f2a None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:12.983601 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108c8c3-5629-4ddd-93d0-0b7e80365f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:13.037722 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-f108c8c3-5629-4ddd-93d0-0b7e80365f2a None None] MFA Rules not processed for user `8d60595ae16e4cab94d82e92a9f08b52`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:28:13.039238 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f108c8c3-5629-4ddd-93d0-0b7e80365f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:13.137406 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1191/2367] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:28:12 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:28:13.150836 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8354c-580b-4654-bd3c-79a44e3a40ea admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:13.152887 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-b0e8354c-580b-4654-bd3c-79a44e3a40ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:13.224163 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8354c-580b-4654-bd3c-79a44e3a40ea admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:13.228649 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b782718-d523-45c8-968e-27fdadfa7240 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:13.229511 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b782718-d523-45c8-968e-27fdadfa7240 service cinder] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:13.229934 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b782718-d523-45c8-968e-27fdadfa7240 service cinder] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:13.230295 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b782718-d523-45c8-968e-27fdadfa7240 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:13.242285 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b782718-d523-45c8-968e-27fdadfa7240 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:13.244041 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b782718-d523-45c8-968e-27fdadfa7240 service cinder] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:13.255790 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1177/2368] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:28:13 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:28:13.593152 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108c8c3-5629-4ddd-93d0-0b7e80365f2a None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:13.596113 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f108c8c3-5629-4ddd-93d0-0b7e80365f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:13.669506 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:28:13.739894 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108c8c3-5629-4ddd-93d0-0b7e80365f2a None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:13.746324 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe67d12-7550-41bf-bf85-ef3b66830a99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:13.747103 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe67d12-7550-41bf-bf85-ef3b66830a99 service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:13.747385 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe67d12-7550-41bf-bf85-ef3b66830a99 service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:13.747659 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe67d12-7550-41bf-bf85-ef3b66830a99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:13.749664 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-6fe67d12-7550-41bf-bf85-ef3b66830a99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:13.762805 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b782718-d523-45c8-968e-27fdadfa7240 service cinder] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:13.765412 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe67d12-7550-41bf-bf85-ef3b66830a99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:13.767307 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe67d12-7550-41bf-bf85-ef3b66830a99 service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:13.782640 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1192/2369] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:28:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:28:13.841603 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b782718-d523-45c8-968e-27fdadfa7240 service cinder] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:13.847119 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acbf5db-adb0-4f73-abb9-fe61fbd3b036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:13.847774 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbf5db-adb0-4f73-abb9-fe61fbd3b036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:13.848058 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbf5db-adb0-4f73-abb9-fe61fbd3b036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:13.848362 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbf5db-adb0-4f73-abb9-fe61fbd3b036 admin admin] PATH_INFO: `/v3/users/eac3486adf774df0acf26b28132025a8` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:13.849553 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acbf5db-adb0-4f73-abb9-fe61fbd3b036 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eac3486adf774df0acf26b28132025a8)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:13.851563 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acbf5db-adb0-4f73-abb9-fe61fbd3b036 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:13.913937 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-5acbf5db-adb0-4f73-abb9-fe61fbd3b036 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eac3486adf774df0acf26b28132025a8'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:13.928795 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-5acbf5db-adb0-4f73-abb9-fe61fbd3b036 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eac3486adf774df0acf26b28132025a8'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:13.938620 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-5acbf5db-adb0-4f73-abb9-fe61fbd3b036 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eac3486adf774df0acf26b28132025a8'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:13.939284 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-5acbf5db-adb0-4f73-abb9-fe61fbd3b036 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eac3486adf774df0acf26b28132025a8'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:13.948448 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-5acbf5db-adb0-4f73-abb9-fe61fbd3b036 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eac3486adf774df0acf26b28132025a8'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:13.958448 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1178/2370] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:28:13 2022] DELETE /identity/v3/users/eac3486adf774df0acf26b28132025a8 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:28:13.961283 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da32cb-a981-4da8-af48-29b440aee202 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:13.961832 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da32cb-a981-4da8-af48-29b440aee202 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:13.962321 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da32cb-a981-4da8-af48-29b440aee202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:13.991069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-b7da32cb-a981-4da8-af48-29b440aee202 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:28:13.993286 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b7da32cb-a981-4da8-af48-29b440aee202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:14.070532 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1193/2371] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:28:14.084015 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acbf5db-adb0-4f73-abb9-fe61fbd3b036 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:14.086274 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-5acbf5db-adb0-4f73-abb9-fe61fbd3b036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:14.118632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:28:14.167891 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acbf5db-adb0-4f73-abb9-fe61fbd3b036 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:14.172014 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef360a0b-7faf-4c7e-8624-583f4c188599 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:14.172846 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef360a0b-7faf-4c7e-8624-583f4c188599 service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:14.173256 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef360a0b-7faf-4c7e-8624-583f4c188599 service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:14.173703 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef360a0b-7faf-4c7e-8624-583f4c188599 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:14.184917 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef360a0b-7faf-4c7e-8624-583f4c188599 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:14.186429 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef360a0b-7faf-4c7e-8624-583f4c188599 service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:14.198137 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1179/2372] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:28:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:28:14.551703 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da32cb-a981-4da8-af48-29b440aee202 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:14.553678 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b7da32cb-a981-4da8-af48-29b440aee202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:14.586582 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da32cb-a981-4da8-af48-29b440aee202 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:14.592251 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376790c-9811-4302-9903-d35117c9da65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:14.592925 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376790c-9811-4302-9903-d35117c9da65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:14.593205 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376790c-9811-4302-9903-d35117c9da65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:14.593471 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376790c-9811-4302-9903-d35117c9da65 admin admin] PATH_INFO: `/v3/projects/02e72b8c5aea47a7b2aefd7393d30913` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:14.594824 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9376790c-9811-4302-9903-d35117c9da65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02e72b8c5aea47a7b2aefd7393d30913)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:14.596794 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9376790c-9811-4302-9903-d35117c9da65 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:14.654069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-9376790c-9811-4302-9903-d35117c9da65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02e72b8c5aea47a7b2aefd7393d30913', 'request_id': 'req-9376790c-9811-4302-9903-d35117c9da65'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:14.663333 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-9376790c-9811-4302-9903-d35117c9da65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02e72b8c5aea47a7b2aefd7393d30913', 'request_id': 'req-9376790c-9811-4302-9903-d35117c9da65'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:14.671201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-9376790c-9811-4302-9903-d35117c9da65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02e72b8c5aea47a7b2aefd7393d30913', 'request_id': 'req-9376790c-9811-4302-9903-d35117c9da65'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:14.685062 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-9376790c-9811-4302-9903-d35117c9da65 admin admin] The token cache is being invalidate because project 02e72b8c5aea47a7b2aefd7393d30913 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:28:14.685312 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-9376790c-9811-4302-9903-d35117c9da65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:14.685931 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-9376790c-9811-4302-9903-d35117c9da65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:14.687674 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1194/2373] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:28:14 2022] DELETE /identity/v3/projects/02e72b8c5aea47a7b2aefd7393d30913 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:28:14.692973 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef360a0b-7faf-4c7e-8624-583f4c188599 service neutron] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:14.706426 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef360a0b-7faf-4c7e-8624-583f4c188599 service neutron] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:14.778760 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078c520-b73a-4b7e-9af8-640850f0dccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:14.779563 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078c520-b73a-4b7e-9af8-640850f0dccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:14.779748 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078c520-b73a-4b7e-9af8-640850f0dccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:14.779930 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078c520-b73a-4b7e-9af8-640850f0dccb admin admin] PATH_INFO: `/v3/users/8d60595ae16e4cab94d82e92a9f08b52` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:14.781177 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078c520-b73a-4b7e-9af8-640850f0dccb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d60595ae16e4cab94d82e92a9f08b52)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:14.783989 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078c520-b73a-4b7e-9af8-640850f0dccb admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:14.840095 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-9078c520-b73a-4b7e-9af8-640850f0dccb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d60595ae16e4cab94d82e92a9f08b52'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:14.854774 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-9078c520-b73a-4b7e-9af8-640850f0dccb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d60595ae16e4cab94d82e92a9f08b52'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:14.864428 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-9078c520-b73a-4b7e-9af8-640850f0dccb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d60595ae16e4cab94d82e92a9f08b52'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:14.865245 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-9078c520-b73a-4b7e-9af8-640850f0dccb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d60595ae16e4cab94d82e92a9f08b52'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:14.874667 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-9078c520-b73a-4b7e-9af8-640850f0dccb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d60595ae16e4cab94d82e92a9f08b52'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:14.882957 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1180/2374] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:28:14 2022] DELETE /identity/v3/users/8d60595ae16e4cab94d82e92a9f08b52 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:28:15.219661 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376790c-9811-4302-9903-d35117c9da65 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:15.222069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-9376790c-9811-4302-9903-d35117c9da65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:15.242601 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376790c-9811-4302-9903-d35117c9da65 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:15.310400 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:28:15.340301 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afacdc3-4faf-473f-9efc-cc9ac388a3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:15.341100 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afacdc3-4faf-473f-9efc-cc9ac388a3b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:15.341477 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afacdc3-4faf-473f-9efc-cc9ac388a3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:15.341866 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afacdc3-4faf-473f-9efc-cc9ac388a3b0 admin admin] PATH_INFO: `/v3/projects/1c6649aad1fd43b68e746c6dbf0ea97d` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:15.343957 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afacdc3-4faf-473f-9efc-cc9ac388a3b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c6649aad1fd43b68e746c6dbf0ea97d)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:15.347567 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afacdc3-4faf-473f-9efc-cc9ac388a3b0 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:15.420930 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0afacdc3-4faf-473f-9efc-cc9ac388a3b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c6649aad1fd43b68e746c6dbf0ea97d', 'request_id': 'req-0afacdc3-4faf-473f-9efc-cc9ac388a3b0'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:15.434781 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0afacdc3-4faf-473f-9efc-cc9ac388a3b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c6649aad1fd43b68e746c6dbf0ea97d', 'request_id': 'req-0afacdc3-4faf-473f-9efc-cc9ac388a3b0'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:15.443328 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0afacdc3-4faf-473f-9efc-cc9ac388a3b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c6649aad1fd43b68e746c6dbf0ea97d', 'request_id': 'req-0afacdc3-4faf-473f-9efc-cc9ac388a3b0'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:15.457543 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0afacdc3-4faf-473f-9efc-cc9ac388a3b0 admin admin] The token cache is being invalidate because project 1c6649aad1fd43b68e746c6dbf0ea97d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:28:15.457831 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0afacdc3-4faf-473f-9efc-cc9ac388a3b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:15.458844 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0afacdc3-4faf-473f-9efc-cc9ac388a3b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:15.461868 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1195/2375] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:28:15 2022] DELETE /identity/v3/projects/1c6649aad1fd43b68e746c6dbf0ea97d => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:28:15.470050 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2531b-6782-4908-9840-6fc335281b3b None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:15.471272 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2531b-6782-4908-9840-6fc335281b3b None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:15.471722 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2531b-6782-4908-9840-6fc335281b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:15.493473 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-dbe2531b-6782-4908-9840-6fc335281b3b None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:28:15.494780 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-dbe2531b-6782-4908-9840-6fc335281b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:15.545595 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:28:15.573643 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1181/2376] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:28:15.583238 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729da03-4bea-4ace-b59a-19e53124672e None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:15.583618 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729da03-4bea-4ace-b59a-19e53124672e None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:15.583970 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729da03-4bea-4ace-b59a-19e53124672e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:15.610660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-a729da03-4bea-4ace-b59a-19e53124672e None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:28:15.612129 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a729da03-4bea-4ace-b59a-19e53124672e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:15.620981 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1196/2377] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:28:15.625431 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2531b-6782-4908-9840-6fc335281b3b None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:15.636803 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2531b-6782-4908-9840-6fc335281b3b None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:15.642019 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd0e92-0020-4cbe-ab65-f0685d21a868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:15.643243 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd0e92-0020-4cbe-ab65-f0685d21a868 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:15.643598 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd0e92-0020-4cbe-ab65-f0685d21a868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:15.643879 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd0e92-0020-4cbe-ab65-f0685d21a868 admin admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:15.644556 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdd0e92-0020-4cbe-ab65-f0685d21a868 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:28:15.644882 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdd0e92-0020-4cbe-ab65-f0685d21a868 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:15.646580 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdd0e92-0020-4cbe-ab65-f0685d21a868 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:15.661430 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1182/2378] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:28:15.666080 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729da03-4bea-4ace-b59a-19e53124672e None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:15.678148 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729da03-4bea-4ace-b59a-19e53124672e None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:15.683271 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14f83b-c197-4bde-9ba0-e991de844afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:15.683898 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14f83b-c197-4bde-9ba0-e991de844afc admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:15.684178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14f83b-c197-4bde-9ba0-e991de844afc admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:15.684451 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b14f83b-c197-4bde-9ba0-e991de844afc admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:15.685113 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b14f83b-c197-4bde-9ba0-e991de844afc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:15.687108 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b14f83b-c197-4bde-9ba0-e991de844afc admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:15.719371 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1197/2379] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:28:15 2022] POST /identity/v3/projects => generated 367 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:28:15.724359 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd0e92-0020-4cbe-ab65-f0685d21a868 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:15.738345 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd0e92-0020-4cbe-ab65-f0685d21a868 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:15.805542 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306cb8c-baae-4970-b866-9b15d5605aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:15.806472 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306cb8c-baae-4970-b866-9b15d5605aa3 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:15.806764 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306cb8c-baae-4970-b866-9b15d5605aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:15.807079 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306cb8c-baae-4970-b866-9b15d5605aa3 admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:15.807749 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8306cb8c-baae-4970-b866-9b15d5605aa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:15.809770 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8306cb8c-baae-4970-b866-9b15d5605aa3 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:15.835759 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1183/2380] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:28:15 2022] POST /identity/v3/users => generated 284 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:28:15.841337 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14f83b-c197-4bde-9ba0-e991de844afc admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:15.853004 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b14f83b-c197-4bde-9ba0-e991de844afc admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:15.858519 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3caa9-4dbb-4f3b-a08d-f20b722a6de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:15.859120 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3caa9-4dbb-4f3b-a08d-f20b722a6de7 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:15.859401 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3caa9-4dbb-4f3b-a08d-f20b722a6de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:15.859678 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3caa9-4dbb-4f3b-a08d-f20b722a6de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:15.860332 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3caa9-4dbb-4f3b-a08d-f20b722a6de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:15.862515 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3caa9-4dbb-4f3b-a08d-f20b722a6de7 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:15.873867 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1198/2381] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:28:15.879688 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306cb8c-baae-4970-b866-9b15d5605aa3 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:15.891067 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306cb8c-baae-4970-b866-9b15d5605aa3 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:15.896062 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45012fd-fcbe-41da-95ea-7a88c7de901b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:15.896684 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45012fd-fcbe-41da-95ea-7a88c7de901b admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:15.896960 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45012fd-fcbe-41da-95ea-7a88c7de901b admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:15.897229 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45012fd-fcbe-41da-95ea-7a88c7de901b admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:15.898127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45012fd-fcbe-41da-95ea-7a88c7de901b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:15.899803 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45012fd-fcbe-41da-95ea-7a88c7de901b admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:15.912485 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1184/2382] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:28:15.917859 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3caa9-4dbb-4f3b-a08d-f20b722a6de7 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:15.929489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3caa9-4dbb-4f3b-a08d-f20b722a6de7 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:15.934327 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d0eb1-d14b-4977-9da0-a8410d7fc882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:15.935034 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d0eb1-d14b-4977-9da0-a8410d7fc882 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:15.935319 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d0eb1-d14b-4977-9da0-a8410d7fc882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:15.935624 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d0eb1-d14b-4977-9da0-a8410d7fc882 admin admin] PATH_INFO: `/v3/projects/093c7f0dbfc347feb526742747a7b147/users/b6b347f2da844b56b14bd2178614ebda/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:15.952908 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d0eb1-d14b-4977-9da0-a8410d7fc882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=093c7f0dbfc347feb526742747a7b147, user_id=b6b347f2da844b56b14bd2178614ebda, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:15.955695 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d0eb1-d14b-4977-9da0-a8410d7fc882 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:15.971011 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1199/2383] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:28:15 2022] PUT /identity/v3/projects/093c7f0dbfc347feb526742747a7b147/users/b6b347f2da844b56b14bd2178614ebda/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:28:15.982012 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71afe5-40f0-4499-9a71-c46110e2e836 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:15.982292 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71afe5-40f0-4499-9a71-c46110e2e836 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:15.982599 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71afe5-40f0-4499-9a71-c46110e2e836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:16.015365 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-bc71afe5-40f0-4499-9a71-c46110e2e836 None None] MFA Rules not processed for user `b6b347f2da844b56b14bd2178614ebda`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:28:16.016629 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-bc71afe5-40f0-4499-9a71-c46110e2e836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:16.106969 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1185/2384] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:28:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:28:16.111809 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d0eb1-d14b-4977-9da0-a8410d7fc882 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:16.186955 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d0eb1-d14b-4977-9da0-a8410d7fc882 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:16.192006 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa5caa-4403-4ee0-90f4-1ecc055468f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:16.192642 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa5caa-4403-4ee0-90f4-1ecc055468f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:16.192924 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa5caa-4403-4ee0-90f4-1ecc055468f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:16.193197 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa5caa-4403-4ee0-90f4-1ecc055468f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:16.193861 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fa5caa-4403-4ee0-90f4-1ecc055468f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:16.195963 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fa5caa-4403-4ee0-90f4-1ecc055468f5 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:16.213289 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:28:16.229117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1200/2385] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:28:16 2022] POST /identity/v3/projects => generated 367 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:28:16.234038 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71afe5-40f0-4499-9a71-c46110e2e836 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:16.246453 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71afe5-40f0-4499-9a71-c46110e2e836 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:16.291936 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:28:16.316818 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f568437-3fbd-433f-ad7e-73c3d361a7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:16.317487 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f568437-3fbd-433f-ad7e-73c3d361a7ae admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:16.317771 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f568437-3fbd-433f-ad7e-73c3d361a7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:16.318047 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f568437-3fbd-433f-ad7e-73c3d361a7ae admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:16.318773 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f568437-3fbd-433f-ad7e-73c3d361a7ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:16.320799 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f568437-3fbd-433f-ad7e-73c3d361a7ae admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:16.348372 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1186/2386] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:28:16 2022] POST /identity/v3/users => generated 290 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:28:16.349848 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa5caa-4403-4ee0-90f4-1ecc055468f5 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:16.361158 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa5caa-4403-4ee0-90f4-1ecc055468f5 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:16.366138 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a0478-c3b8-42aa-a4e7-c7282e42055c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:16.366816 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a0478-c3b8-42aa-a4e7-c7282e42055c admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:16.367097 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a0478-c3b8-42aa-a4e7-c7282e42055c admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:16.367527 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a0478-c3b8-42aa-a4e7-c7282e42055c admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:16.368202 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a0478-c3b8-42aa-a4e7-c7282e42055c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:16.369857 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a0478-c3b8-42aa-a4e7-c7282e42055c admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:16.382602 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1201/2387] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:28:16.387549 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f568437-3fbd-433f-ad7e-73c3d361a7ae admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:16.405060 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f568437-3fbd-433f-ad7e-73c3d361a7ae admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:16.411050 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f21d97-dc29-42a6-a2cd-045ee0cf93d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:16.411743 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f21d97-dc29-42a6-a2cd-045ee0cf93d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:16.412027 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f21d97-dc29-42a6-a2cd-045ee0cf93d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:16.412303 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f21d97-dc29-42a6-a2cd-045ee0cf93d1 admin admin] PATH_INFO: `/v3/projects/c2722337b83a465aacf67d883c44c5a8/users/f75a2b8cf5394716b6d33dbe567f7d45/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:16.430662 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f21d97-dc29-42a6-a2cd-045ee0cf93d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2722337b83a465aacf67d883c44c5a8, user_id=f75a2b8cf5394716b6d33dbe567f7d45, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:16.433434 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f21d97-dc29-42a6-a2cd-045ee0cf93d1 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:16.449981 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1187/2388] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:28:16 2022] PUT /identity/v3/projects/c2722337b83a465aacf67d883c44c5a8/users/f75a2b8cf5394716b6d33dbe567f7d45/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:28:16.454531 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a0478-c3b8-42aa-a4e7-c7282e42055c admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:16.465760 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a0478-c3b8-42aa-a4e7-c7282e42055c admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:16.536443 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a7490-fb75-4259-a0df-be6c7879688d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:16.537120 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a7490-fb75-4259-a0df-be6c7879688d admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:16.537442 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a7490-fb75-4259-a0df-be6c7879688d admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:16.537779 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a7490-fb75-4259-a0df-be6c7879688d admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:16.538650 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a7490-fb75-4259-a0df-be6c7879688d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:16.540378 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a7490-fb75-4259-a0df-be6c7879688d admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:16.553854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1202/2389] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:28:16.560240 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f21d97-dc29-42a6-a2cd-045ee0cf93d1 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:16.583725 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f21d97-dc29-42a6-a2cd-045ee0cf93d1 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:16.591662 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330978ca-0c5a-4b75-a43e-24121caa3212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:16.592736 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330978ca-0c5a-4b75-a43e-24121caa3212 admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:16.593190 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330978ca-0c5a-4b75-a43e-24121caa3212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:16.593665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330978ca-0c5a-4b75-a43e-24121caa3212 admin admin] PATH_INFO: `/v3/projects/c2722337b83a465aacf67d883c44c5a8/users/f75a2b8cf5394716b6d33dbe567f7d45/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:16.597687 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330978ca-0c5a-4b75-a43e-24121caa3212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2722337b83a465aacf67d883c44c5a8, user_id=f75a2b8cf5394716b6d33dbe567f7d45, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:16.602830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330978ca-0c5a-4b75-a43e-24121caa3212 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:16.621573 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1188/2390] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:28:16 2022] PUT /identity/v3/projects/c2722337b83a465aacf67d883c44c5a8/users/f75a2b8cf5394716b6d33dbe567f7d45/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:28:16.642192 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edd3bf-7b76-4dae-9e63-98c8162a5c35 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:16.643307 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edd3bf-7b76-4dae-9e63-98c8162a5c35 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:16.643786 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edd3bf-7b76-4dae-9e63-98c8162a5c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:16.686718 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-09edd3bf-7b76-4dae-9e63-98c8162a5c35 None None] MFA Rules not processed for user `f75a2b8cf5394716b6d33dbe567f7d45`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:28:16.688798 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-09edd3bf-7b76-4dae-9e63-98c8162a5c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:16.795357 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1203/2391] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:28:16 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:28:16.808762 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330978ca-0c5a-4b75-a43e-24121caa3212 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:16.811340 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-330978ca-0c5a-4b75-a43e-24121caa3212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:16.903056 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330978ca-0c5a-4b75-a43e-24121caa3212 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:16.910344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3eeea-f506-4213-a879-38f47d1008f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:16.911436 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3eeea-f506-4213-a879-38f47d1008f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:16.911865 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3eeea-f506-4213-a879-38f47d1008f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:16.912198 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3eeea-f506-4213-a879-38f47d1008f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:16.925579 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d3eeea-f506-4213-a879-38f47d1008f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:16.927558 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d3eeea-f506-4213-a879-38f47d1008f3 service cinder] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:16.941258 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1189/2392] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:28:16 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:28:18.983718 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09edd3bf-7b76-4dae-9e63-98c8162a5c35 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:19.111888 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09edd3bf-7b76-4dae-9e63-98c8162a5c35 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:19.119026 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74af16-638c-479f-bad3-71f5465d9bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:19.120011 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74af16-638c-479f-bad3-71f5465d9bd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:19.120694 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74af16-638c-479f-bad3-71f5465d9bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:19.121169 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74af16-638c-479f-bad3-71f5465d9bd3 admin admin] PATH_INFO: `/v3/users/b6b347f2da844b56b14bd2178614ebda` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:19.122897 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed74af16-638c-479f-bad3-71f5465d9bd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6b347f2da844b56b14bd2178614ebda)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:19.125440 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed74af16-638c-479f-bad3-71f5465d9bd3 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:19.133935 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:28:19.231928 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ed74af16-638c-479f-bad3-71f5465d9bd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6b347f2da844b56b14bd2178614ebda'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:19.246429 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ed74af16-638c-479f-bad3-71f5465d9bd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6b347f2da844b56b14bd2178614ebda'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:19.273202 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ed74af16-638c-479f-bad3-71f5465d9bd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6b347f2da844b56b14bd2178614ebda'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:19.275365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ed74af16-638c-479f-bad3-71f5465d9bd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6b347f2da844b56b14bd2178614ebda'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:19.292384 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ed74af16-638c-479f-bad3-71f5465d9bd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6b347f2da844b56b14bd2178614ebda'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:19.305562 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1204/2393] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:28:18 2022] DELETE /identity/v3/users/b6b347f2da844b56b14bd2178614ebda => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:28:19.310265 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129c0db-f3dc-466c-8048-763a3a31ca92 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:19.311296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129c0db-f3dc-466c-8048-763a3a31ca92 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:19.311296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129c0db-f3dc-466c-8048-763a3a31ca92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:19.345590 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-b129c0db-f3dc-466c-8048-763a3a31ca92 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:28:19.347482 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-b129c0db-f3dc-466c-8048-763a3a31ca92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:19.469142 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1190/2394] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:28:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:28:19.480449 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74af16-638c-479f-bad3-71f5465d9bd3 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:19.482096 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ed74af16-638c-479f-bad3-71f5465d9bd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:19.562013 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74af16-638c-479f-bad3-71f5465d9bd3 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:19.569125 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641b526-4242-449c-b61c-75a882cc7641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:19.570028 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641b526-4242-449c-b61c-75a882cc7641 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:19.570661 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641b526-4242-449c-b61c-75a882cc7641 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:19.571038 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641b526-4242-449c-b61c-75a882cc7641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:19.591938 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2641b526-4242-449c-b61c-75a882cc7641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:19.593678 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2641b526-4242-449c-b61c-75a882cc7641 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:19.608491 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1205/2395] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:28:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:28:20.079180 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129c0db-f3dc-466c-8048-763a3a31ca92 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:20.082169 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-b129c0db-f3dc-466c-8048-763a3a31ca92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:20.108661 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129c0db-f3dc-466c-8048-763a3a31ca92 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:20.115417 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c2837-768b-45c0-9f91-7a1073365afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:20.116147 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c2837-768b-45c0-9f91-7a1073365afd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:20.116436 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c2837-768b-45c0-9f91-7a1073365afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:20.116705 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c2837-768b-45c0-9f91-7a1073365afd admin admin] PATH_INFO: `/v3/projects/093c7f0dbfc347feb526742747a7b147` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:20.118050 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632c2837-768b-45c0-9f91-7a1073365afd admin admin] RBAC: Authorizing `identity:delete_project(project_id=093c7f0dbfc347feb526742747a7b147)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:20.120204 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632c2837-768b-45c0-9f91-7a1073365afd admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:20.175835 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:28:20.203385 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-632c2837-768b-45c0-9f91-7a1073365afd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '093c7f0dbfc347feb526742747a7b147', 'request_id': 'req-632c2837-768b-45c0-9f91-7a1073365afd'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:20.217026 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-632c2837-768b-45c0-9f91-7a1073365afd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '093c7f0dbfc347feb526742747a7b147', 'request_id': 'req-632c2837-768b-45c0-9f91-7a1073365afd'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:20.228708 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-632c2837-768b-45c0-9f91-7a1073365afd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '093c7f0dbfc347feb526742747a7b147', 'request_id': 'req-632c2837-768b-45c0-9f91-7a1073365afd'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:20.242410 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-632c2837-768b-45c0-9f91-7a1073365afd admin admin] The token cache is being invalidate because project 093c7f0dbfc347feb526742747a7b147 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:28:20.242704 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-632c2837-768b-45c0-9f91-7a1073365afd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:20.243413 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-632c2837-768b-45c0-9f91-7a1073365afd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:20.244982 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1191/2396] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:28:20 2022] DELETE /identity/v3/projects/093c7f0dbfc347feb526742747a7b147 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:28:20.249291 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641b526-4242-449c-b61c-75a882cc7641 service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:20.267220 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641b526-4242-449c-b61c-75a882cc7641 service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:20.367437 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe9c5c-2bce-4113-a81c-18fc9bc181e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:20.367982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe9c5c-2bce-4113-a81c-18fc9bc181e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:20.368266 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe9c5c-2bce-4113-a81c-18fc9bc181e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:20.368541 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe9c5c-2bce-4113-a81c-18fc9bc181e4 admin admin] PATH_INFO: `/v3/users/f75a2b8cf5394716b6d33dbe567f7d45` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:20.369815 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe9c5c-2bce-4113-a81c-18fc9bc181e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f75a2b8cf5394716b6d33dbe567f7d45)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:20.371897 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe9c5c-2bce-4113-a81c-18fc9bc181e4 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:20.409707 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:28:20.435604 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-9fbe9c5c-2bce-4113-a81c-18fc9bc181e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f75a2b8cf5394716b6d33dbe567f7d45'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:20.445941 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-9fbe9c5c-2bce-4113-a81c-18fc9bc181e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f75a2b8cf5394716b6d33dbe567f7d45'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:20.462491 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-9fbe9c5c-2bce-4113-a81c-18fc9bc181e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f75a2b8cf5394716b6d33dbe567f7d45'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:20.463390 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-9fbe9c5c-2bce-4113-a81c-18fc9bc181e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f75a2b8cf5394716b6d33dbe567f7d45'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:20.472967 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-9fbe9c5c-2bce-4113-a81c-18fc9bc181e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f75a2b8cf5394716b6d33dbe567f7d45'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:20.481952 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1206/2397] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:28:20 2022] DELETE /identity/v3/users/f75a2b8cf5394716b6d33dbe567f7d45 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:28:20.829614 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c2837-768b-45c0-9f91-7a1073365afd admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:20.831633 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-632c2837-768b-45c0-9f91-7a1073365afd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:20.854704 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c2837-768b-45c0-9f91-7a1073365afd admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:20.941138 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbed40-0cb0-4aee-8022-91f73ac17c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:20.941752 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbed40-0cb0-4aee-8022-91f73ac17c9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:20.942184 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbed40-0cb0-4aee-8022-91f73ac17c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:20.942623 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbed40-0cb0-4aee-8022-91f73ac17c9e admin admin] PATH_INFO: `/v3/projects/c2722337b83a465aacf67d883c44c5a8` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:20.944341 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbed40-0cb0-4aee-8022-91f73ac17c9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2722337b83a465aacf67d883c44c5a8)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:20.946805 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbed40-0cb0-4aee-8022-91f73ac17c9e admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:21.014130 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-0cdbed40-0cb0-4aee-8022-91f73ac17c9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2722337b83a465aacf67d883c44c5a8', 'request_id': 'req-0cdbed40-0cb0-4aee-8022-91f73ac17c9e'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:21.024269 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-0cdbed40-0cb0-4aee-8022-91f73ac17c9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2722337b83a465aacf67d883c44c5a8', 'request_id': 'req-0cdbed40-0cb0-4aee-8022-91f73ac17c9e'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:21.031012 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-0cdbed40-0cb0-4aee-8022-91f73ac17c9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2722337b83a465aacf67d883c44c5a8', 'request_id': 'req-0cdbed40-0cb0-4aee-8022-91f73ac17c9e'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:21.045065 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-0cdbed40-0cb0-4aee-8022-91f73ac17c9e admin admin] The token cache is being invalidate because project c2722337b83a465aacf67d883c44c5a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:28:21.045415 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-0cdbed40-0cb0-4aee-8022-91f73ac17c9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:21.046157 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-0cdbed40-0cb0-4aee-8022-91f73ac17c9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:21.047946 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1192/2398] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:28:20 2022] DELETE /identity/v3/projects/c2722337b83a465aacf67d883c44c5a8 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:28:21.053413 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f629a7-8657-44d2-be30-0eb25aef4b84 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:21.053839 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f629a7-8657-44d2-be30-0eb25aef4b84 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:21.054215 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f629a7-8657-44d2-be30-0eb25aef4b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:21.079325 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-27f629a7-8657-44d2-be30-0eb25aef4b84 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:28:21.082222 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-27f629a7-8657-44d2-be30-0eb25aef4b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:21.170566 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1207/2399] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:28:21.180012 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5a916-9152-4afb-bd26-e85f3328a52d None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:21.180318 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5a916-9152-4afb-bd26-e85f3328a52d None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:21.180605 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5a916-9152-4afb-bd26-e85f3328a52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:21.204822 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-11a5a916-9152-4afb-bd26-e85f3328a52d None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:28:21.206034 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-11a5a916-9152-4afb-bd26-e85f3328a52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:21.215038 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1193/2400] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:28:21.222201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f629a7-8657-44d2-be30-0eb25aef4b84 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:21.241453 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f629a7-8657-44d2-be30-0eb25aef4b84 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:21.247420 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44fd9a0-4f48-44e4-adb9-9bd260e793bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:21.248057 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fd9a0-4f48-44e4-adb9-9bd260e793bc admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:21.248341 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fd9a0-4f48-44e4-adb9-9bd260e793bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:21.248613 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fd9a0-4f48-44e4-adb9-9bd260e793bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:21.249317 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44fd9a0-4f48-44e4-adb9-9bd260e793bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:28:21.249622 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44fd9a0-4f48-44e4-adb9-9bd260e793bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:21.251390 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44fd9a0-4f48-44e4-adb9-9bd260e793bc admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:21.268117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1208/2401] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:28:21.273405 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5a916-9152-4afb-bd26-e85f3328a52d None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:21.283827 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5a916-9152-4afb-bd26-e85f3328a52d None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:21.289640 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14f419-7345-49ec-88b9-7216a4b38844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:21.290274 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14f419-7345-49ec-88b9-7216a4b38844 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:21.290700 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14f419-7345-49ec-88b9-7216a4b38844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:21.291016 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14f419-7345-49ec-88b9-7216a4b38844 admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:21.291719 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14f419-7345-49ec-88b9-7216a4b38844 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:21.293725 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14f419-7345-49ec-88b9-7216a4b38844 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:21.326028 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1194/2402] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:28:21 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:28:21.332888 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44fd9a0-4f48-44e4-adb9-9bd260e793bc admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:21.351155 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44fd9a0-4f48-44e4-adb9-9bd260e793bc admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:21.465167 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7bc6e-b0e7-4955-bbd4-6cd9743b73b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:21.466140 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7bc6e-b0e7-4955-bbd4-6cd9743b73b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:21.466661 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7bc6e-b0e7-4955-bbd4-6cd9743b73b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:21.467140 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7bc6e-b0e7-4955-bbd4-6cd9743b73b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:21.468337 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7bc6e-b0e7-4955-bbd4-6cd9743b73b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:21.472730 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7bc6e-b0e7-4955-bbd4-6cd9743b73b6 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:21.503395 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1209/2403] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:28:21 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:28:21.508568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14f419-7345-49ec-88b9-7216a4b38844 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:21.528203 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14f419-7345-49ec-88b9-7216a4b38844 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:21.537041 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f1beb-d616-4387-af5a-81732a9cdbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:21.538125 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f1beb-d616-4387-af5a-81732a9cdbbe admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:21.538686 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f1beb-d616-4387-af5a-81732a9cdbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:21.539190 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f1beb-d616-4387-af5a-81732a9cdbbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:21.540428 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f1beb-d616-4387-af5a-81732a9cdbbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:21.543619 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f1beb-d616-4387-af5a-81732a9cdbbe admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:21.565631 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1195/2404] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:28:21.570730 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7bc6e-b0e7-4955-bbd4-6cd9743b73b6 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:21.585569 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7bc6e-b0e7-4955-bbd4-6cd9743b73b6 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:21.592635 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248ede0-55a4-4764-8546-aa9e19892312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:21.593719 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248ede0-55a4-4764-8546-aa9e19892312 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:21.594269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248ede0-55a4-4764-8546-aa9e19892312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:21.594792 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248ede0-55a4-4764-8546-aa9e19892312 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:21.596543 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d248ede0-55a4-4764-8546-aa9e19892312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:21.599691 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d248ede0-55a4-4764-8546-aa9e19892312 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:21.621431 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1210/2405] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:28:21.625836 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f1beb-d616-4387-af5a-81732a9cdbbe admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:21.637216 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f1beb-d616-4387-af5a-81732a9cdbbe admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:21.643162 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d410e-91de-4e54-84cb-3980fc177466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:21.643847 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d410e-91de-4e54-84cb-3980fc177466 admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:21.644142 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d410e-91de-4e54-84cb-3980fc177466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:21.644401 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d410e-91de-4e54-84cb-3980fc177466 admin admin] PATH_INFO: `/v3/projects/74b6f123256448128e9802143a1a7f18/users/05935dd71330455f9f4d3d7ba2d32194/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:21.648461 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:28:21.665600 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d410e-91de-4e54-84cb-3980fc177466 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74b6f123256448128e9802143a1a7f18, user_id=05935dd71330455f9f4d3d7ba2d32194, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:21.668515 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d410e-91de-4e54-84cb-3980fc177466 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:21.686139 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1196/2406] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:28:21 2022] PUT /identity/v3/projects/74b6f123256448128e9802143a1a7f18/users/05935dd71330455f9f4d3d7ba2d32194/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:28:21.698295 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99941434-6742-4dd2-b63b-0a66a337599a None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:21.698601 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99941434-6742-4dd2-b63b-0a66a337599a None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:21.698888 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99941434-6742-4dd2-b63b-0a66a337599a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:21.723079 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:28:21.739286 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-99941434-6742-4dd2-b63b-0a66a337599a None None] MFA Rules not processed for user `05935dd71330455f9f4d3d7ba2d32194`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:28:21.740635 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-99941434-6742-4dd2-b63b-0a66a337599a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:21.833029 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1211/2407] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:28:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:28:21.838779 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d410e-91de-4e54-84cb-3980fc177466 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:21.931925 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d410e-91de-4e54-84cb-3980fc177466 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:21.936927 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921d2a5-ce5c-4a34-b389-4b63025aef20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:21.937557 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921d2a5-ce5c-4a34-b389-4b63025aef20 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:21.937836 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921d2a5-ce5c-4a34-b389-4b63025aef20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:21.938109 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921d2a5-ce5c-4a34-b389-4b63025aef20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:21.938808 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921d2a5-ce5c-4a34-b389-4b63025aef20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:21.941366 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921d2a5-ce5c-4a34-b389-4b63025aef20 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:21.971728 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1197/2408] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:28:21 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:28:21.978839 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99941434-6742-4dd2-b63b-0a66a337599a None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:21.997632 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99941434-6742-4dd2-b63b-0a66a337599a None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:22.074245 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8129f2-c337-4257-82a9-a8779a58a906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:22.074915 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8129f2-c337-4257-82a9-a8779a58a906 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:22.075198 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8129f2-c337-4257-82a9-a8779a58a906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:22.075483 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8129f2-c337-4257-82a9-a8779a58a906 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:22.076126 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8129f2-c337-4257-82a9-a8779a58a906 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:22.078120 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8129f2-c337-4257-82a9-a8779a58a906 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:22.103211 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1212/2409] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:28:21 2022] POST /identity/v3/users => generated 299 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:28:22.108923 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921d2a5-ce5c-4a34-b389-4b63025aef20 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:22.120787 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921d2a5-ce5c-4a34-b389-4b63025aef20 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:22.126263 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d6993-ff00-410f-80e3-7a962fd202a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:22.127470 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d6993-ff00-410f-80e3-7a962fd202a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:22.127752 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d6993-ff00-410f-80e3-7a962fd202a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:22.128026 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d6993-ff00-410f-80e3-7a962fd202a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:22.128685 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d6993-ff00-410f-80e3-7a962fd202a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:22.130338 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d6993-ff00-410f-80e3-7a962fd202a4 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:22.143078 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1198/2410] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:28:22.150304 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8129f2-c337-4257-82a9-a8779a58a906 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:22.168072 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8129f2-c337-4257-82a9-a8779a58a906 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:22.176817 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457d99e-0df2-4477-8df3-ea5510b65354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:22.177872 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457d99e-0df2-4477-8df3-ea5510b65354 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:22.178156 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457d99e-0df2-4477-8df3-ea5510b65354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:22.178464 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457d99e-0df2-4477-8df3-ea5510b65354 admin admin] PATH_INFO: `/v3/projects/a16ea2397de94a02ac7d03901fe9b7b3/users/73d81e2a61b84195834c5110eb89c40b/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:22.197641 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0457d99e-0df2-4477-8df3-ea5510b65354 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a16ea2397de94a02ac7d03901fe9b7b3, user_id=73d81e2a61b84195834c5110eb89c40b, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:22.200740 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0457d99e-0df2-4477-8df3-ea5510b65354 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:22.222091 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1213/2411] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:28:22 2022] PUT /identity/v3/projects/a16ea2397de94a02ac7d03901fe9b7b3/users/73d81e2a61b84195834c5110eb89c40b/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:28:22.227533 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d6993-ff00-410f-80e3-7a962fd202a4 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:22.238819 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d6993-ff00-410f-80e3-7a962fd202a4 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:22.315570 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b130387-68ca-413d-9d4e-d61fcd0464f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:22.316417 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b130387-68ca-413d-9d4e-d61fcd0464f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:22.316792 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b130387-68ca-413d-9d4e-d61fcd0464f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:22.317205 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b130387-68ca-413d-9d4e-d61fcd0464f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:22.317976 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b130387-68ca-413d-9d4e-d61fcd0464f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:22.319860 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b130387-68ca-413d-9d4e-d61fcd0464f6 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:22.332707 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1199/2412] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:28:22.337362 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457d99e-0df2-4477-8df3-ea5510b65354 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:22.350461 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457d99e-0df2-4477-8df3-ea5510b65354 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:22.361402 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc106b-3bb8-45e4-b737-452905d0fd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:22.362151 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc106b-3bb8-45e4-b737-452905d0fd23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:22.362530 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc106b-3bb8-45e4-b737-452905d0fd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:22.362875 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc106b-3bb8-45e4-b737-452905d0fd23 admin admin] PATH_INFO: `/v3/projects/a16ea2397de94a02ac7d03901fe9b7b3/users/73d81e2a61b84195834c5110eb89c40b/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:22.365085 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc106b-3bb8-45e4-b737-452905d0fd23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a16ea2397de94a02ac7d03901fe9b7b3, user_id=73d81e2a61b84195834c5110eb89c40b, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:22.368081 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc106b-3bb8-45e4-b737-452905d0fd23 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:22.381767 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1214/2413] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:28:22 2022] PUT /identity/v3/projects/a16ea2397de94a02ac7d03901fe9b7b3/users/73d81e2a61b84195834c5110eb89c40b/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:28:22.394443 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90b20f-0dcc-4e1d-bb28-6dd2d1320efe None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:22.394792 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90b20f-0dcc-4e1d-bb28-6dd2d1320efe None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:22.395120 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90b20f-0dcc-4e1d-bb28-6dd2d1320efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:22.430375 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-6c90b20f-0dcc-4e1d-bb28-6dd2d1320efe None None] MFA Rules not processed for user `73d81e2a61b84195834c5110eb89c40b`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:28:22.432580 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-6c90b20f-0dcc-4e1d-bb28-6dd2d1320efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:22.514885 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:28:22.550116 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1200/2414] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:28:22 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:28:22.566765 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc106b-3bb8-45e4-b737-452905d0fd23 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:22.569134 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-59dc106b-3bb8-45e4-b737-452905d0fd23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:22.643259 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc106b-3bb8-45e4-b737-452905d0fd23 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:22.647450 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceff571-fcb9-4d1e-ae60-2e7802de9fbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:22.648343 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceff571-fcb9-4d1e-ae60-2e7802de9fbb service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:22.648622 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceff571-fcb9-4d1e-ae60-2e7802de9fbb service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:22.648894 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceff571-fcb9-4d1e-ae60-2e7802de9fbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:22.656978 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:28:22.661458 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceff571-fcb9-4d1e-ae60-2e7802de9fbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:22.664218 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceff571-fcb9-4d1e-ae60-2e7802de9fbb service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:22.677279 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1215/2415] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:28:22 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:28:22.763296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90b20f-0dcc-4e1d-bb28-6dd2d1320efe None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:22.841851 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90b20f-0dcc-4e1d-bb28-6dd2d1320efe None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:22.847380 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab719ba-71be-4fea-ab6a-c946cfef5e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:22.848131 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab719ba-71be-4fea-ab6a-c946cfef5e54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:22.848417 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab719ba-71be-4fea-ab6a-c946cfef5e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:22.848687 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab719ba-71be-4fea-ab6a-c946cfef5e54 admin admin] PATH_INFO: `/v3/users/05935dd71330455f9f4d3d7ba2d32194` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:22.849890 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab719ba-71be-4fea-ab6a-c946cfef5e54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05935dd71330455f9f4d3d7ba2d32194)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:22.851903 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab719ba-71be-4fea-ab6a-c946cfef5e54 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:22.910929 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-2ab719ba-71be-4fea-ab6a-c946cfef5e54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05935dd71330455f9f4d3d7ba2d32194'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:22.928547 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-2ab719ba-71be-4fea-ab6a-c946cfef5e54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05935dd71330455f9f4d3d7ba2d32194'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:22.937811 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-2ab719ba-71be-4fea-ab6a-c946cfef5e54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05935dd71330455f9f4d3d7ba2d32194'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:22.938746 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-2ab719ba-71be-4fea-ab6a-c946cfef5e54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05935dd71330455f9f4d3d7ba2d32194'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:22.948673 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-2ab719ba-71be-4fea-ab6a-c946cfef5e54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05935dd71330455f9f4d3d7ba2d32194'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:22.955475 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1201/2416] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:28:22 2022] DELETE /identity/v3/users/05935dd71330455f9f4d3d7ba2d32194 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:28:22.960284 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6112ef-6c95-4ace-811f-d8fb65ae0bc4 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:22.960572 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6112ef-6c95-4ace-811f-d8fb65ae0bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:22.960855 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6112ef-6c95-4ace-811f-d8fb65ae0bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:22.981519 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-9a6112ef-6c95-4ace-811f-d8fb65ae0bc4 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:28:22.983312 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-9a6112ef-6c95-4ace-811f-d8fb65ae0bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:23.057861 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1216/2417] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:28:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:28:23.068779 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab719ba-71be-4fea-ab6a-c946cfef5e54 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:23.070405 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-2ab719ba-71be-4fea-ab6a-c946cfef5e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:23.150166 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab719ba-71be-4fea-ab6a-c946cfef5e54 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:23.156453 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf3ba6-7fed-4c76-971b-47cf54e18548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:23.157490 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf3ba6-7fed-4c76-971b-47cf54e18548 service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:23.158529 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf3ba6-7fed-4c76-971b-47cf54e18548 service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:23.159001 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf3ba6-7fed-4c76-971b-47cf54e18548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:23.173462 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf3ba6-7fed-4c76-971b-47cf54e18548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:23.176200 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf3ba6-7fed-4c76-971b-47cf54e18548 service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:23.188756 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1202/2418] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:28:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:28:23.573021 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6112ef-6c95-4ace-811f-d8fb65ae0bc4 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:23.575019 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-9a6112ef-6c95-4ace-811f-d8fb65ae0bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:23.593980 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6112ef-6c95-4ace-811f-d8fb65ae0bc4 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:23.603895 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e1088-f081-4149-86ed-94c0451bba88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:23.605009 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e1088-f081-4149-86ed-94c0451bba88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:23.605581 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e1088-f081-4149-86ed-94c0451bba88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:23.606009 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e1088-f081-4149-86ed-94c0451bba88 admin admin] PATH_INFO: `/v3/projects/74b6f123256448128e9802143a1a7f18` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:23.608374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e1088-f081-4149-86ed-94c0451bba88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74b6f123256448128e9802143a1a7f18)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:23.612476 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e1088-f081-4149-86ed-94c0451bba88 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:23.675036 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-044e1088-f081-4149-86ed-94c0451bba88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74b6f123256448128e9802143a1a7f18', 'request_id': 'req-044e1088-f081-4149-86ed-94c0451bba88'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:23.686298 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-044e1088-f081-4149-86ed-94c0451bba88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74b6f123256448128e9802143a1a7f18', 'request_id': 'req-044e1088-f081-4149-86ed-94c0451bba88'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:23.695790 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-044e1088-f081-4149-86ed-94c0451bba88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74b6f123256448128e9802143a1a7f18', 'request_id': 'req-044e1088-f081-4149-86ed-94c0451bba88'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:23.710853 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-044e1088-f081-4149-86ed-94c0451bba88 admin admin] The token cache is being invalidate because project 74b6f123256448128e9802143a1a7f18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:28:23.711127 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-044e1088-f081-4149-86ed-94c0451bba88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:23.711749 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-044e1088-f081-4149-86ed-94c0451bba88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:23.713784 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1217/2419] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:28:23 2022] DELETE /identity/v3/projects/74b6f123256448128e9802143a1a7f18 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:28:23.718495 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf3ba6-7fed-4c76-971b-47cf54e18548 service neutron] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:23.724680 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:28:23.733204 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf3ba6-7fed-4c76-971b-47cf54e18548 service neutron] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:23.810487 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4fb18b-5274-45dd-81d7-8a8e216755bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:23.811648 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fb18b-5274-45dd-81d7-8a8e216755bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:23.812184 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fb18b-5274-45dd-81d7-8a8e216755bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:23.812709 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fb18b-5274-45dd-81d7-8a8e216755bb admin admin] PATH_INFO: `/v3/users/73d81e2a61b84195834c5110eb89c40b` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:23.815592 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4fb18b-5274-45dd-81d7-8a8e216755bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=73d81e2a61b84195834c5110eb89c40b)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:23.819205 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4fb18b-5274-45dd-81d7-8a8e216755bb admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:23.910642 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-cf4fb18b-5274-45dd-81d7-8a8e216755bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73d81e2a61b84195834c5110eb89c40b'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:23.928291 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-cf4fb18b-5274-45dd-81d7-8a8e216755bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73d81e2a61b84195834c5110eb89c40b'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:23.938889 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-cf4fb18b-5274-45dd-81d7-8a8e216755bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73d81e2a61b84195834c5110eb89c40b'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:23.940518 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-cf4fb18b-5274-45dd-81d7-8a8e216755bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73d81e2a61b84195834c5110eb89c40b'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:23.949740 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-cf4fb18b-5274-45dd-81d7-8a8e216755bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73d81e2a61b84195834c5110eb89c40b'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:23.958044 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1203/2420] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:28:23 2022] DELETE /identity/v3/users/73d81e2a61b84195834c5110eb89c40b => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:28:24.299771 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e1088-f081-4149-86ed-94c0451bba88 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:24.301323 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-044e1088-f081-4149-86ed-94c0451bba88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:24.317048 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e1088-f081-4149-86ed-94c0451bba88 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:24.396745 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702fb8d9-6175-41e2-832f-dc530b6fc1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:24.397409 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fb8d9-6175-41e2-832f-dc530b6fc1a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:24.397689 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fb8d9-6175-41e2-832f-dc530b6fc1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:24.398214 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fb8d9-6175-41e2-832f-dc530b6fc1a8 admin admin] PATH_INFO: `/v3/projects/a16ea2397de94a02ac7d03901fe9b7b3` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:24.399507 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702fb8d9-6175-41e2-832f-dc530b6fc1a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a16ea2397de94a02ac7d03901fe9b7b3)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:24.401784 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702fb8d9-6175-41e2-832f-dc530b6fc1a8 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:24.431184 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:28:24.462696 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-702fb8d9-6175-41e2-832f-dc530b6fc1a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a16ea2397de94a02ac7d03901fe9b7b3', 'request_id': 'req-702fb8d9-6175-41e2-832f-dc530b6fc1a8'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:24.472329 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-702fb8d9-6175-41e2-832f-dc530b6fc1a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a16ea2397de94a02ac7d03901fe9b7b3', 'request_id': 'req-702fb8d9-6175-41e2-832f-dc530b6fc1a8'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:24.480205 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-702fb8d9-6175-41e2-832f-dc530b6fc1a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a16ea2397de94a02ac7d03901fe9b7b3', 'request_id': 'req-702fb8d9-6175-41e2-832f-dc530b6fc1a8'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:24.496427 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-702fb8d9-6175-41e2-832f-dc530b6fc1a8 admin admin] The token cache is being invalidate because project a16ea2397de94a02ac7d03901fe9b7b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:28:24.496708 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-702fb8d9-6175-41e2-832f-dc530b6fc1a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:24.497411 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-702fb8d9-6175-41e2-832f-dc530b6fc1a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:24.499010 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1218/2421] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:28:24 2022] DELETE /identity/v3/projects/a16ea2397de94a02ac7d03901fe9b7b3 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:28:24.505749 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9050119-baea-4974-8f52-66823ed9fa6e None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:24.506078 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9050119-baea-4974-8f52-66823ed9fa6e None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:24.506445 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9050119-baea-4974-8f52-66823ed9fa6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:24.528645 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-f9050119-baea-4974-8f52-66823ed9fa6e None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:28:24.529915 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-f9050119-baea-4974-8f52-66823ed9fa6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:24.604855 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1204/2422] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:28:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:28:24.617623 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b8c84-7d28-45d1-9ac4-5e83b77b717b None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:24.618211 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b8c84-7d28-45d1-9ac4-5e83b77b717b None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:24.618211 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b8c84-7d28-45d1-9ac4-5e83b77b717b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:24.640833 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-4e8b8c84-7d28-45d1-9ac4-5e83b77b717b None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:28:24.642276 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-4e8b8c84-7d28-45d1-9ac4-5e83b77b717b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:24.651492 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1219/2423] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:28:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:28:24.656273 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9050119-baea-4974-8f52-66823ed9fa6e None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:24.667592 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9050119-baea-4974-8f52-66823ed9fa6e None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:24.672568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019131a-5b90-4064-a3d0-47f0cd5fd383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:24.673201 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019131a-5b90-4064-a3d0-47f0cd5fd383 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:24.673559 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019131a-5b90-4064-a3d0-47f0cd5fd383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:24.673833 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019131a-5b90-4064-a3d0-47f0cd5fd383 admin admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:24.674545 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019131a-5b90-4064-a3d0-47f0cd5fd383 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:28:24.674851 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019131a-5b90-4064-a3d0-47f0cd5fd383 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:24.676507 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019131a-5b90-4064-a3d0-47f0cd5fd383 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:24.690897 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1205/2424] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:28:24.695973 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b8c84-7d28-45d1-9ac4-5e83b77b717b None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:24.706211 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b8c84-7d28-45d1-9ac4-5e83b77b717b None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:24.711543 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13cc76-f0e4-4717-8d5b-1b7fee4c4a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:24.712175 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13cc76-f0e4-4717-8d5b-1b7fee4c4a00 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:24.712458 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13cc76-f0e4-4717-8d5b-1b7fee4c4a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:24.712729 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13cc76-f0e4-4717-8d5b-1b7fee4c4a00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:24.713392 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13cc76-f0e4-4717-8d5b-1b7fee4c4a00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:24.715511 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13cc76-f0e4-4717-8d5b-1b7fee4c4a00 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:24.749431 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1220/2425] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:28:24 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:28:24.754691 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019131a-5b90-4064-a3d0-47f0cd5fd383 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:24.766126 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019131a-5b90-4064-a3d0-47f0cd5fd383 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:24.772737 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:28:24.834298 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35afda78-d81f-4193-bf14-5b1701e78795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:24.834966 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afda78-d81f-4193-bf14-5b1701e78795 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:24.835244 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afda78-d81f-4193-bf14-5b1701e78795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:24.835519 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afda78-d81f-4193-bf14-5b1701e78795 admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:24.836178 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35afda78-d81f-4193-bf14-5b1701e78795 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:24.838174 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35afda78-d81f-4193-bf14-5b1701e78795 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:24.865339 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1206/2426] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:28:24 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:28:24.870685 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13cc76-f0e4-4717-8d5b-1b7fee4c4a00 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:24.882584 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13cc76-f0e4-4717-8d5b-1b7fee4c4a00 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:24.889068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02779bd1-3f4d-4fa9-a770-9a1888b716c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:24.890140 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02779bd1-3f4d-4fa9-a770-9a1888b716c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:24.890671 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02779bd1-3f4d-4fa9-a770-9a1888b716c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:24.891167 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02779bd1-3f4d-4fa9-a770-9a1888b716c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:24.893107 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02779bd1-3f4d-4fa9-a770-9a1888b716c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:24.896262 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02779bd1-3f4d-4fa9-a770-9a1888b716c9 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:24.913446 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1221/2427] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:28:24.919780 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35afda78-d81f-4193-bf14-5b1701e78795 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:24.936475 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35afda78-d81f-4193-bf14-5b1701e78795 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:24.944425 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc62c5-da1c-4445-80ef-82c0590324fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:24.945465 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc62c5-da1c-4445-80ef-82c0590324fb admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:24.945947 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc62c5-da1c-4445-80ef-82c0590324fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:24.946462 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc62c5-da1c-4445-80ef-82c0590324fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:24.947643 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc62c5-da1c-4445-80ef-82c0590324fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:24.950793 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc62c5-da1c-4445-80ef-82c0590324fb admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:24.967638 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1207/2428] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:28:24.973063 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02779bd1-3f4d-4fa9-a770-9a1888b716c9 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:24.985708 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02779bd1-3f4d-4fa9-a770-9a1888b716c9 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:24.991507 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca1467-1c26-476b-84b2-2eea69042982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:24.992190 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca1467-1c26-476b-84b2-2eea69042982 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:24.992474 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca1467-1c26-476b-84b2-2eea69042982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:24.992757 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca1467-1c26-476b-84b2-2eea69042982 admin admin] PATH_INFO: `/v3/projects/514be57acf9a47c996e91f956972ede8/users/ffae5f104ea8402984203c96e5d877b8/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:25.014631 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ca1467-1c26-476b-84b2-2eea69042982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=514be57acf9a47c996e91f956972ede8, user_id=ffae5f104ea8402984203c96e5d877b8, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:25.017859 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ca1467-1c26-476b-84b2-2eea69042982 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:25.034318 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1222/2429] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:28:24 2022] PUT /identity/v3/projects/514be57acf9a47c996e91f956972ede8/users/ffae5f104ea8402984203c96e5d877b8/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:28:25.051181 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58a94a-6cb8-4dcf-bfb0-2652d0553f4e None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:25.051550 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58a94a-6cb8-4dcf-bfb0-2652d0553f4e None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:25.052006 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58a94a-6cb8-4dcf-bfb0-2652d0553f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:25.085615 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-8b58a94a-6cb8-4dcf-bfb0-2652d0553f4e None None] MFA Rules not processed for user `ffae5f104ea8402984203c96e5d877b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:28:25.087044 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-8b58a94a-6cb8-4dcf-bfb0-2652d0553f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:25.164463 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1208/2430] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:28:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:28:25.178054 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca1467-1c26-476b-84b2-2eea69042982 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:25.180071 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-42ca1467-1c26-476b-84b2-2eea69042982 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:25.250154 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca1467-1c26-476b-84b2-2eea69042982 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:25.254260 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28149e08-7666-4c42-84a1-93c3f0022af4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c513a6c91a0240de87c7b51b07617827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:25.254937 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28149e08-7666-4c42-84a1-93c3f0022af4 service glance] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:25.255221 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28149e08-7666-4c42-84a1-93c3f0022af4 service glance] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:25.255498 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28149e08-7666-4c42-84a1-93c3f0022af4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:25.265655 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28149e08-7666-4c42-84a1-93c3f0022af4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:25.268087 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28149e08-7666-4c42-84a1-93c3f0022af4 service glance] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:25.280092 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1223/2431] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:28:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:28:35.160930 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=62,keystone:INSERT=3 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:28:35.274968 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:DELETE=7,keystone:SELECT=68,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:28:46.524105 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58a94a-6cb8-4dcf-bfb0-2652d0553f4e None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:46.600857 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58a94a-6cb8-4dcf-bfb0-2652d0553f4e None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:46.605733 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ca6b3-563b-47a2-b4ed-dc52094e60ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:46.606416 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ca6b3-563b-47a2-b4ed-dc52094e60ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:46.606701 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ca6b3-563b-47a2-b4ed-dc52094e60ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:46.606973 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ca6b3-563b-47a2-b4ed-dc52094e60ef admin admin] PATH_INFO: `/v3/users/ffae5f104ea8402984203c96e5d877b8` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:46.608164 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ca6b3-563b-47a2-b4ed-dc52094e60ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffae5f104ea8402984203c96e5d877b8)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:46.610175 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ca6b3-563b-47a2-b4ed-dc52094e60ef admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:46.670667 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-a09ca6b3-563b-47a2-b4ed-dc52094e60ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffae5f104ea8402984203c96e5d877b8'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:46.685309 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-a09ca6b3-563b-47a2-b4ed-dc52094e60ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffae5f104ea8402984203c96e5d877b8'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:46.695221 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-a09ca6b3-563b-47a2-b4ed-dc52094e60ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffae5f104ea8402984203c96e5d877b8'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:46.695864 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-a09ca6b3-563b-47a2-b4ed-dc52094e60ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffae5f104ea8402984203c96e5d877b8'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:46.705984 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-a09ca6b3-563b-47a2-b4ed-dc52094e60ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffae5f104ea8402984203c96e5d877b8'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:46.713806 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1209/2432] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:28:46 2022] DELETE /identity/v3/users/ffae5f104ea8402984203c96e5d877b8 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:28:46.719036 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25521828-3302-46bc-b503-ffa4427ea25e None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:46.719685 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25521828-3302-46bc-b503-ffa4427ea25e None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:46.719685 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25521828-3302-46bc-b503-ffa4427ea25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:46.742236 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-25521828-3302-46bc-b503-ffa4427ea25e None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:28:46.743850 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-25521828-3302-46bc-b503-ffa4427ea25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:46.817383 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1224/2433] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:28:46.832016 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ca6b3-563b-47a2-b4ed-dc52094e60ef admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:46.833499 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-a09ca6b3-563b-47a2-b4ed-dc52094e60ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:46.902446 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ca6b3-563b-47a2-b4ed-dc52094e60ef admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:46.906559 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1373d9-8368-497d-9c64-b69f6eda48f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:46.907199 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1373d9-8368-497d-9c64-b69f6eda48f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:46.907477 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1373d9-8368-497d-9c64-b69f6eda48f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:46.907749 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1373d9-8368-497d-9c64-b69f6eda48f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:46.918536 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1373d9-8368-497d-9c64-b69f6eda48f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:46.921239 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1373d9-8368-497d-9c64-b69f6eda48f1 service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:46.933545 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1210/2434] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:28:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:28:47.371277 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25521828-3302-46bc-b503-ffa4427ea25e None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:47.374391 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-25521828-3302-46bc-b503-ffa4427ea25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:47.393968 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25521828-3302-46bc-b503-ffa4427ea25e None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:47.400675 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5413dba5-d3b1-46d4-81ff-b042bcf1f8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:47.401553 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413dba5-d3b1-46d4-81ff-b042bcf1f8e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:47.401987 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413dba5-d3b1-46d4-81ff-b042bcf1f8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:47.402308 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413dba5-d3b1-46d4-81ff-b042bcf1f8e2 admin admin] PATH_INFO: `/v3/projects/514be57acf9a47c996e91f956972ede8` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:47.404308 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5413dba5-d3b1-46d4-81ff-b042bcf1f8e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=514be57acf9a47c996e91f956972ede8)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:47.408088 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5413dba5-d3b1-46d4-81ff-b042bcf1f8e2 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:47.475472 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-5413dba5-d3b1-46d4-81ff-b042bcf1f8e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '514be57acf9a47c996e91f956972ede8', 'request_id': 'req-5413dba5-d3b1-46d4-81ff-b042bcf1f8e2'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:47.492076 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-5413dba5-d3b1-46d4-81ff-b042bcf1f8e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '514be57acf9a47c996e91f956972ede8', 'request_id': 'req-5413dba5-d3b1-46d4-81ff-b042bcf1f8e2'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:47.504300 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-5413dba5-d3b1-46d4-81ff-b042bcf1f8e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '514be57acf9a47c996e91f956972ede8', 'request_id': 'req-5413dba5-d3b1-46d4-81ff-b042bcf1f8e2'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:47.525708 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-5413dba5-d3b1-46d4-81ff-b042bcf1f8e2 admin admin] The token cache is being invalidate because project 514be57acf9a47c996e91f956972ede8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:28:47.526190 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-5413dba5-d3b1-46d4-81ff-b042bcf1f8e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:47.527275 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-5413dba5-d3b1-46d4-81ff-b042bcf1f8e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:28:47.529835 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1225/2435] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:28:47 2022] DELETE /identity/v3/projects/514be57acf9a47c996e91f956972ede8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:28:47.535100 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864f2e4-fa43-4506-b3a6-e1b3780a08c6 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:47.535901 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864f2e4-fa43-4506-b3a6-e1b3780a08c6 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:47.536090 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864f2e4-fa43-4506-b3a6-e1b3780a08c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:47.559830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-a864f2e4-fa43-4506-b3a6-e1b3780a08c6 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:28:47.561774 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-a864f2e4-fa43-4506-b3a6-e1b3780a08c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:47.584598 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:28:47.644007 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1211/2436] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:28:47.656492 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f815ff-8bc2-4e67-ad82-71c070f1f068 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:47.656856 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f815ff-8bc2-4e67-ad82-71c070f1f068 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:47.657057 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f815ff-8bc2-4e67-ad82-71c070f1f068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:47.679841 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-74f815ff-8bc2-4e67-ad82-71c070f1f068 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:28:47.681125 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-74f815ff-8bc2-4e67-ad82-71c070f1f068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:47.690342 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1226/2437] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:28:47.696672 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864f2e4-fa43-4506-b3a6-e1b3780a08c6 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:47.708470 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864f2e4-fa43-4506-b3a6-e1b3780a08c6 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:47.714064 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77e26a-e7ab-460d-a190-70dde7515d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:47.714798 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77e26a-e7ab-460d-a190-70dde7515d28 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:47.715117 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77e26a-e7ab-460d-a190-70dde7515d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:47.715434 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77e26a-e7ab-460d-a190-70dde7515d28 admin admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:47.716145 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77e26a-e7ab-460d-a190-70dde7515d28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:28:47.716490 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77e26a-e7ab-460d-a190-70dde7515d28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:47.718401 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77e26a-e7ab-460d-a190-70dde7515d28 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:47.733346 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1212/2438] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:28:47.738253 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f815ff-8bc2-4e67-ad82-71c070f1f068 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:47.748855 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f815ff-8bc2-4e67-ad82-71c070f1f068 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:47.754595 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8437b-eb3e-483f-a45d-b7f28f046c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:47.755234 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8437b-eb3e-483f-a45d-b7f28f046c42 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:47.755522 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8437b-eb3e-483f-a45d-b7f28f046c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:47.755791 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8437b-eb3e-483f-a45d-b7f28f046c42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:47.756446 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab8437b-eb3e-483f-a45d-b7f28f046c42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:47.758763 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab8437b-eb3e-483f-a45d-b7f28f046c42 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:47.791356 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1227/2439] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:28:47 2022] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:28:47.797440 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77e26a-e7ab-460d-a190-70dde7515d28 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:47.808716 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77e26a-e7ab-460d-a190-70dde7515d28 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:47.900408 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5371fd-d03d-4821-a777-83d8662666fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:47.901378 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5371fd-d03d-4821-a777-83d8662666fe admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:47.901873 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5371fd-d03d-4821-a777-83d8662666fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:47.902333 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5371fd-d03d-4821-a777-83d8662666fe admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:47.903578 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5371fd-d03d-4821-a777-83d8662666fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:47.907929 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5371fd-d03d-4821-a777-83d8662666fe admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:47.942523 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1213/2440] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:28:47 2022] POST /identity/v3/users => generated 285 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:28:47.946957 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8437b-eb3e-483f-a45d-b7f28f046c42 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:47.959986 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8437b-eb3e-483f-a45d-b7f28f046c42 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:47.966092 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f7808-3eee-431a-9dda-f4dfc9012c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:47.966759 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f7808-3eee-431a-9dda-f4dfc9012c5e admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:47.967041 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f7808-3eee-431a-9dda-f4dfc9012c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:47.967350 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f7808-3eee-431a-9dda-f4dfc9012c5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:47.968165 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f7808-3eee-431a-9dda-f4dfc9012c5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:47.969869 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f7808-3eee-431a-9dda-f4dfc9012c5e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:47.982925 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1228/2441] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:28:47.988111 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5371fd-d03d-4821-a777-83d8662666fe admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:48.007619 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5371fd-d03d-4821-a777-83d8662666fe admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:48.016014 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd7247-323e-45ba-aeb2-56a3d889d746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:48.017690 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd7247-323e-45ba-aeb2-56a3d889d746 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:48.018192 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd7247-323e-45ba-aeb2-56a3d889d746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:48.018730 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd7247-323e-45ba-aeb2-56a3d889d746 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:48.019944 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd7247-323e-45ba-aeb2-56a3d889d746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:48.023410 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd7247-323e-45ba-aeb2-56a3d889d746 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:48.044989 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1214/2442] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:28:48.049909 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f7808-3eee-431a-9dda-f4dfc9012c5e admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:48.062054 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f7808-3eee-431a-9dda-f4dfc9012c5e admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:48.068039 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3c87f-a9f9-4b1e-bd21-5462cf9454a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:48.068755 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3c87f-a9f9-4b1e-bd21-5462cf9454a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:48.069050 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3c87f-a9f9-4b1e-bd21-5462cf9454a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:48.069315 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3c87f-a9f9-4b1e-bd21-5462cf9454a4 admin admin] PATH_INFO: `/v3/projects/0b3c4c1f30ff45bc9db3eeec34370fb0/users/3dcb228cf2a6402380ab681836ad0ff1/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:48.086976 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b3c87f-a9f9-4b1e-bd21-5462cf9454a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b3c4c1f30ff45bc9db3eeec34370fb0, user_id=3dcb228cf2a6402380ab681836ad0ff1, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:48.089702 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b3c87f-a9f9-4b1e-bd21-5462cf9454a4 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:48.106700 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1229/2443] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:28:48 2022] PUT /identity/v3/projects/0b3c4c1f30ff45bc9db3eeec34370fb0/users/3dcb228cf2a6402380ab681836ad0ff1/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:28:48.119693 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47c1c3-5a23-4be1-8828-1b4c38c6db1e None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:48.120119 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47c1c3-5a23-4be1-8828-1b4c38c6db1e None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:48.120517 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47c1c3-5a23-4be1-8828-1b4c38c6db1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:48.153245 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-cd47c1c3-5a23-4be1-8828-1b4c38c6db1e None None] MFA Rules not processed for user `3dcb228cf2a6402380ab681836ad0ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:28:48.154417 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-cd47c1c3-5a23-4be1-8828-1b4c38c6db1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:48.242895 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1215/2444] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:28:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:28:48.255902 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3c87f-a9f9-4b1e-bd21-5462cf9454a4 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:28:48.257748 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-14b3c87f-a9f9-4b1e-bd21-5462cf9454a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:28:48.283512 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:28:48.336060 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3c87f-a9f9-4b1e-bd21-5462cf9454a4 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:28:48.340224 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf4e82-85ad-4f61-b0a6-100f89c156e2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c513a6c91a0240de87c7b51b07617827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:28:48.340931 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf4e82-85ad-4f61-b0a6-100f89c156e2 service glance] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:28:48.341255 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf4e82-85ad-4f61-b0a6-100f89c156e2 service glance] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:28:48.341571 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf4e82-85ad-4f61-b0a6-100f89c156e2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:28:48.354959 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf4e82-85ad-4f61-b0a6-100f89c156e2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:28:48.356559 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf4e82-85ad-4f61-b0a6-100f89c156e2 service glance] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:28:48.367240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1230/2445] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:28:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:28:58.239774 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:28:58.362450 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=17 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:29:19.148108 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d614d-b98e-4614-9b28-f31001dff370 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:29:19.149333 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d614d-b98e-4614-9b28-f31001dff370 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:29:19.149333 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d614d-b98e-4614-9b28-f31001dff370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:29:19.170947 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-588d614d-b98e-4614-9b28-f31001dff370 None None] MFA Rules not processed for user `cf20489fb7624e34b71ed9f03c2f50d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:29:19.172174 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-588d614d-b98e-4614-9b28-f31001dff370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:29:19.246707 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1216/2446] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:29:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:29:21.241014 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf4e82-85ad-4f61-b0a6-100f89c156e2 service glance] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:29:21.326496 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf4e82-85ad-4f61-b0a6-100f89c156e2 service glance] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:29:21.332778 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be746f5-4b33-48ac-b683-0cbacad65f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:29:21.333643 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be746f5-4b33-48ac-b683-0cbacad65f0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:29:21.334010 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be746f5-4b33-48ac-b683-0cbacad65f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:29:21.334464 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be746f5-4b33-48ac-b683-0cbacad65f0f admin admin] PATH_INFO: `/v3/users/3dcb228cf2a6402380ab681836ad0ff1` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:29:21.335994 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be746f5-4b33-48ac-b683-0cbacad65f0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dcb228cf2a6402380ab681836ad0ff1)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:29:21.338959 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be746f5-4b33-48ac-b683-0cbacad65f0f admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:29:21.429136 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-7be746f5-4b33-48ac-b683-0cbacad65f0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dcb228cf2a6402380ab681836ad0ff1'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:29:21.447568 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-7be746f5-4b33-48ac-b683-0cbacad65f0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dcb228cf2a6402380ab681836ad0ff1'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:29:21.477290 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-7be746f5-4b33-48ac-b683-0cbacad65f0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dcb228cf2a6402380ab681836ad0ff1'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:29:21.479161 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-7be746f5-4b33-48ac-b683-0cbacad65f0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dcb228cf2a6402380ab681836ad0ff1'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:29:21.500831 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-7be746f5-4b33-48ac-b683-0cbacad65f0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dcb228cf2a6402380ab681836ad0ff1'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:29:21.509833 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1231/2447] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:29:21 2022] DELETE /identity/v3/users/3dcb228cf2a6402380ab681836ad0ff1 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:29:21.514675 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72705e-eeea-46f4-8252-ae2274c045ab None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:29:21.515541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72705e-eeea-46f4-8252-ae2274c045ab None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:29:21.515541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72705e-eeea-46f4-8252-ae2274c045ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:29:21.540004 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-8a72705e-eeea-46f4-8252-ae2274c045ab None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:29:21.541474 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-8a72705e-eeea-46f4-8252-ae2274c045ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:29:21.656035 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1217/2448] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:29:21.671214 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be746f5-4b33-48ac-b683-0cbacad65f0f admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:29:21.674817 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7be746f5-4b33-48ac-b683-0cbacad65f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:29:21.781067 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be746f5-4b33-48ac-b683-0cbacad65f0f admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:29:21.788179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6dd69-5b10-48ca-a0e8-98afbb3bb484 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:29:21.789184 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6dd69-5b10-48ca-a0e8-98afbb3bb484 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:29:21.789463 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6dd69-5b10-48ca-a0e8-98afbb3bb484 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:29:21.789741 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6dd69-5b10-48ca-a0e8-98afbb3bb484 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:29:21.806350 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6dd69-5b10-48ca-a0e8-98afbb3bb484 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:29:21.807935 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6dd69-5b10-48ca-a0e8-98afbb3bb484 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:29:21.822253 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1232/2449] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:29:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:29:22.404521 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72705e-eeea-46f4-8252-ae2274c045ab None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:29:22.406191 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-8a72705e-eeea-46f4-8252-ae2274c045ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:29:22.419393 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a72705e-eeea-46f4-8252-ae2274c045ab None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:29:22.425508 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd127a-f5ea-48e2-b096-64c80772a1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:29:22.426849 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd127a-f5ea-48e2-b096-64c80772a1e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:29:22.427207 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd127a-f5ea-48e2-b096-64c80772a1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:29:22.427554 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd127a-f5ea-48e2-b096-64c80772a1e0 admin admin] PATH_INFO: `/v3/projects/0b3c4c1f30ff45bc9db3eeec34370fb0` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:29:22.428895 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd127a-f5ea-48e2-b096-64c80772a1e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b3c4c1f30ff45bc9db3eeec34370fb0)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:29:22.431294 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd127a-f5ea-48e2-b096-64c80772a1e0 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:29:22.504966 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-5abd127a-f5ea-48e2-b096-64c80772a1e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b3c4c1f30ff45bc9db3eeec34370fb0', 'request_id': 'req-5abd127a-f5ea-48e2-b096-64c80772a1e0'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:29:22.521031 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-5abd127a-f5ea-48e2-b096-64c80772a1e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b3c4c1f30ff45bc9db3eeec34370fb0', 'request_id': 'req-5abd127a-f5ea-48e2-b096-64c80772a1e0'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:29:22.534705 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-5abd127a-f5ea-48e2-b096-64c80772a1e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b3c4c1f30ff45bc9db3eeec34370fb0', 'request_id': 'req-5abd127a-f5ea-48e2-b096-64c80772a1e0'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:29:22.564548 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-5abd127a-f5ea-48e2-b096-64c80772a1e0 admin admin] The token cache is being invalidate because project 0b3c4c1f30ff45bc9db3eeec34370fb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:29:22.565151 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-5abd127a-f5ea-48e2-b096-64c80772a1e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:29:22.566258 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-5abd127a-f5ea-48e2-b096-64c80772a1e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:29:22.569462 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1218/2450] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:29:22 2022] DELETE /identity/v3/projects/0b3c4c1f30ff45bc9db3eeec34370fb0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:29:22.575577 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2a35d-b500-44e9-bc2f-d539ed121084 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:29:22.578044 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2a35d-b500-44e9-bc2f-d539ed121084 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:29:22.579718 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2a35d-b500-44e9-bc2f-d539ed121084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:29:22.621849 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-a6c2a35d-b500-44e9-bc2f-d539ed121084 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:29:22.623440 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a6c2a35d-b500-44e9-bc2f-d539ed121084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:29:22.666265 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:29:22.774124 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1233/2451] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:29:22.850437 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8bca9-48e4-46fc-b06f-8484f80e2442 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:29:22.851204 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8bca9-48e4-46fc-b06f-8484f80e2442 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:29:22.851920 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a8bca9-48e4-46fc-b06f-8484f80e2442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:29:22.892794 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-81a8bca9-48e4-46fc-b06f-8484f80e2442 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:29:22.895948 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-81a8bca9-48e4-46fc-b06f-8484f80e2442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:29:22.926460 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1219/2452] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:29:22.928603 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2a35d-b500-44e9-bc2f-d539ed121084 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:29:22.949295 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2a35d-b500-44e9-bc2f-d539ed121084 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:29:22.955941 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd47bc-4498-4ec8-8ff3-4d9a94bb17f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:29:22.956914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd47bc-4498-4ec8-8ff3-4d9a94bb17f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:29:22.957482 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd47bc-4498-4ec8-8ff3-4d9a94bb17f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:29:22.957824 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd47bc-4498-4ec8-8ff3-4d9a94bb17f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:29:22.959534 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd47bc-4498-4ec8-8ff3-4d9a94bb17f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:29:22.959534 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd47bc-4498-4ec8-8ff3-4d9a94bb17f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:29:22.961048 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd47bc-4498-4ec8-8ff3-4d9a94bb17f5 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:29:22.975963 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1234/2453] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:29:22.981442 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a8bca9-48e4-46fc-b06f-8484f80e2442 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:29:23.006484 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a8bca9-48e4-46fc-b06f-8484f80e2442 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:29:23.016774 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fdf9ef-9b40-4e37-b26f-457339ab2137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:29:23.018178 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fdf9ef-9b40-4e37-b26f-457339ab2137 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:29:23.018999 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fdf9ef-9b40-4e37-b26f-457339ab2137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:29:23.019669 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fdf9ef-9b40-4e37-b26f-457339ab2137 admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:29:23.021132 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fdf9ef-9b40-4e37-b26f-457339ab2137 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:29:23.025498 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fdf9ef-9b40-4e37-b26f-457339ab2137 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:29:23.069850 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:29:23.079863 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1220/2454] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:29:22 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:29:23.085599 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd47bc-4498-4ec8-8ff3-4d9a94bb17f5 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:29:23.100209 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd47bc-4498-4ec8-8ff3-4d9a94bb17f5 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:29:23.173715 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e247ba6-62e3-4d71-9088-e2c4480f8b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:29:23.174376 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e247ba6-62e3-4d71-9088-e2c4480f8b9a admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:29:23.174682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e247ba6-62e3-4d71-9088-e2c4480f8b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:29:23.174958 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e247ba6-62e3-4d71-9088-e2c4480f8b9a admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:29:23.175609 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e247ba6-62e3-4d71-9088-e2c4480f8b9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:29:23.177641 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e247ba6-62e3-4d71-9088-e2c4480f8b9a admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:29:23.208677 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1235/2455] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:29:23 2022] POST /identity/v3/users => generated 287 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:29:23.210013 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fdf9ef-9b40-4e37-b26f-457339ab2137 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:29:23.222716 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fdf9ef-9b40-4e37-b26f-457339ab2137 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:29:23.228213 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e954c-54b1-42a7-a692-820911a4cb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:29:23.228875 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e954c-54b1-42a7-a692-820911a4cb2d admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:29:23.229158 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e954c-54b1-42a7-a692-820911a4cb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:29:23.229433 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e954c-54b1-42a7-a692-820911a4cb2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:29:23.230112 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e954c-54b1-42a7-a692-820911a4cb2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:29:23.231857 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e954c-54b1-42a7-a692-820911a4cb2d admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:29:23.243899 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1221/2456] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:29:23.249011 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e247ba6-62e3-4d71-9088-e2c4480f8b9a admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:29:23.262461 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e247ba6-62e3-4d71-9088-e2c4480f8b9a admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:29:23.268935 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cad9ab-1990-459e-a65c-bc801b19b305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:29:23.269715 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cad9ab-1990-459e-a65c-bc801b19b305 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:29:23.270069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cad9ab-1990-459e-a65c-bc801b19b305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:29:23.270439 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cad9ab-1990-459e-a65c-bc801b19b305 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:29:23.271175 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cad9ab-1990-459e-a65c-bc801b19b305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:29:23.272907 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cad9ab-1990-459e-a65c-bc801b19b305 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:29:23.285575 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1236/2457] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:29:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:29:23.289692 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e954c-54b1-42a7-a692-820911a4cb2d admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:29:23.300549 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e954c-54b1-42a7-a692-820911a4cb2d admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:29:23.305890 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b7b128-00d1-4ac8-a988-bba280122f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:29:23.306624 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7b128-00d1-4ac8-a988-bba280122f09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:29:23.306912 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7b128-00d1-4ac8-a988-bba280122f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:29:23.307193 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7b128-00d1-4ac8-a988-bba280122f09 admin admin] PATH_INFO: `/v3/projects/f900cbd3c05f4c2aa14b71cd2ed39ce4/users/affb93636c744153bdd690fc590524d4/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:29:23.329203 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b7b128-00d1-4ac8-a988-bba280122f09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f900cbd3c05f4c2aa14b71cd2ed39ce4, user_id=affb93636c744153bdd690fc590524d4, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:29:23.336527 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b7b128-00d1-4ac8-a988-bba280122f09 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:29:23.362377 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1222/2458] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:29:23 2022] PUT /identity/v3/projects/f900cbd3c05f4c2aa14b71cd2ed39ce4/users/affb93636c744153bdd690fc590524d4/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:29:23.379666 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e299a96-cdd1-4502-8272-def93a5dcb2d None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:29:23.380125 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e299a96-cdd1-4502-8272-def93a5dcb2d None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:29:23.380603 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e299a96-cdd1-4502-8272-def93a5dcb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:29:23.424317 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-7e299a96-cdd1-4502-8272-def93a5dcb2d None None] MFA Rules not processed for user `affb93636c744153bdd690fc590524d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:29:23.426390 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7e299a96-cdd1-4502-8272-def93a5dcb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:29:23.534589 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1237/2459] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:29:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:29:23.551590 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b7b128-00d1-4ac8-a988-bba280122f09 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:29:23.555603 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-f7b7b128-00d1-4ac8-a988-bba280122f09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:29:23.671216 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b7b128-00d1-4ac8-a988-bba280122f09 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:29:23.678290 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c9013-24c2-43f0-b648-df545a895459 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:29:23.679327 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c9013-24c2-43f0-b648-df545a895459 service cinder] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:29:23.679813 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c9013-24c2-43f0-b648-df545a895459 service cinder] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:29:23.680240 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c9013-24c2-43f0-b648-df545a895459 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:29:23.695265 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c9013-24c2-43f0-b648-df545a895459 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:29:23.696740 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c9013-24c2-43f0-b648-df545a895459 service cinder] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:29:23.707875 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1223/2460] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:29:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:29:23.750661 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e299a96-cdd1-4502-8272-def93a5dcb2d None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:29:23.779410 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:29:23.857329 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e299a96-cdd1-4502-8272-def93a5dcb2d None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:29:23.862191 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4461f4f-3303-46bf-a848-8ba6ae5086cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:29:23.862901 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4461f4f-3303-46bf-a848-8ba6ae5086cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:29:23.863182 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4461f4f-3303-46bf-a848-8ba6ae5086cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:29:23.863448 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4461f4f-3303-46bf-a848-8ba6ae5086cd admin admin] PATH_INFO: `/v3/users/affb93636c744153bdd690fc590524d4` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:29:23.864669 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4461f4f-3303-46bf-a848-8ba6ae5086cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=affb93636c744153bdd690fc590524d4)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:29:23.866686 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4461f4f-3303-46bf-a848-8ba6ae5086cd admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:29:23.928854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a4461f4f-3303-46bf-a848-8ba6ae5086cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'affb93636c744153bdd690fc590524d4'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:29:23.939030 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a4461f4f-3303-46bf-a848-8ba6ae5086cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'affb93636c744153bdd690fc590524d4'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:29:23.952745 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a4461f4f-3303-46bf-a848-8ba6ae5086cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'affb93636c744153bdd690fc590524d4'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:29:23.953574 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a4461f4f-3303-46bf-a848-8ba6ae5086cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'affb93636c744153bdd690fc590524d4'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:29:23.963684 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-a4461f4f-3303-46bf-a848-8ba6ae5086cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'affb93636c744153bdd690fc590524d4'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:29:23.972405 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1238/2461] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:29:23 2022] DELETE /identity/v3/users/affb93636c744153bdd690fc590524d4 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:29:23.978408 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3ba6b-d42d-405b-9af2-457001dad255 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:29:23.978982 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3ba6b-d42d-405b-9af2-457001dad255 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:29:23.979447 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3ba6b-d42d-405b-9af2-457001dad255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:29:24.005444 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-acc3ba6b-d42d-405b-9af2-457001dad255 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:29:24.006786 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-acc3ba6b-d42d-405b-9af2-457001dad255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:29:24.083078 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1224/2462] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:29:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:29:24.093135 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4461f4f-3303-46bf-a848-8ba6ae5086cd admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:29:24.095529 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a4461f4f-3303-46bf-a848-8ba6ae5086cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:29:24.232323 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4461f4f-3303-46bf-a848-8ba6ae5086cd admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:29:24.243486 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ce9fb-52d8-4b1f-a50f-5bec9c2df91a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:29:24.244497 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ce9fb-52d8-4b1f-a50f-5bec9c2df91a service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:29:24.244983 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ce9fb-52d8-4b1f-a50f-5bec9c2df91a service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:29:24.245485 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ce9fb-52d8-4b1f-a50f-5bec9c2df91a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:29:24.264409 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955ce9fb-52d8-4b1f-a50f-5bec9c2df91a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:29:24.268207 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955ce9fb-52d8-4b1f-a50f-5bec9c2df91a service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:29:24.289150 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1239/2463] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:29:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:29:24.712655 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3ba6b-d42d-405b-9af2-457001dad255 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:29:24.716061 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-acc3ba6b-d42d-405b-9af2-457001dad255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:29:24.742346 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3ba6b-d42d-405b-9af2-457001dad255 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:29:24.750790 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f2102-512c-4b8e-99fa-29f99af631a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:29:24.751662 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f2102-512c-4b8e-99fa-29f99af631a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:29:24.752121 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f2102-512c-4b8e-99fa-29f99af631a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:29:24.752446 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f2102-512c-4b8e-99fa-29f99af631a0 admin admin] PATH_INFO: `/v3/projects/f900cbd3c05f4c2aa14b71cd2ed39ce4` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:29:24.753913 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1f2102-512c-4b8e-99fa-29f99af631a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f900cbd3c05f4c2aa14b71cd2ed39ce4)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:29:24.756646 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1f2102-512c-4b8e-99fa-29f99af631a0 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:29:24.816159 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-cf1f2102-512c-4b8e-99fa-29f99af631a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f900cbd3c05f4c2aa14b71cd2ed39ce4', 'request_id': 'req-cf1f2102-512c-4b8e-99fa-29f99af631a0'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:29:24.827261 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-cf1f2102-512c-4b8e-99fa-29f99af631a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f900cbd3c05f4c2aa14b71cd2ed39ce4', 'request_id': 'req-cf1f2102-512c-4b8e-99fa-29f99af631a0'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:29:24.835907 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:29:24.837775 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-cf1f2102-512c-4b8e-99fa-29f99af631a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f900cbd3c05f4c2aa14b71cd2ed39ce4', 'request_id': 'req-cf1f2102-512c-4b8e-99fa-29f99af631a0'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:29:24.858138 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-cf1f2102-512c-4b8e-99fa-29f99af631a0 admin admin] The token cache is being invalidate because project f900cbd3c05f4c2aa14b71cd2ed39ce4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:29:24.858627 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-cf1f2102-512c-4b8e-99fa-29f99af631a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:29:24.859434 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-cf1f2102-512c-4b8e-99fa-29f99af631a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:29:24.861082 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1225/2464] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:29:24 2022] DELETE /identity/v3/projects/f900cbd3c05f4c2aa14b71cd2ed39ce4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:29:34.278163 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:29:34.509569 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173eca13-7b51-4753-bc16-0c6032c7464d None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:29:34.509852 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173eca13-7b51-4753-bc16-0c6032c7464d None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:29:34.510098 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173eca13-7b51-4753-bc16-0c6032c7464d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:29:34.555089 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-173eca13-7b51-4753-bc16-0c6032c7464d None None] MFA Rules not processed for user `bbd7a1d5a8d04e3798ffcab27bad936b`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:29:34.556483 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-173eca13-7b51-4753-bc16-0c6032c7464d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:29:34.660317 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1240/2465] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Sep 21 12:29:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:29:34.735671 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f2102-512c-4b8e-99fa-29f99af631a0 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:29:34.737557 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-cf1f2102-512c-4b8e-99fa-29f99af631a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:29:34.854557 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f2102-512c-4b8e-99fa-29f99af631a0 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:29:34.863792 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc7c21-6d37-4085-90ab-6c39a1698eb1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc2bab11b264196859802907b93ac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:29:34.864908 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc7c21-6d37-4085-90ab-6c39a1698eb1 service swift] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:29:34.865429 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc7c21-6d37-4085-90ab-6c39a1698eb1 service swift] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:29:34.865929 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc7c21-6d37-4085-90ab-6c39a1698eb1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:29:34.882071 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc7c21-6d37-4085-90ab-6c39a1698eb1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:29:34.884513 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc7c21-6d37-4085-90ab-6c39a1698eb1 service swift] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:29:34.896469 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1226/2466] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Sep 21 12:29:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 21 12:29:44.648301 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=32 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:29:44.892351 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=36 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:29:51.242027 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e799b-4292-41da-a19a-22d1cdb57521 None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:29:51.242911 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e799b-4292-41da-a19a-22d1cdb57521 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:29:51.242911 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e799b-4292-41da-a19a-22d1cdb57521 None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:29:51.244018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1241/2467] 10.222.0.60 () {54 vars in 921 bytes} [Wed Sep 21 12:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:29:51.251634 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a587d0-29a4-428f-a7f8-16c07e5c31c0 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:29:51.252539 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a587d0-29a4-428f-a7f8-16c07e5c31c0 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:29:51.252539 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a587d0-29a4-428f-a7f8-16c07e5c31c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:29:51.299960 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-d4a587d0-29a4-428f-a7f8-16c07e5c31c0 None None] MFA Rules not processed for user `6cb4001f94b8439180ca2a93d3b279b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:29:51.301464 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-d4a587d0-29a4-428f-a7f8-16c07e5c31c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:29:51.434924 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1227/2468] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Sep 21 12:29:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:29:51.450785 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e799b-4292-41da-a19a-22d1cdb57521 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:29:51.452923 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-6f5e799b-4292-41da-a19a-22d1cdb57521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:29:51.520255 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e799b-4292-41da-a19a-22d1cdb57521 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:29:51.524503 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eeba5c-2693-4525-9909-07f84c230d16 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c513a6c91a0240de87c7b51b07617827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:29:51.525134 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eeba5c-2693-4525-9909-07f84c230d16 service glance] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:29:51.525418 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eeba5c-2693-4525-9909-07f84c230d16 service glance] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:29:51.525731 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eeba5c-2693-4525-9909-07f84c230d16 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:29:51.541240 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eeba5c-2693-4525-9909-07f84c230d16 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:29:51.542766 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eeba5c-2693-4525-9909-07f84c230d16 service glance] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:29:51.555875 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1242/2469] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:29:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:29:51.637700 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e366ec8-469e-41f9-9537-28abc9648e34 None None] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:29:51.637984 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e366ec8-469e-41f9-9537-28abc9648e34 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:29:51.638252 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e366ec8-469e-41f9-9537-28abc9648e34 None None] PATH_INFO: `/` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:29:51.639716 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1228/2470] 10.222.0.60 () {54 vars in 921 bytes} [Wed Sep 21 12:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 21 12:29:51.646228 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6b5d6-d7af-450b-8ce9-4bd97a7836d1 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:29:51.646663 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6b5d6-d7af-450b-8ce9-4bd97a7836d1 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:29:51.647004 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6b5d6-d7af-450b-8ce9-4bd97a7836d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:29:51.671248 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-edc6b5d6-d7af-450b-8ce9-4bd97a7836d1 None None] MFA Rules not processed for user `ab0521c25c2d4417944efa4745588f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:29:51.673960 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-edc6b5d6-d7af-450b-8ce9-4bd97a7836d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:29:51.741544 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1243/2471] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Sep 21 12:29:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:29:51.755012 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e366ec8-469e-41f9-9537-28abc9648e34 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:29:51.756872 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-6e366ec8-469e-41f9-9537-28abc9648e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:29:51.771807 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e366ec8-469e-41f9-9537-28abc9648e34 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:29:51.776021 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef92a0-26b9-42e5-af89-34165df9a816 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:29:51.776647 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef92a0-26b9-42e5-af89-34165df9a816 service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:29:51.776926 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef92a0-26b9-42e5-af89-34165df9a816 service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:29:51.777200 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef92a0-26b9-42e5-af89-34165df9a816 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:29:51.785465 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef92a0-26b9-42e5-af89-34165df9a816 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:29:51.786974 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef92a0-26b9-42e5-af89-34165df9a816 service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:29:51.796305 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1229/2472] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:29:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:29:51.904488 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e015f6-b362-4c6f-a609-a2d3ad36b4ad None None] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:29:51.904758 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e015f6-b362-4c6f-a609-a2d3ad36b4ad None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:29:51.905038 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e015f6-b362-4c6f-a609-a2d3ad36b4ad None None] PATH_INFO: `/` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:29:51.907149 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1244/2473] 10.222.0.60 () {54 vars in 921 bytes} [Wed Sep 21 12:29:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 21 12:29:51.914106 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8174f-5eac-49fd-8705-75015517611d None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:29:51.914555 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8174f-5eac-49fd-8705-75015517611d None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:29:51.914871 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8174f-5eac-49fd-8705-75015517611d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:29:51.936114 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-0da8174f-5eac-49fd-8705-75015517611d None None] MFA Rules not processed for user `6cb4001f94b8439180ca2a93d3b279b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:29:51.938011 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-0da8174f-5eac-49fd-8705-75015517611d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:29:51.948734 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1230/2474] 10.222.0.60 () {58 vars in 1018 bytes} [Wed Sep 21 12:29:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:29:51.960568 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e015f6-b362-4c6f-a609-a2d3ad36b4ad None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:29:51.972627 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e015f6-b362-4c6f-a609-a2d3ad36b4ad None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:29:51.976383 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76414d56-0d4d-4086-8b62-0115158d409b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:29:51.976993 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76414d56-0d4d-4086-8b62-0115158d409b service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:29:51.977269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76414d56-0d4d-4086-8b62-0115158d409b service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:29:51.977536 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76414d56-0d4d-4086-8b62-0115158d409b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:29:51.988898 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76414d56-0d4d-4086-8b62-0115158d409b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:29:51.990694 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76414d56-0d4d-4086-8b62-0115158d409b service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:29:52.003750 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1245/2475] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:29:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:29:54.245824 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450244e-666d-46b3-a382-2376540a5b58 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:29:54.246479 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450244e-666d-46b3-a382-2376540a5b58 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:29:54.246479 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450244e-666d-46b3-a382-2376540a5b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:29:54.268027 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-f450244e-666d-46b3-a382-2376540a5b58 None None] MFA Rules not processed for user `bbd7a1d5a8d04e3798ffcab27bad936b`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:29:54.269580 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-f450244e-666d-46b3-a382-2376540a5b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:29:54.278164 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1231/2476] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Sep 21 12:29:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:29:54.291727 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76414d56-0d4d-4086-8b62-0115158d409b service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:29:54.312932 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76414d56-0d4d-4086-8b62-0115158d409b service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:29:54.321813 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63903357-01b5-4144-8fe6-ad3ac521ac8f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc2bab11b264196859802907b93ac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:29:54.322841 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63903357-01b5-4144-8fe6-ad3ac521ac8f service swift] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:29:54.323250 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63903357-01b5-4144-8fe6-ad3ac521ac8f service swift] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:29:54.323664 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63903357-01b5-4144-8fe6-ad3ac521ac8f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:29:54.339455 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63903357-01b5-4144-8fe6-ad3ac521ac8f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:29:54.342486 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63903357-01b5-4144-8fe6-ad3ac521ac8f service swift] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:29:54.358023 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1246/2477] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Sep 21 12:29:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 12:30:04.261241 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=52 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:30:04.352961 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=61 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:30:14.748017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afade7f-8e10-40f4-8cd3-163e93dbd438 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:14.748686 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afade7f-8e10-40f4-8cd3-163e93dbd438 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:14.749001 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afade7f-8e10-40f4-8cd3-163e93dbd438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:14.775126 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-2afade7f-8e10-40f4-8cd3-163e93dbd438 None None] MFA Rules not processed for user `bbd7a1d5a8d04e3798ffcab27bad936b`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:30:14.777008 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-2afade7f-8e10-40f4-8cd3-163e93dbd438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:30:14.788267 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1232/2478] 10.222.0.60 () {58 vars in 967 bytes} [Wed Sep 21 12:30:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:30:14.807384 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63903357-01b5-4144-8fe6-ad3ac521ac8f service swift] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:14.820529 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63903357-01b5-4144-8fe6-ad3ac521ac8f service swift] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:14.827867 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca93898-bb24-4373-af7a-958d5eb4f49c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc2bab11b264196859802907b93ac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:14.828531 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca93898-bb24-4373-af7a-958d5eb4f49c service swift] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:14.828814 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca93898-bb24-4373-af7a-958d5eb4f49c service swift] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:14.829111 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca93898-bb24-4373-af7a-958d5eb4f49c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:14.838699 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca93898-bb24-4373-af7a-958d5eb4f49c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:14.840304 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca93898-bb24-4373-af7a-958d5eb4f49c service swift] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:14.850785 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1247/2479] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Sep 21 12:30:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 21 12:30:24.768276 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=3 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:30:24.848541 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=6 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:30:26.219793 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afade7f-8e10-40f4-8cd3-163e93dbd438 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:26.222003 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-2afade7f-8e10-40f4-8cd3-163e93dbd438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:30:26.396117 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afade7f-8e10-40f4-8cd3-163e93dbd438 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:26.405935 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561344c-fdbe-4117-a4cd-1ba2abf7aa5c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e866f134f64644bf33e3adecf207c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:26.407014 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561344c-fdbe-4117-a4cd-1ba2abf7aa5c service placement] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:26.407499 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561344c-fdbe-4117-a4cd-1ba2abf7aa5c service placement] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:26.407978 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561344c-fdbe-4117-a4cd-1ba2abf7aa5c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:26.411403 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-d561344c-fdbe-4117-a4cd-1ba2abf7aa5c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:30:26.432422 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d561344c-fdbe-4117-a4cd-1ba2abf7aa5c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:26.435662 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d561344c-fdbe-4117-a4cd-1ba2abf7aa5c service placement] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:26.454351 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1233/2480] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:30:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:30:33.863537 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca93898-bb24-4373-af7a-958d5eb4f49c service swift] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:33.865071 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-0ca93898-bb24-4373-af7a-958d5eb4f49c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:30:33.879425 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca93898-bb24-4373-af7a-958d5eb4f49c service swift] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:33.883637 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cda311-fa37-4be4-b226-cef3fc082d0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:33.884300 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cda311-fa37-4be4-b226-cef3fc082d0d service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:33.884640 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cda311-fa37-4be4-b226-cef3fc082d0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:33.884968 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cda311-fa37-4be4-b226-cef3fc082d0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:33.887022 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-31cda311-fa37-4be4-b226-cef3fc082d0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:30:33.989484 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cda311-fa37-4be4-b226-cef3fc082d0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:33.991010 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cda311-fa37-4be4-b226-cef3fc082d0d service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:34.003937 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1248/2481] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:30:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:30:36.447662 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=41 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:30:38.091366 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561344c-fdbe-4117-a4cd-1ba2abf7aa5c service placement] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:38.101642 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-d561344c-fdbe-4117-a4cd-1ba2abf7aa5c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:30:38.124919 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561344c-fdbe-4117-a4cd-1ba2abf7aa5c service placement] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:38.135211 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac3741-b800-47cd-889e-9574d153750e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e866f134f64644bf33e3adecf207c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:38.136419 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac3741-b800-47cd-889e-9574d153750e service placement] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:38.137012 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac3741-b800-47cd-889e-9574d153750e service placement] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:38.137632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac3741-b800-47cd-889e-9574d153750e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:38.141621 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-e9ac3741-b800-47cd-889e-9574d153750e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:30:38.169404 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac3741-b800-47cd-889e-9574d153750e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:38.175313 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cda311-fa37-4be4-b226-cef3fc082d0d service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:38.177051 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac3741-b800-47cd-889e-9574d153750e service placement] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:38.177599 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-31cda311-fa37-4be4-b226-cef3fc082d0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:30:38.199392 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cda311-fa37-4be4-b226-cef3fc082d0d service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:38.200659 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1234/2482] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:30:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:30:38.221525 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267382f9-1784-41f9-9b28-bc23f4480d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:38.222182 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267382f9-1784-41f9-9b28-bc23f4480d04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:38.222490 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267382f9-1784-41f9-9b28-bc23f4480d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:38.222763 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267382f9-1784-41f9-9b28-bc23f4480d04 admin admin] PATH_INFO: `/v3/users/a55997792b7843439d62ef7d5245382b` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:38.227063 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267382f9-1784-41f9-9b28-bc23f4480d04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a55997792b7843439d62ef7d5245382b)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:38.229150 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267382f9-1784-41f9-9b28-bc23f4480d04 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:38.308640 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-267382f9-1784-41f9-9b28-bc23f4480d04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a55997792b7843439d62ef7d5245382b'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:38.322270 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-267382f9-1784-41f9-9b28-bc23f4480d04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a55997792b7843439d62ef7d5245382b'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:38.340691 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-267382f9-1784-41f9-9b28-bc23f4480d04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a55997792b7843439d62ef7d5245382b'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:38.341841 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-267382f9-1784-41f9-9b28-bc23f4480d04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a55997792b7843439d62ef7d5245382b'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:38.352754 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-267382f9-1784-41f9-9b28-bc23f4480d04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a55997792b7843439d62ef7d5245382b'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:38.362088 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1249/2483] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:30:38 2022] DELETE /identity/v3/users/a55997792b7843439d62ef7d5245382b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:30:38.603258 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac3741-b800-47cd-889e-9574d153750e service placement] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:38.625075 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac3741-b800-47cd-889e-9574d153750e service placement] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:38.699413 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630d89b-fed9-400f-b5ad-f6aa5e534bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:38.700357 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630d89b-fed9-400f-b5ad-f6aa5e534bd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:38.700835 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630d89b-fed9-400f-b5ad-f6aa5e534bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:38.701876 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630d89b-fed9-400f-b5ad-f6aa5e534bd9 admin admin] PATH_INFO: `/v3/projects/280996f37cda406ab3d23f5cb0911dd1` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:38.703888 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630d89b-fed9-400f-b5ad-f6aa5e534bd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=280996f37cda406ab3d23f5cb0911dd1)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:38.705978 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630d89b-fed9-400f-b5ad-f6aa5e534bd9 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:38.763603 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-3630d89b-fed9-400f-b5ad-f6aa5e534bd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '280996f37cda406ab3d23f5cb0911dd1', 'request_id': 'req-3630d89b-fed9-400f-b5ad-f6aa5e534bd9'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:38.773584 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-3630d89b-fed9-400f-b5ad-f6aa5e534bd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '280996f37cda406ab3d23f5cb0911dd1', 'request_id': 'req-3630d89b-fed9-400f-b5ad-f6aa5e534bd9'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:38.780854 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-3630d89b-fed9-400f-b5ad-f6aa5e534bd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '280996f37cda406ab3d23f5cb0911dd1', 'request_id': 'req-3630d89b-fed9-400f-b5ad-f6aa5e534bd9'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:38.794722 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-3630d89b-fed9-400f-b5ad-f6aa5e534bd9 admin admin] The token cache is being invalidate because project 280996f37cda406ab3d23f5cb0911dd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:30:38.795599 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-3630d89b-fed9-400f-b5ad-f6aa5e534bd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:38.796471 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-3630d89b-fed9-400f-b5ad-f6aa5e534bd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:38.798061 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1235/2484] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:30:38 2022] DELETE /identity/v3/projects/280996f37cda406ab3d23f5cb0911dd1 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:30:38.803728 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d44bd-5ab7-4c1d-a4c5-7a4971315971 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:38.804372 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d44bd-5ab7-4c1d-a4c5-7a4971315971 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:38.804746 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d44bd-5ab7-4c1d-a4c5-7a4971315971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:38.956756 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-159d44bd-5ab7-4c1d-a4c5-7a4971315971 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:30:38.958011 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-159d44bd-5ab7-4c1d-a4c5-7a4971315971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:30:39.029166 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1250/2485] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:30:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:30:39.039062 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709f3e6-38b8-45b8-8a3e-191d446a3aaa None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:39.039564 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709f3e6-38b8-45b8-8a3e-191d446a3aaa None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:39.040060 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709f3e6-38b8-45b8-8a3e-191d446a3aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:39.074253 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-8709f3e6-38b8-45b8-8a3e-191d446a3aaa None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:30:39.077049 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-8709f3e6-38b8-45b8-8a3e-191d446a3aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:30:39.092577 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1236/2486] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:30:39.097296 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d44bd-5ab7-4c1d-a4c5-7a4971315971 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:39.108768 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d44bd-5ab7-4c1d-a4c5-7a4971315971 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:39.113819 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d49612-2b5b-4606-8aba-33408e2cc794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:39.114500 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d49612-2b5b-4606-8aba-33408e2cc794 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:39.114792 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d49612-2b5b-4606-8aba-33408e2cc794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:39.115059 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d49612-2b5b-4606-8aba-33408e2cc794 admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:39.115728 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d49612-2b5b-4606-8aba-33408e2cc794 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:30:39.116029 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d49612-2b5b-4606-8aba-33408e2cc794 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:39.117710 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d49612-2b5b-4606-8aba-33408e2cc794 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:39.119714 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:30:39.136457 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1251/2487] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:30:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:30:39.142481 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8709f3e6-38b8-45b8-8a3e-191d446a3aaa None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:39.161031 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8709f3e6-38b8-45b8-8a3e-191d446a3aaa None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:39.169193 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55c4586-5154-4aa4-945d-00f785dd86af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:39.170980 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c4586-5154-4aa4-945d-00f785dd86af admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:39.171471 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c4586-5154-4aa4-945d-00f785dd86af admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:39.171951 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c4586-5154-4aa4-945d-00f785dd86af admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:39.173124 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55c4586-5154-4aa4-945d-00f785dd86af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:39.176933 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55c4586-5154-4aa4-945d-00f785dd86af admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:39.229239 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1237/2488] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:30:39 2022] POST /identity/v3/projects => generated 403 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:30:39.234503 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d49612-2b5b-4606-8aba-33408e2cc794 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:39.246886 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d49612-2b5b-4606-8aba-33408e2cc794 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:39.321708 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a0409-c22b-4e9a-9667-ae2f53c058fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:39.322327 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a0409-c22b-4e9a-9667-ae2f53c058fe admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:39.322637 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a0409-c22b-4e9a-9667-ae2f53c058fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:39.322905 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a0409-c22b-4e9a-9667-ae2f53c058fe admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:39.323562 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676a0409-c22b-4e9a-9667-ae2f53c058fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:39.325527 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676a0409-c22b-4e9a-9667-ae2f53c058fe admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:39.353112 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1252/2489] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:30:39 2022] POST /identity/v3/users => generated 302 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:30:39.360395 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55c4586-5154-4aa4-945d-00f785dd86af admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:39.372677 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55c4586-5154-4aa4-945d-00f785dd86af admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:39.377855 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b3e72-9fd8-4a89-b0db-34aa802b92a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:39.378534 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b3e72-9fd8-4a89-b0db-34aa802b92a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:39.378812 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b3e72-9fd8-4a89-b0db-34aa802b92a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:39.379082 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b3e72-9fd8-4a89-b0db-34aa802b92a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:39.379748 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b3e72-9fd8-4a89-b0db-34aa802b92a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:39.381407 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b3e72-9fd8-4a89-b0db-34aa802b92a7 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:39.392948 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1238/2490] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:30:39.397706 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a0409-c22b-4e9a-9667-ae2f53c058fe admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:39.409892 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a0409-c22b-4e9a-9667-ae2f53c058fe admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:39.415206 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb35bc-3a1f-4bfe-bd0a-19dab697c9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:39.416132 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb35bc-3a1f-4bfe-bd0a-19dab697c9a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:39.416474 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb35bc-3a1f-4bfe-bd0a-19dab697c9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:39.416784 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb35bc-3a1f-4bfe-bd0a-19dab697c9a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:39.417665 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb35bc-3a1f-4bfe-bd0a-19dab697c9a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:39.419416 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb35bc-3a1f-4bfe-bd0a-19dab697c9a5 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:39.433016 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1253/2491] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:30:39.439672 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b3e72-9fd8-4a89-b0db-34aa802b92a7 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:39.451262 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b3e72-9fd8-4a89-b0db-34aa802b92a7 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:39.457461 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895eb83-7683-4a3e-800f-d7afd02e422d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:39.458187 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895eb83-7683-4a3e-800f-d7afd02e422d admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:39.458486 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895eb83-7683-4a3e-800f-d7afd02e422d admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:39.458767 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895eb83-7683-4a3e-800f-d7afd02e422d admin admin] PATH_INFO: `/v3/projects/90ea52a87b9442e4a5254b85e84b721f/users/df5e8df688374b99bc8c23132c3ff5d2/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:39.476667 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895eb83-7683-4a3e-800f-d7afd02e422d admin admin] RBAC: Authorizing `identity:create_grant(project_id=90ea52a87b9442e4a5254b85e84b721f, user_id=df5e8df688374b99bc8c23132c3ff5d2, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:39.479718 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895eb83-7683-4a3e-800f-d7afd02e422d admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:39.495756 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1239/2492] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:30:39 2022] PUT /identity/v3/projects/90ea52a87b9442e4a5254b85e84b721f/users/df5e8df688374b99bc8c23132c3ff5d2/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:30:39.503691 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46174dc-4c02-4c6b-a4c0-3651048e04d4 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:39.503997 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46174dc-4c02-4c6b-a4c0-3651048e04d4 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:39.504229 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46174dc-4c02-4c6b-a4c0-3651048e04d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:39.534925 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-f46174dc-4c02-4c6b-a4c0-3651048e04d4 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:30:39.537058 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f46174dc-4c02-4c6b-a4c0-3651048e04d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:30:39.631714 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1254/2493] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:30:39.644394 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895eb83-7683-4a3e-800f-d7afd02e422d admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:39.646917 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-6895eb83-7683-4a3e-800f-d7afd02e422d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:30:39.673824 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:30:39.748730 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895eb83-7683-4a3e-800f-d7afd02e422d admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:39.752685 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c784c2-6c7d-44b4-84d4-6a4ff47957b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:39.753453 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c784c2-6c7d-44b4-84d4-6a4ff47957b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:39.753853 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c784c2-6c7d-44b4-84d4-6a4ff47957b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:39.754170 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c784c2-6c7d-44b4-84d4-6a4ff47957b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:39.766263 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c784c2-6c7d-44b4-84d4-6a4ff47957b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:39.767967 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c784c2-6c7d-44b4-84d4-6a4ff47957b0 service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:39.780982 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1240/2494] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:30:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:30:40.701625 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f87e7b-78cf-4a67-b4ba-7b9d5d898c5d None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:40.702975 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f87e7b-78cf-4a67-b4ba-7b9d5d898c5d None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:40.703458 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f87e7b-78cf-4a67-b4ba-7b9d5d898c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:40.753956 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-b4f87e7b-78cf-4a67-b4ba-7b9d5d898c5d None None] MFA Rules not processed for user `df5e8df688374b99bc8c23132c3ff5d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:30:40.757485 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b4f87e7b-78cf-4a67-b4ba-7b9d5d898c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:30:40.887364 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1255/2495] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:30:40 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:30:40.894567 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c784c2-6c7d-44b4-84d4-6a4ff47957b0 service neutron] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:40.914286 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c784c2-6c7d-44b4-84d4-6a4ff47957b0 service neutron] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:40.924252 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d24b75-6207-4ef6-867c-3a1805d370c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:40.926208 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d24b75-6207-4ef6-867c-3a1805d370c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:40.926208 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d24b75-6207-4ef6-867c-3a1805d370c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:40.926781 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d24b75-6207-4ef6-867c-3a1805d370c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:40.928350 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d24b75-6207-4ef6-867c-3a1805d370c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:40.932543 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d24b75-6207-4ef6-867c-3a1805d370c1 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:40.990072 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1241/2496] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:30:40 2022] POST /identity/v3/projects => generated 399 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:30:40.996216 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f87e7b-78cf-4a67-b4ba-7b9d5d898c5d None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:41.007173 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:30:41.028018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f87e7b-78cf-4a67-b4ba-7b9d5d898c5d None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:41.121499 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4085e-39f9-4634-a9ca-bdc6f711f999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:41.122019 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4085e-39f9-4634-a9ca-bdc6f711f999 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:41.122525 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4085e-39f9-4634-a9ca-bdc6f711f999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:41.122721 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4085e-39f9-4634-a9ca-bdc6f711f999 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:41.123289 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4085e-39f9-4634-a9ca-bdc6f711f999 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:41.125242 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4085e-39f9-4634-a9ca-bdc6f711f999 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:41.155950 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1256/2497] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:30:40 2022] POST /identity/v3/users => generated 306 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:30:41.157190 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d24b75-6207-4ef6-867c-3a1805d370c1 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:41.169607 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d24b75-6207-4ef6-867c-3a1805d370c1 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:41.175508 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388dd291-296d-49ed-a675-cbfd8e864cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:41.176133 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388dd291-296d-49ed-a675-cbfd8e864cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:41.176412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388dd291-296d-49ed-a675-cbfd8e864cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:41.176682 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388dd291-296d-49ed-a675-cbfd8e864cd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:41.177368 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388dd291-296d-49ed-a675-cbfd8e864cd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:41.179073 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388dd291-296d-49ed-a675-cbfd8e864cd7 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:41.191789 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1242/2498] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:30:41.196277 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4085e-39f9-4634-a9ca-bdc6f711f999 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:41.217544 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4085e-39f9-4634-a9ca-bdc6f711f999 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:41.225786 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683eb10-b5ee-417c-a4c1-6fb3cfc039d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:41.227026 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683eb10-b5ee-417c-a4c1-6fb3cfc039d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:41.227595 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683eb10-b5ee-417c-a4c1-6fb3cfc039d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:41.228147 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683eb10-b5ee-417c-a4c1-6fb3cfc039d8 admin admin] PATH_INFO: `/v3/projects/50f9dc7f7b9e46c3ad3fc3ee110c1b81/users/6e8c8054b42b453fa1e7fe7a45362097/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:41.257629 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1683eb10-b5ee-417c-a4c1-6fb3cfc039d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50f9dc7f7b9e46c3ad3fc3ee110c1b81, user_id=6e8c8054b42b453fa1e7fe7a45362097, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:41.262086 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1683eb10-b5ee-417c-a4c1-6fb3cfc039d8 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:41.281504 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1257/2499] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:30:41 2022] PUT /identity/v3/projects/50f9dc7f7b9e46c3ad3fc3ee110c1b81/users/6e8c8054b42b453fa1e7fe7a45362097/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:30:41.286029 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388dd291-296d-49ed-a675-cbfd8e864cd7 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:41.300961 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388dd291-296d-49ed-a675-cbfd8e864cd7 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:41.380574 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81afcb5f-cdcb-48f9-a636-8da77684e1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:41.381114 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81afcb5f-cdcb-48f9-a636-8da77684e1c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:41.381490 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81afcb5f-cdcb-48f9-a636-8da77684e1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:41.381668 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81afcb5f-cdcb-48f9-a636-8da77684e1c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:41.382319 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81afcb5f-cdcb-48f9-a636-8da77684e1c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:41.384054 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81afcb5f-cdcb-48f9-a636-8da77684e1c0 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:41.398436 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1243/2500] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:30:41.403243 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683eb10-b5ee-417c-a4c1-6fb3cfc039d8 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:41.415834 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683eb10-b5ee-417c-a4c1-6fb3cfc039d8 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:41.421373 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb90ff-7c34-4f06-9d1b-e098b43189d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:41.422179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb90ff-7c34-4f06-9d1b-e098b43189d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:41.422330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb90ff-7c34-4f06-9d1b-e098b43189d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:41.422713 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb90ff-7c34-4f06-9d1b-e098b43189d1 admin admin] PATH_INFO: `/v3/projects/50f9dc7f7b9e46c3ad3fc3ee110c1b81/users/6e8c8054b42b453fa1e7fe7a45362097/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:41.425003 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb90ff-7c34-4f06-9d1b-e098b43189d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50f9dc7f7b9e46c3ad3fc3ee110c1b81, user_id=6e8c8054b42b453fa1e7fe7a45362097, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:41.428172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb90ff-7c34-4f06-9d1b-e098b43189d1 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:41.444416 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1258/2501] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:30:41 2022] PUT /identity/v3/projects/50f9dc7f7b9e46c3ad3fc3ee110c1b81/users/6e8c8054b42b453fa1e7fe7a45362097/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:30:42.369942 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e66b2-a64e-45dc-ba73-3cebef4ece11 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:42.370891 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e66b2-a64e-45dc-ba73-3cebef4ece11 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:42.370891 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e66b2-a64e-45dc-ba73-3cebef4ece11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:42.409096 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-434e66b2-a64e-45dc-ba73-3cebef4ece11 None None] MFA Rules not processed for user `6e8c8054b42b453fa1e7fe7a45362097`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:30:42.411462 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-434e66b2-a64e-45dc-ba73-3cebef4ece11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:30:42.530418 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1244/2502] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:30:42 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:30:43.224215 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb90ff-7c34-4f06-9d1b-e098b43189d1 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:43.227322 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-4eeb90ff-7c34-4f06-9d1b-e098b43189d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:30:43.379576 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb90ff-7c34-4f06-9d1b-e098b43189d1 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:43.386149 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae151197-56e9-438b-81ce-79f146c0d375 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e866f134f64644bf33e3adecf207c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:43.386825 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae151197-56e9-438b-81ce-79f146c0d375 service placement] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:43.387099 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae151197-56e9-438b-81ce-79f146c0d375 service placement] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:43.387366 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae151197-56e9-438b-81ce-79f146c0d375 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:43.389655 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ae151197-56e9-438b-81ce-79f146c0d375 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:30:43.404890 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae151197-56e9-438b-81ce-79f146c0d375 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:43.407527 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae151197-56e9-438b-81ce-79f146c0d375 service placement] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:43.420827 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1259/2503] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:30:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:30:44.132424 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e66b2-a64e-45dc-ba73-3cebef4ece11 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:44.141557 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:30:44.229631 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e66b2-a64e-45dc-ba73-3cebef4ece11 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:44.239312 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5740c03-262d-4651-81ef-779d6e713aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:44.240338 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5740c03-262d-4651-81ef-779d6e713aff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:44.240823 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5740c03-262d-4651-81ef-779d6e713aff admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:44.241261 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5740c03-262d-4651-81ef-779d6e713aff admin admin] PATH_INFO: `/v3/users/df5e8df688374b99bc8c23132c3ff5d2` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:44.243268 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5740c03-262d-4651-81ef-779d6e713aff admin admin] RBAC: Authorizing `identity:delete_user(user_id=df5e8df688374b99bc8c23132c3ff5d2)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:44.247136 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5740c03-262d-4651-81ef-779d6e713aff admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:44.323796 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-c5740c03-262d-4651-81ef-779d6e713aff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df5e8df688374b99bc8c23132c3ff5d2'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:44.344596 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-c5740c03-262d-4651-81ef-779d6e713aff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df5e8df688374b99bc8c23132c3ff5d2'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:44.356429 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-c5740c03-262d-4651-81ef-779d6e713aff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df5e8df688374b99bc8c23132c3ff5d2'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:44.357297 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-c5740c03-262d-4651-81ef-779d6e713aff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df5e8df688374b99bc8c23132c3ff5d2'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:44.369290 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-c5740c03-262d-4651-81ef-779d6e713aff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df5e8df688374b99bc8c23132c3ff5d2'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:44.380224 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1245/2504] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:30:44 2022] DELETE /identity/v3/users/df5e8df688374b99bc8c23132c3ff5d2 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:30:44.893868 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae151197-56e9-438b-81ce-79f146c0d375 service placement] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:44.921625 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae151197-56e9-438b-81ce-79f146c0d375 service placement] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:45.007766 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:30:45.042068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3c9bd-07cd-48f3-bfd9-56449194ac06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:45.043677 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3c9bd-07cd-48f3-bfd9-56449194ac06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:45.044171 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3c9bd-07cd-48f3-bfd9-56449194ac06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:45.045143 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3c9bd-07cd-48f3-bfd9-56449194ac06 admin admin] PATH_INFO: `/v3/projects/90ea52a87b9442e4a5254b85e84b721f` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:45.047464 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3c9bd-07cd-48f3-bfd9-56449194ac06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90ea52a87b9442e4a5254b85e84b721f)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:45.051469 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3c9bd-07cd-48f3-bfd9-56449194ac06 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:45.135010 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-b5a3c9bd-07cd-48f3-bfd9-56449194ac06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90ea52a87b9442e4a5254b85e84b721f', 'request_id': 'req-b5a3c9bd-07cd-48f3-bfd9-56449194ac06'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:45.149769 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-b5a3c9bd-07cd-48f3-bfd9-56449194ac06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90ea52a87b9442e4a5254b85e84b721f', 'request_id': 'req-b5a3c9bd-07cd-48f3-bfd9-56449194ac06'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:45.161572 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-b5a3c9bd-07cd-48f3-bfd9-56449194ac06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90ea52a87b9442e4a5254b85e84b721f', 'request_id': 'req-b5a3c9bd-07cd-48f3-bfd9-56449194ac06'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:45.184321 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-b5a3c9bd-07cd-48f3-bfd9-56449194ac06 admin admin] The token cache is being invalidate because project 90ea52a87b9442e4a5254b85e84b721f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:30:45.184847 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-b5a3c9bd-07cd-48f3-bfd9-56449194ac06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:45.186550 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-b5a3c9bd-07cd-48f3-bfd9-56449194ac06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:45.189484 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1260/2505] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:30:44 2022] DELETE /identity/v3/projects/90ea52a87b9442e4a5254b85e84b721f => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:30:45.194808 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5740c03-262d-4651-81ef-779d6e713aff admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:45.197369 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-c5740c03-262d-4651-81ef-779d6e713aff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:30:45.223143 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5740c03-262d-4651-81ef-779d6e713aff admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:45.314612 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b14169-6553-4fa4-8b86-30fbe642702c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:45.315388 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b14169-6553-4fa4-8b86-30fbe642702c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:45.315784 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b14169-6553-4fa4-8b86-30fbe642702c admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:45.316134 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b14169-6553-4fa4-8b86-30fbe642702c admin admin] PATH_INFO: `/v3/users/6e8c8054b42b453fa1e7fe7a45362097` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:45.317555 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b14169-6553-4fa4-8b86-30fbe642702c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e8c8054b42b453fa1e7fe7a45362097)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:45.320494 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b14169-6553-4fa4-8b86-30fbe642702c admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:45.369437 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:30:45.411122 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-e8b14169-6553-4fa4-8b86-30fbe642702c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e8c8054b42b453fa1e7fe7a45362097'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:45.430678 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-e8b14169-6553-4fa4-8b86-30fbe642702c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e8c8054b42b453fa1e7fe7a45362097'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:45.439827 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-e8b14169-6553-4fa4-8b86-30fbe642702c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e8c8054b42b453fa1e7fe7a45362097'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:45.440690 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-e8b14169-6553-4fa4-8b86-30fbe642702c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e8c8054b42b453fa1e7fe7a45362097'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:45.452600 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-e8b14169-6553-4fa4-8b86-30fbe642702c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e8c8054b42b453fa1e7fe7a45362097'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:45.460054 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1246/2506] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:30:45 2022] DELETE /identity/v3/users/6e8c8054b42b453fa1e7fe7a45362097 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:30:45.712106 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3c9bd-07cd-48f3-bfd9-56449194ac06 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:45.715998 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b5a3c9bd-07cd-48f3-bfd9-56449194ac06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:30:45.745435 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3c9bd-07cd-48f3-bfd9-56449194ac06 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:45.875416 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd89ea-7319-45de-bf29-869b50525890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:45.876448 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd89ea-7319-45de-bf29-869b50525890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:45.876918 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd89ea-7319-45de-bf29-869b50525890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:45.877401 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd89ea-7319-45de-bf29-869b50525890 admin admin] PATH_INFO: `/v3/projects/50f9dc7f7b9e46c3ad3fc3ee110c1b81` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:45.879859 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd89ea-7319-45de-bf29-869b50525890 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50f9dc7f7b9e46c3ad3fc3ee110c1b81)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:45.883140 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd89ea-7319-45de-bf29-869b50525890 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:45.972320 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-bacd89ea-7319-45de-bf29-869b50525890 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50f9dc7f7b9e46c3ad3fc3ee110c1b81', 'request_id': 'req-bacd89ea-7319-45de-bf29-869b50525890'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:45.985112 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-bacd89ea-7319-45de-bf29-869b50525890 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50f9dc7f7b9e46c3ad3fc3ee110c1b81', 'request_id': 'req-bacd89ea-7319-45de-bf29-869b50525890'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:45.995831 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-bacd89ea-7319-45de-bf29-869b50525890 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50f9dc7f7b9e46c3ad3fc3ee110c1b81', 'request_id': 'req-bacd89ea-7319-45de-bf29-869b50525890'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:46.017418 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-bacd89ea-7319-45de-bf29-869b50525890 admin admin] The token cache is being invalidate because project 50f9dc7f7b9e46c3ad3fc3ee110c1b81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:30:46.017827 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-bacd89ea-7319-45de-bf29-869b50525890 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:46.018730 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-bacd89ea-7319-45de-bf29-869b50525890 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:46.020953 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1261/2507] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:30:45 2022] DELETE /identity/v3/projects/50f9dc7f7b9e46c3ad3fc3ee110c1b81 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:30:46.027961 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53d098-99f9-4a0e-b138-3a155d69f6ca None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:46.028374 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53d098-99f9-4a0e-b138-3a155d69f6ca None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:46.028745 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53d098-99f9-4a0e-b138-3a155d69f6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:46.057598 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-7d53d098-99f9-4a0e-b138-3a155d69f6ca None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:30:46.059458 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-7d53d098-99f9-4a0e-b138-3a155d69f6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:30:46.155311 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1247/2508] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:30:46.165478 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87dec7-769d-42dd-b902-a8a4346e9acf None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:46.165801 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87dec7-769d-42dd-b902-a8a4346e9acf None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:46.166044 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87dec7-769d-42dd-b902-a8a4346e9acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:46.177452 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:30:46.200087 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-0f87dec7-769d-42dd-b902-a8a4346e9acf None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:30:46.203054 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-0f87dec7-769d-42dd-b902-a8a4346e9acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:30:46.217888 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1262/2509] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:30:46.224138 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53d098-99f9-4a0e-b138-3a155d69f6ca None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:46.246749 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53d098-99f9-4a0e-b138-3a155d69f6ca None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:46.256761 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd5970-02fd-4dd0-96d9-5deb1614378a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:46.258887 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd5970-02fd-4dd0-96d9-5deb1614378a admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:46.259180 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd5970-02fd-4dd0-96d9-5deb1614378a admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:46.259464 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd5970-02fd-4dd0-96d9-5deb1614378a admin admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:46.260176 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd5970-02fd-4dd0-96d9-5deb1614378a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:30:46.260498 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd5970-02fd-4dd0-96d9-5deb1614378a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:46.262167 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd5970-02fd-4dd0-96d9-5deb1614378a admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:46.277600 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1248/2510] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:30:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:30:46.282385 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87dec7-769d-42dd-b902-a8a4346e9acf None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:46.293591 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87dec7-769d-42dd-b902-a8a4346e9acf None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:46.303926 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaa0411-3adb-4e80-88bc-1a84b762a85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:46.305302 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa0411-3adb-4e80-88bc-1a84b762a85d admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:46.305522 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa0411-3adb-4e80-88bc-1a84b762a85d admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:46.305917 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa0411-3adb-4e80-88bc-1a84b762a85d admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:46.307231 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaa0411-3adb-4e80-88bc-1a84b762a85d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:46.311754 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaa0411-3adb-4e80-88bc-1a84b762a85d admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:46.353574 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1263/2511] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:30:46 2022] POST /identity/v3/projects => generated 393 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:30:46.360260 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd5970-02fd-4dd0-96d9-5deb1614378a admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:46.374393 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd5970-02fd-4dd0-96d9-5deb1614378a admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:46.455952 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da901e1a-f301-4205-ac0e-aa04f6c076f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:46.456976 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da901e1a-f301-4205-ac0e-aa04f6c076f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:46.457428 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da901e1a-f301-4205-ac0e-aa04f6c076f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:46.457898 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da901e1a-f301-4205-ac0e-aa04f6c076f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:46.459119 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da901e1a-f301-4205-ac0e-aa04f6c076f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:46.462923 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da901e1a-f301-4205-ac0e-aa04f6c076f7 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:46.500089 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1249/2512] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:30:46 2022] POST /identity/v3/users => generated 297 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:30:46.506083 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaa0411-3adb-4e80-88bc-1a84b762a85d admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:46.518974 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaa0411-3adb-4e80-88bc-1a84b762a85d admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:46.526128 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7dd04-6b09-49ad-9a5b-985fd3911b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:46.526929 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7dd04-6b09-49ad-9a5b-985fd3911b7d admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:46.527309 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7dd04-6b09-49ad-9a5b-985fd3911b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:46.527763 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7dd04-6b09-49ad-9a5b-985fd3911b7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:46.528533 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7dd04-6b09-49ad-9a5b-985fd3911b7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:46.530508 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7dd04-6b09-49ad-9a5b-985fd3911b7d admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:46.544050 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1264/2513] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:30:46.549935 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da901e1a-f301-4205-ac0e-aa04f6c076f7 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:46.566903 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da901e1a-f301-4205-ac0e-aa04f6c076f7 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:46.574482 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce99068-53b3-482a-9eaf-445be824e674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:46.575560 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce99068-53b3-482a-9eaf-445be824e674 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:46.575953 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce99068-53b3-482a-9eaf-445be824e674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:46.576395 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce99068-53b3-482a-9eaf-445be824e674 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:46.577433 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce99068-53b3-482a-9eaf-445be824e674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:46.580767 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce99068-53b3-482a-9eaf-445be824e674 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:46.596481 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1250/2514] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:30:46 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:30:46.601030 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7dd04-6b09-49ad-9a5b-985fd3911b7d admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:46.614566 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7dd04-6b09-49ad-9a5b-985fd3911b7d admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:46.620151 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc5962-a474-4ba0-9747-5ba3c4b9dbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:46.620834 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc5962-a474-4ba0-9747-5ba3c4b9dbfe admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:46.621113 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc5962-a474-4ba0-9747-5ba3c4b9dbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:46.621436 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc5962-a474-4ba0-9747-5ba3c4b9dbfe admin admin] PATH_INFO: `/v3/projects/bc833d69bd894fbe8cfb718d8bc78f6d/users/0aa99cdc28fe410b8281bbfb3cb883df/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:46.643962 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babc5962-a474-4ba0-9747-5ba3c4b9dbfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc833d69bd894fbe8cfb718d8bc78f6d, user_id=0aa99cdc28fe410b8281bbfb3cb883df, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:46.646778 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babc5962-a474-4ba0-9747-5ba3c4b9dbfe admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:46.665386 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1265/2515] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:30:46 2022] PUT /identity/v3/projects/bc833d69bd894fbe8cfb718d8bc78f6d/users/0aa99cdc28fe410b8281bbfb3cb883df/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:30:46.677836 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad8bd8-5c9b-4d81-a73b-594b96156869 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:46.678490 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad8bd8-5c9b-4d81-a73b-594b96156869 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:46.678833 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad8bd8-5c9b-4d81-a73b-594b96156869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:46.705386 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:30:46.721652 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-40ad8bd8-5c9b-4d81-a73b-594b96156869 None None] MFA Rules not processed for user `0aa99cdc28fe410b8281bbfb3cb883df`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:30:46.723995 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-40ad8bd8-5c9b-4d81-a73b-594b96156869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:30:46.815330 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1251/2516] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:30:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:30:46.820959 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc5962-a474-4ba0-9747-5ba3c4b9dbfe admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:46.918691 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc5962-a474-4ba0-9747-5ba3c4b9dbfe admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:46.925149 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afbcf34-0a64-4c1f-bd6c-72e498d4b66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:46.925945 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbcf34-0a64-4c1f-bd6c-72e498d4b66a admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:46.926409 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbcf34-0a64-4c1f-bd6c-72e498d4b66a admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:46.926947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbcf34-0a64-4c1f-bd6c-72e498d4b66a admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:46.928154 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afbcf34-0a64-4c1f-bd6c-72e498d4b66a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:46.931513 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afbcf34-0a64-4c1f-bd6c-72e498d4b66a admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:46.972618 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1266/2517] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:30:46 2022] POST /identity/v3/projects => generated 393 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:30:46.979593 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad8bd8-5c9b-4d81-a73b-594b96156869 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:47.002313 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad8bd8-5c9b-4d81-a73b-594b96156869 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:47.080908 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d27621-ce0d-4eb1-b09d-dca677dc2738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:47.081440 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d27621-ce0d-4eb1-b09d-dca677dc2738 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:47.081728 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d27621-ce0d-4eb1-b09d-dca677dc2738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:47.082004 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d27621-ce0d-4eb1-b09d-dca677dc2738 admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:47.082715 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d27621-ce0d-4eb1-b09d-dca677dc2738 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:47.084748 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d27621-ce0d-4eb1-b09d-dca677dc2738 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:47.119833 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1252/2518] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:30:46 2022] POST /identity/v3/users => generated 303 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:30:47.125697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afbcf34-0a64-4c1f-bd6c-72e498d4b66a admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:47.137487 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afbcf34-0a64-4c1f-bd6c-72e498d4b66a admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:47.143659 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a880a-2e65-4696-ba9e-9a64b4a08ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:47.144293 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a880a-2e65-4696-ba9e-9a64b4a08ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:47.144724 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a880a-2e65-4696-ba9e-9a64b4a08ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:47.144915 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a880a-2e65-4696-ba9e-9a64b4a08ff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:47.145480 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502a880a-2e65-4696-ba9e-9a64b4a08ff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:47.147291 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502a880a-2e65-4696-ba9e-9a64b4a08ff7 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:47.160503 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1267/2519] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:30:47.165886 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d27621-ce0d-4eb1-b09d-dca677dc2738 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:47.188838 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d27621-ce0d-4eb1-b09d-dca677dc2738 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:47.197503 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771b60c-2ddf-4116-b483-10c1e8ada4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:47.198712 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771b60c-2ddf-4116-b483-10c1e8ada4e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:47.199200 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771b60c-2ddf-4116-b483-10c1e8ada4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:47.199709 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771b60c-2ddf-4116-b483-10c1e8ada4e5 admin admin] PATH_INFO: `/v3/projects/e64ae246cf50458babf038137df0a384/users/42cdc422460e4e30895a4b0a2c475878/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:47.229555 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771b60c-2ddf-4116-b483-10c1e8ada4e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e64ae246cf50458babf038137df0a384, user_id=42cdc422460e4e30895a4b0a2c475878, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:47.233815 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771b60c-2ddf-4116-b483-10c1e8ada4e5 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:47.254157 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1253/2520] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:30:47 2022] PUT /identity/v3/projects/e64ae246cf50458babf038137df0a384/users/42cdc422460e4e30895a4b0a2c475878/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:30:47.258731 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a880a-2e65-4696-ba9e-9a64b4a08ff7 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:47.274055 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a880a-2e65-4696-ba9e-9a64b4a08ff7 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:47.362226 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2ff6d-6fc1-4e16-b890-2c8eb2b895b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:47.362810 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2ff6d-6fc1-4e16-b890-2c8eb2b895b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:47.363099 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2ff6d-6fc1-4e16-b890-2c8eb2b895b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:47.363380 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2ff6d-6fc1-4e16-b890-2c8eb2b895b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:47.364128 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d2ff6d-6fc1-4e16-b890-2c8eb2b895b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:47.366513 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d2ff6d-6fc1-4e16-b890-2c8eb2b895b9 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:47.379906 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1268/2521] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:30:47.385579 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771b60c-2ddf-4116-b483-10c1e8ada4e5 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:47.402905 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771b60c-2ddf-4116-b483-10c1e8ada4e5 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:47.408800 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83574fdd-c83c-4026-9c5c-6a6fac9866f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:47.409507 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83574fdd-c83c-4026-9c5c-6a6fac9866f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:47.409883 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83574fdd-c83c-4026-9c5c-6a6fac9866f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:47.410055 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83574fdd-c83c-4026-9c5c-6a6fac9866f3 admin admin] PATH_INFO: `/v3/projects/e64ae246cf50458babf038137df0a384/users/42cdc422460e4e30895a4b0a2c475878/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:47.412310 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83574fdd-c83c-4026-9c5c-6a6fac9866f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e64ae246cf50458babf038137df0a384, user_id=42cdc422460e4e30895a4b0a2c475878, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:47.415209 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83574fdd-c83c-4026-9c5c-6a6fac9866f3 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:47.430613 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1254/2522] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:30:47 2022] PUT /identity/v3/projects/e64ae246cf50458babf038137df0a384/users/42cdc422460e4e30895a4b0a2c475878/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:30:47.443133 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1da4a-c000-4b23-b061-f4b1e7a441d6 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:47.443584 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1da4a-c000-4b23-b061-f4b1e7a441d6 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:47.443959 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1da4a-c000-4b23-b061-f4b1e7a441d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:47.472293 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:30:47.484771 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-f1d1da4a-c000-4b23-b061-f4b1e7a441d6 None None] MFA Rules not processed for user `42cdc422460e4e30895a4b0a2c475878`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:30:47.487757 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f1d1da4a-c000-4b23-b061-f4b1e7a441d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:30:47.605827 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1269/2523] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:30:47 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:30:47.621554 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83574fdd-c83c-4026-9c5c-6a6fac9866f3 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:47.624972 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-83574fdd-c83c-4026-9c5c-6a6fac9866f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:30:47.729168 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83574fdd-c83c-4026-9c5c-6a6fac9866f3 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:47.733709 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5ee53-1849-4f8e-9e84-b4388f239006 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:47.734531 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5ee53-1849-4f8e-9e84-b4388f239006 service cinder] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:47.734913 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5ee53-1849-4f8e-9e84-b4388f239006 service cinder] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:47.735230 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5ee53-1849-4f8e-9e84-b4388f239006 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:47.742028 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:30:47.748813 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e5ee53-1849-4f8e-9e84-b4388f239006 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:47.751451 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e5ee53-1849-4f8e-9e84-b4388f239006 service cinder] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:47.763194 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1255/2524] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:30:47 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:30:47.825089 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1da4a-c000-4b23-b061-f4b1e7a441d6 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:47.827367 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f1d1da4a-c000-4b23-b061-f4b1e7a441d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:30:47.842806 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1da4a-c000-4b23-b061-f4b1e7a441d6 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:47.848529 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7aff00-d69b-43b7-8e9d-33b56c783a90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:47.849335 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7aff00-d69b-43b7-8e9d-33b56c783a90 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:47.849751 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7aff00-d69b-43b7-8e9d-33b56c783a90 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:47.850253 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7aff00-d69b-43b7-8e9d-33b56c783a90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:47.951233 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7aff00-d69b-43b7-8e9d-33b56c783a90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:47.953836 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7aff00-d69b-43b7-8e9d-33b56c783a90 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:47.969407 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1270/2525] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:30:47 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:30:51.973988 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5ee53-1849-4f8e-9e84-b4388f239006 service cinder] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:52.071039 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5ee53-1849-4f8e-9e84-b4388f239006 service cinder] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:52.079175 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b3e77-2213-4eab-a1e0-c41417cb6cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:52.080304 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b3e77-2213-4eab-a1e0-c41417cb6cd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:52.080778 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b3e77-2213-4eab-a1e0-c41417cb6cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:52.081251 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b3e77-2213-4eab-a1e0-c41417cb6cd3 admin admin] PATH_INFO: `/v3/users/0aa99cdc28fe410b8281bbfb3cb883df` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:52.083357 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b3e77-2213-4eab-a1e0-c41417cb6cd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aa99cdc28fe410b8281bbfb3cb883df)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:52.087095 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b3e77-2213-4eab-a1e0-c41417cb6cd3 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:52.159241 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-034b3e77-2213-4eab-a1e0-c41417cb6cd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aa99cdc28fe410b8281bbfb3cb883df'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:52.181177 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-034b3e77-2213-4eab-a1e0-c41417cb6cd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aa99cdc28fe410b8281bbfb3cb883df'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:52.194953 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-034b3e77-2213-4eab-a1e0-c41417cb6cd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aa99cdc28fe410b8281bbfb3cb883df'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:52.196161 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-034b3e77-2213-4eab-a1e0-c41417cb6cd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aa99cdc28fe410b8281bbfb3cb883df'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:52.208382 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-034b3e77-2213-4eab-a1e0-c41417cb6cd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aa99cdc28fe410b8281bbfb3cb883df'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:52.219236 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1256/2526] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:30:51 2022] DELETE /identity/v3/users/0aa99cdc28fe410b8281bbfb3cb883df => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:30:52.225970 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595d9c5-3da9-4f91-b9a2-9a03c10d8a03 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:52.226829 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595d9c5-3da9-4f91-b9a2-9a03c10d8a03 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:52.226829 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595d9c5-3da9-4f91-b9a2-9a03c10d8a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:52.254404 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-f595d9c5-3da9-4f91-b9a2-9a03c10d8a03 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:30:52.256245 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f595d9c5-3da9-4f91-b9a2-9a03c10d8a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:30:52.338406 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1271/2527] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:30:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:30:52.348052 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b3e77-2213-4eab-a1e0-c41417cb6cd3 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:52.349599 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-034b3e77-2213-4eab-a1e0-c41417cb6cd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:30:52.417701 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b3e77-2213-4eab-a1e0-c41417cb6cd3 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:52.421683 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9a912-fe68-4621-991e-ca25d87e17fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:52.422314 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9a912-fe68-4621-991e-ca25d87e17fc service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:52.422651 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9a912-fe68-4621-991e-ca25d87e17fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:52.422892 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9a912-fe68-4621-991e-ca25d87e17fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:52.433796 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9a912-fe68-4621-991e-ca25d87e17fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:52.435381 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9a912-fe68-4621-991e-ca25d87e17fc service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:52.447134 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1257/2528] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:30:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:30:52.795671 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595d9c5-3da9-4f91-b9a2-9a03c10d8a03 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:52.798258 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f595d9c5-3da9-4f91-b9a2-9a03c10d8a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:30:52.820285 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595d9c5-3da9-4f91-b9a2-9a03c10d8a03 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:52.828703 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918ad55-aaf8-45c8-b0a9-5ab89280854b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:52.829670 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918ad55-aaf8-45c8-b0a9-5ab89280854b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:52.830186 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918ad55-aaf8-45c8-b0a9-5ab89280854b admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:52.830607 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918ad55-aaf8-45c8-b0a9-5ab89280854b admin admin] PATH_INFO: `/v3/projects/bc833d69bd894fbe8cfb718d8bc78f6d` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:52.832120 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918ad55-aaf8-45c8-b0a9-5ab89280854b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc833d69bd894fbe8cfb718d8bc78f6d)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:52.834458 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918ad55-aaf8-45c8-b0a9-5ab89280854b admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:52.877192 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:30:52.896526 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0918ad55-aaf8-45c8-b0a9-5ab89280854b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc833d69bd894fbe8cfb718d8bc78f6d', 'request_id': 'req-0918ad55-aaf8-45c8-b0a9-5ab89280854b'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:52.907184 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0918ad55-aaf8-45c8-b0a9-5ab89280854b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc833d69bd894fbe8cfb718d8bc78f6d', 'request_id': 'req-0918ad55-aaf8-45c8-b0a9-5ab89280854b'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:52.913845 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0918ad55-aaf8-45c8-b0a9-5ab89280854b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc833d69bd894fbe8cfb718d8bc78f6d', 'request_id': 'req-0918ad55-aaf8-45c8-b0a9-5ab89280854b'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:52.926024 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0918ad55-aaf8-45c8-b0a9-5ab89280854b admin admin] The token cache is being invalidate because project bc833d69bd894fbe8cfb718d8bc78f6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:30:52.926503 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0918ad55-aaf8-45c8-b0a9-5ab89280854b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:52.927269 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0918ad55-aaf8-45c8-b0a9-5ab89280854b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:52.928836 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1272/2529] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:30:52 2022] DELETE /identity/v3/projects/bc833d69bd894fbe8cfb718d8bc78f6d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:30:52.933305 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9a912-fe68-4621-991e-ca25d87e17fc service neutron] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:52.945050 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9a912-fe68-4621-991e-ca25d87e17fc service neutron] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:52.960570 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:30:53.019286 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c402a60-22b0-47ff-8dc0-1de4a6786d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:53.020047 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c402a60-22b0-47ff-8dc0-1de4a6786d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:53.020376 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c402a60-22b0-47ff-8dc0-1de4a6786d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:53.020699 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c402a60-22b0-47ff-8dc0-1de4a6786d7c admin admin] PATH_INFO: `/v3/users/42cdc422460e4e30895a4b0a2c475878` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:53.022127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c402a60-22b0-47ff-8dc0-1de4a6786d7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=42cdc422460e4e30895a4b0a2c475878)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:53.024694 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c402a60-22b0-47ff-8dc0-1de4a6786d7c admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:53.082037 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-9c402a60-22b0-47ff-8dc0-1de4a6786d7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42cdc422460e4e30895a4b0a2c475878'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:53.097142 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-9c402a60-22b0-47ff-8dc0-1de4a6786d7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42cdc422460e4e30895a4b0a2c475878'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:53.106352 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-9c402a60-22b0-47ff-8dc0-1de4a6786d7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42cdc422460e4e30895a4b0a2c475878'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:53.107728 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-9c402a60-22b0-47ff-8dc0-1de4a6786d7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42cdc422460e4e30895a4b0a2c475878'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:53.116514 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-9c402a60-22b0-47ff-8dc0-1de4a6786d7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42cdc422460e4e30895a4b0a2c475878'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:53.124299 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1258/2530] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:30:52 2022] DELETE /identity/v3/users/42cdc422460e4e30895a4b0a2c475878 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:30:53.473626 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918ad55-aaf8-45c8-b0a9-5ab89280854b admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:53.476005 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-0918ad55-aaf8-45c8-b0a9-5ab89280854b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:30:53.499035 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918ad55-aaf8-45c8-b0a9-5ab89280854b admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:53.575014 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e44a0-b01e-4f0d-8675-650a634a6f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:53.576080 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e44a0-b01e-4f0d-8675-650a634a6f93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:53.576360 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e44a0-b01e-4f0d-8675-650a634a6f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:53.576638 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e44a0-b01e-4f0d-8675-650a634a6f93 admin admin] PATH_INFO: `/v3/projects/e64ae246cf50458babf038137df0a384` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:53.578090 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e44a0-b01e-4f0d-8675-650a634a6f93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e64ae246cf50458babf038137df0a384)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:53.580291 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e44a0-b01e-4f0d-8675-650a634a6f93 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:53.639555 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-c08e44a0-b01e-4f0d-8675-650a634a6f93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e64ae246cf50458babf038137df0a384', 'request_id': 'req-c08e44a0-b01e-4f0d-8675-650a634a6f93'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:53.648337 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-c08e44a0-b01e-4f0d-8675-650a634a6f93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e64ae246cf50458babf038137df0a384', 'request_id': 'req-c08e44a0-b01e-4f0d-8675-650a634a6f93'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:53.656305 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-c08e44a0-b01e-4f0d-8675-650a634a6f93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e64ae246cf50458babf038137df0a384', 'request_id': 'req-c08e44a0-b01e-4f0d-8675-650a634a6f93'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:53.670805 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-c08e44a0-b01e-4f0d-8675-650a634a6f93 admin admin] The token cache is being invalidate because project e64ae246cf50458babf038137df0a384 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:30:53.671172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-c08e44a0-b01e-4f0d-8675-650a634a6f93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:53.671973 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-c08e44a0-b01e-4f0d-8675-650a634a6f93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:30:53.673801 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1273/2531] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:30:53 2022] DELETE /identity/v3/projects/e64ae246cf50458babf038137df0a384 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:30:53.680447 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba13ea-8aef-4909-9726-96ec1bea4632 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:53.680910 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba13ea-8aef-4909-9726-96ec1bea4632 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:53.681323 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba13ea-8aef-4909-9726-96ec1bea4632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:53.704489 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-40ba13ea-8aef-4909-9726-96ec1bea4632 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:30:53.705762 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-40ba13ea-8aef-4909-9726-96ec1bea4632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:30:53.803967 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1259/2532] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:30:53.813302 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24329baf-a44a-48ae-8542-bab619e6b202 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:53.813808 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24329baf-a44a-48ae-8542-bab619e6b202 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:53.814310 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24329baf-a44a-48ae-8542-bab619e6b202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:53.848393 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-24329baf-a44a-48ae-8542-bab619e6b202 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:30:53.850590 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-24329baf-a44a-48ae-8542-bab619e6b202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:30:53.865623 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1274/2533] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:30:53.870680 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba13ea-8aef-4909-9726-96ec1bea4632 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:53.882866 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba13ea-8aef-4909-9726-96ec1bea4632 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:53.888068 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f19c58-637e-4abd-bd0f-e5edbae98c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:53.888798 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f19c58-637e-4abd-bd0f-e5edbae98c24 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:53.889135 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f19c58-637e-4abd-bd0f-e5edbae98c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:53.889591 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f19c58-637e-4abd-bd0f-e5edbae98c24 admin admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:53.890563 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f19c58-637e-4abd-bd0f-e5edbae98c24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:30:53.891068 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f19c58-637e-4abd-bd0f-e5edbae98c24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:53.893023 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f19c58-637e-4abd-bd0f-e5edbae98c24 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:53.908300 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1260/2534] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:30:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:30:53.913210 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24329baf-a44a-48ae-8542-bab619e6b202 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:53.924487 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24329baf-a44a-48ae-8542-bab619e6b202 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:53.929713 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab3724-e9a2-4c22-9cce-096faf053a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:53.930402 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab3724-e9a2-4c22-9cce-096faf053a7d admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:53.930675 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab3724-e9a2-4c22-9cce-096faf053a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:53.930975 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab3724-e9a2-4c22-9cce-096faf053a7d admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:53.931640 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab3724-e9a2-4c22-9cce-096faf053a7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:53.933808 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab3724-e9a2-4c22-9cce-096faf053a7d admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:53.968713 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1275/2535] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:30:53 2022] POST /identity/v3/projects => generated 367 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:30:53.974251 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f19c58-637e-4abd-bd0f-e5edbae98c24 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:53.987838 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f19c58-637e-4abd-bd0f-e5edbae98c24 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:54.016154 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:30:54.077624 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f27d8db-6230-4b23-ace1-91b43005052a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:54.078383 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27d8db-6230-4b23-ace1-91b43005052a admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:54.078576 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27d8db-6230-4b23-ace1-91b43005052a admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:54.078809 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27d8db-6230-4b23-ace1-91b43005052a admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:54.079458 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f27d8db-6230-4b23-ace1-91b43005052a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:54.081454 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f27d8db-6230-4b23-ace1-91b43005052a admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:54.106060 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1261/2536] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:30:53 2022] POST /identity/v3/users => generated 284 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:30:54.111618 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab3724-e9a2-4c22-9cce-096faf053a7d admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:54.124223 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab3724-e9a2-4c22-9cce-096faf053a7d admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:54.129530 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68ca12-5081-4d66-a26e-b07c01fe7bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:54.130156 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68ca12-5081-4d66-a26e-b07c01fe7bfb admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:54.130472 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68ca12-5081-4d66-a26e-b07c01fe7bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:54.130749 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68ca12-5081-4d66-a26e-b07c01fe7bfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:54.131413 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68ca12-5081-4d66-a26e-b07c01fe7bfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:54.133160 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68ca12-5081-4d66-a26e-b07c01fe7bfb admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:54.145152 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1276/2537] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:30:54.150004 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f27d8db-6230-4b23-ace1-91b43005052a admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:54.162320 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f27d8db-6230-4b23-ace1-91b43005052a admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:54.167439 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef849970-8051-4999-bb13-c8111a671159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:54.168063 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef849970-8051-4999-bb13-c8111a671159 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:54.168373 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef849970-8051-4999-bb13-c8111a671159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:54.168651 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef849970-8051-4999-bb13-c8111a671159 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:54.169393 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef849970-8051-4999-bb13-c8111a671159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:54.171592 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef849970-8051-4999-bb13-c8111a671159 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:54.183905 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1262/2538] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:30:54.189056 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68ca12-5081-4d66-a26e-b07c01fe7bfb admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:54.201419 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68ca12-5081-4d66-a26e-b07c01fe7bfb admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:54.207050 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584dac2-73c0-4552-9f6d-759264a476e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:54.207736 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584dac2-73c0-4552-9f6d-759264a476e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:54.208020 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584dac2-73c0-4552-9f6d-759264a476e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:54.208295 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584dac2-73c0-4552-9f6d-759264a476e1 admin admin] PATH_INFO: `/v3/projects/1ce69ee33cf14fc3997350d380105c78/users/e7e3dd7780df496baabfb17e11dad1f8/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:54.212107 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:30:54.229409 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e584dac2-73c0-4552-9f6d-759264a476e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ce69ee33cf14fc3997350d380105c78, user_id=e7e3dd7780df496baabfb17e11dad1f8, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:54.232377 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e584dac2-73c0-4552-9f6d-759264a476e1 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:54.251499 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1277/2539] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:30:54 2022] PUT /identity/v3/projects/1ce69ee33cf14fc3997350d380105c78/users/e7e3dd7780df496baabfb17e11dad1f8/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:30:54.265670 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6aedd9-1752-4506-a6e8-cd1129453701 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:54.265953 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6aedd9-1752-4506-a6e8-cd1129453701 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:54.266226 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6aedd9-1752-4506-a6e8-cd1129453701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:54.299480 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-9e6aedd9-1752-4506-a6e8-cd1129453701 None None] MFA Rules not processed for user `e7e3dd7780df496baabfb17e11dad1f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:30:54.300773 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-9e6aedd9-1752-4506-a6e8-cd1129453701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:30:54.379379 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1263/2540] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:30:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:30:54.384510 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584dac2-73c0-4552-9f6d-759264a476e1 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:54.456718 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584dac2-73c0-4552-9f6d-759264a476e1 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:54.461721 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b0fd1-88ab-43b8-8eca-d5779c18d1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:54.462334 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b0fd1-88ab-43b8-8eca-d5779c18d1be admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:54.462743 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b0fd1-88ab-43b8-8eca-d5779c18d1be admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:54.463030 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b0fd1-88ab-43b8-8eca-d5779c18d1be admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:54.463651 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b0fd1-88ab-43b8-8eca-d5779c18d1be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:54.465578 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b0fd1-88ab-43b8-8eca-d5779c18d1be admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:54.497990 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1278/2541] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:30:54 2022] POST /identity/v3/projects => generated 365 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:30:54.502503 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6aedd9-1752-4506-a6e8-cd1129453701 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:54.516306 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6aedd9-1752-4506-a6e8-cd1129453701 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:54.588412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fbe594-b969-4a55-bde9-7305a1edb072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:54.589038 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbe594-b969-4a55-bde9-7305a1edb072 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:54.589314 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbe594-b969-4a55-bde9-7305a1edb072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:54.589584 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbe594-b969-4a55-bde9-7305a1edb072 admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:54.590225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fbe594-b969-4a55-bde9-7305a1edb072 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:54.592254 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fbe594-b969-4a55-bde9-7305a1edb072 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:54.616791 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1264/2542] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:30:54 2022] POST /identity/v3/users => generated 289 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:30:54.621340 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b0fd1-88ab-43b8-8eca-d5779c18d1be admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:54.636889 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b0fd1-88ab-43b8-8eca-d5779c18d1be admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:54.645910 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896a519-e703-4e52-9cf8-64bae88f7ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:54.646599 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896a519-e703-4e52-9cf8-64bae88f7ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:54.646858 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896a519-e703-4e52-9cf8-64bae88f7ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:54.647125 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896a519-e703-4e52-9cf8-64bae88f7ab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:54.647787 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d896a519-e703-4e52-9cf8-64bae88f7ab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:54.649962 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d896a519-e703-4e52-9cf8-64bae88f7ab0 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:54.665299 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1279/2543] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:30:54.670455 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fbe594-b969-4a55-bde9-7305a1edb072 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:54.688302 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fbe594-b969-4a55-bde9-7305a1edb072 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:54.696483 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e3e687-4e15-4de6-8c9b-f0f217baf04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:54.697854 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3e687-4e15-4de6-8c9b-f0f217baf04c admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:54.698331 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3e687-4e15-4de6-8c9b-f0f217baf04c admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:54.698866 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3e687-4e15-4de6-8c9b-f0f217baf04c admin admin] PATH_INFO: `/v3/projects/3ddad176af054d1e8d0ebd7759e50961/users/670256874886493ba9ccd0ab5137045c/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:54.730740 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e3e687-4e15-4de6-8c9b-f0f217baf04c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ddad176af054d1e8d0ebd7759e50961, user_id=670256874886493ba9ccd0ab5137045c, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:54.736313 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e3e687-4e15-4de6-8c9b-f0f217baf04c admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:54.742045 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:30:54.760851 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1265/2544] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:30:54 2022] PUT /identity/v3/projects/3ddad176af054d1e8d0ebd7759e50961/users/670256874886493ba9ccd0ab5137045c/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:30:54.767484 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896a519-e703-4e52-9cf8-64bae88f7ab0 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:54.778672 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896a519-e703-4e52-9cf8-64bae88f7ab0 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:54.852492 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a4731e-9e7d-4a10-8248-778c68f9e733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:54.853328 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a4731e-9e7d-4a10-8248-778c68f9e733 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:54.853746 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a4731e-9e7d-4a10-8248-778c68f9e733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:54.854445 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a4731e-9e7d-4a10-8248-778c68f9e733 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:54.855258 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a4731e-9e7d-4a10-8248-778c68f9e733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:54.857250 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a4731e-9e7d-4a10-8248-778c68f9e733 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:54.874060 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1280/2545] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:30:54.875858 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e3e687-4e15-4de6-8c9b-f0f217baf04c admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:54.892469 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e3e687-4e15-4de6-8c9b-f0f217baf04c admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:54.899483 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830b7e4-2e70-4b4a-b24f-c685a7119db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:54.900297 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830b7e4-2e70-4b4a-b24f-c685a7119db4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:54.900699 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830b7e4-2e70-4b4a-b24f-c685a7119db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:54.901100 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830b7e4-2e70-4b4a-b24f-c685a7119db4 admin admin] PATH_INFO: `/v3/projects/3ddad176af054d1e8d0ebd7759e50961/users/670256874886493ba9ccd0ab5137045c/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:54.903720 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830b7e4-2e70-4b4a-b24f-c685a7119db4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ddad176af054d1e8d0ebd7759e50961, user_id=670256874886493ba9ccd0ab5137045c, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:54.908643 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830b7e4-2e70-4b4a-b24f-c685a7119db4 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:54.924513 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1266/2546] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:30:54 2022] PUT /identity/v3/projects/3ddad176af054d1e8d0ebd7759e50961/users/670256874886493ba9ccd0ab5137045c/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:30:54.938144 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be81de-c5d5-466c-8aac-502fa74a2eec None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:54.938577 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be81de-c5d5-466c-8aac-502fa74a2eec None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:54.938980 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be81de-c5d5-466c-8aac-502fa74a2eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:54.978118 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-51be81de-c5d5-466c-8aac-502fa74a2eec None None] MFA Rules not processed for user `670256874886493ba9ccd0ab5137045c`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:30:54.979422 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-51be81de-c5d5-466c-8aac-502fa74a2eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:30:55.084140 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:30:55.144209 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1281/2547] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:30:54 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:30:55.158851 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830b7e4-2e70-4b4a-b24f-c685a7119db4 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:55.160715 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-c830b7e4-2e70-4b4a-b24f-c685a7119db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:30:55.227126 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830b7e4-2e70-4b4a-b24f-c685a7119db4 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:55.231133 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f560429-cac2-4b06-816b-b844282cb5dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:55.232045 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f560429-cac2-4b06-816b-b844282cb5dd service cinder] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:55.232476 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f560429-cac2-4b06-816b-b844282cb5dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:55.232764 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f560429-cac2-4b06-816b-b844282cb5dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:55.243566 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f560429-cac2-4b06-816b-b844282cb5dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:55.245412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f560429-cac2-4b06-816b-b844282cb5dd service cinder] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:55.258707 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1267/2548] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:30:55 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:30:55.353455 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be81de-c5d5-466c-8aac-502fa74a2eec None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:30:55.364714 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be81de-c5d5-466c-8aac-502fa74a2eec None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:30:55.369134 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd6e4e-b4e4-4971-9e6b-2393a00cab7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:30:55.369759 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd6e4e-b4e4-4971-9e6b-2393a00cab7f service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:30:55.370049 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd6e4e-b4e4-4971-9e6b-2393a00cab7f service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:30:55.370315 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd6e4e-b4e4-4971-9e6b-2393a00cab7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:30:55.439435 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd6e4e-b4e4-4971-9e6b-2393a00cab7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:30:55.440799 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd6e4e-b4e4-4971-9e6b-2393a00cab7f service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:30:55.451864 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1282/2549] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:30:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:31:00.826419 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f560429-cac2-4b06-816b-b844282cb5dd service cinder] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:00.915326 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f560429-cac2-4b06-816b-b844282cb5dd service cinder] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:00.924502 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b2626-eb1c-427b-a81d-37465693cd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:00.925534 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b2626-eb1c-427b-a81d-37465693cd5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:00.926031 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b2626-eb1c-427b-a81d-37465693cd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:00.926573 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b2626-eb1c-427b-a81d-37465693cd5b admin admin] PATH_INFO: `/v3/users/e7e3dd7780df496baabfb17e11dad1f8` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:00.928678 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b2626-eb1c-427b-a81d-37465693cd5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7e3dd7780df496baabfb17e11dad1f8)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:00.932327 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b2626-eb1c-427b-a81d-37465693cd5b admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:01.008688 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-562b2626-eb1c-427b-a81d-37465693cd5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7e3dd7780df496baabfb17e11dad1f8'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:01.028880 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-562b2626-eb1c-427b-a81d-37465693cd5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7e3dd7780df496baabfb17e11dad1f8'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:01.039824 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-562b2626-eb1c-427b-a81d-37465693cd5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7e3dd7780df496baabfb17e11dad1f8'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:01.040563 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-562b2626-eb1c-427b-a81d-37465693cd5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7e3dd7780df496baabfb17e11dad1f8'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:01.050606 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-562b2626-eb1c-427b-a81d-37465693cd5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7e3dd7780df496baabfb17e11dad1f8'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:01.057756 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1268/2550] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:31:00 2022] DELETE /identity/v3/users/e7e3dd7780df496baabfb17e11dad1f8 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:01.063120 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f23f0-1a9f-4ef9-97e2-3120e5b9b099 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:01.064001 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f23f0-1a9f-4ef9-97e2-3120e5b9b099 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:01.064226 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f23f0-1a9f-4ef9-97e2-3120e5b9b099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:01.085757 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-d84f23f0-1a9f-4ef9-97e2-3120e5b9b099 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:01.087217 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d84f23f0-1a9f-4ef9-97e2-3120e5b9b099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:01.161524 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1283/2551] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:31:01.172751 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b2626-eb1c-427b-a81d-37465693cd5b admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:01.174908 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-562b2626-eb1c-427b-a81d-37465693cd5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:01.182941 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:01.249492 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b2626-eb1c-427b-a81d-37465693cd5b admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:01.253303 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50f896-6935-4f0a-955a-718d3433f8bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:01.253929 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50f896-6935-4f0a-955a-718d3433f8bc service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:01.254212 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50f896-6935-4f0a-955a-718d3433f8bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:01.254505 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50f896-6935-4f0a-955a-718d3433f8bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:01.265625 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f50f896-6935-4f0a-955a-718d3433f8bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:01.267046 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f50f896-6935-4f0a-955a-718d3433f8bc service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:01.278347 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1269/2552] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:31:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:31:01.615161 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f23f0-1a9f-4ef9-97e2-3120e5b9b099 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:01.617508 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d84f23f0-1a9f-4ef9-97e2-3120e5b9b099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:01.640155 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f23f0-1a9f-4ef9-97e2-3120e5b9b099 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:01.648542 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3cf514-cc64-407f-a08e-b417576f219b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:01.649989 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3cf514-cc64-407f-a08e-b417576f219b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:01.650613 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3cf514-cc64-407f-a08e-b417576f219b admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:01.651179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3cf514-cc64-407f-a08e-b417576f219b admin admin] PATH_INFO: `/v3/projects/1ce69ee33cf14fc3997350d380105c78` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:01.653848 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3cf514-cc64-407f-a08e-b417576f219b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ce69ee33cf14fc3997350d380105c78)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:01.657692 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3cf514-cc64-407f-a08e-b417576f219b admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:01.734258 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-9f3cf514-cc64-407f-a08e-b417576f219b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ce69ee33cf14fc3997350d380105c78', 'request_id': 'req-9f3cf514-cc64-407f-a08e-b417576f219b'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:01.745905 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-9f3cf514-cc64-407f-a08e-b417576f219b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ce69ee33cf14fc3997350d380105c78', 'request_id': 'req-9f3cf514-cc64-407f-a08e-b417576f219b'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:01.754206 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-9f3cf514-cc64-407f-a08e-b417576f219b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ce69ee33cf14fc3997350d380105c78', 'request_id': 'req-9f3cf514-cc64-407f-a08e-b417576f219b'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:01.767863 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-9f3cf514-cc64-407f-a08e-b417576f219b admin admin] The token cache is being invalidate because project 1ce69ee33cf14fc3997350d380105c78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:31:01.768196 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-9f3cf514-cc64-407f-a08e-b417576f219b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:01.768826 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-9f3cf514-cc64-407f-a08e-b417576f219b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:01.770380 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1284/2553] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:31:01 2022] DELETE /identity/v3/projects/1ce69ee33cf14fc3997350d380105c78 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:01.776946 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50f896-6935-4f0a-955a-718d3433f8bc service neutron] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:01.794423 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50f896-6935-4f0a-955a-718d3433f8bc service neutron] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:01.899673 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec0225b-1728-40f8-939b-0d5b27096ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:01.900788 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0225b-1728-40f8-939b-0d5b27096ad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:01.901296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0225b-1728-40f8-939b-0d5b27096ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:01.901803 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0225b-1728-40f8-939b-0d5b27096ad6 admin admin] PATH_INFO: `/v3/users/670256874886493ba9ccd0ab5137045c` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:01.904553 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec0225b-1728-40f8-939b-0d5b27096ad6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=670256874886493ba9ccd0ab5137045c)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:01.908565 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec0225b-1728-40f8-939b-0d5b27096ad6 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:01.986536 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-2ec0225b-1728-40f8-939b-0d5b27096ad6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '670256874886493ba9ccd0ab5137045c'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:02.003465 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-2ec0225b-1728-40f8-939b-0d5b27096ad6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '670256874886493ba9ccd0ab5137045c'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:02.014685 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-2ec0225b-1728-40f8-939b-0d5b27096ad6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '670256874886493ba9ccd0ab5137045c'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:02.015464 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-2ec0225b-1728-40f8-939b-0d5b27096ad6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '670256874886493ba9ccd0ab5137045c'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:02.025311 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-2ec0225b-1728-40f8-939b-0d5b27096ad6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '670256874886493ba9ccd0ab5137045c'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:02.032495 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1270/2554] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:31:01 2022] DELETE /identity/v3/users/670256874886493ba9ccd0ab5137045c => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:02.413983 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3cf514-cc64-407f-a08e-b417576f219b admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:02.416021 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-9f3cf514-cc64-407f-a08e-b417576f219b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:02.429075 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:02.439839 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3cf514-cc64-407f-a08e-b417576f219b admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:02.523517 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36a4e0-2f22-45e2-996e-bbadb49335a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:02.524545 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36a4e0-2f22-45e2-996e-bbadb49335a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:02.524928 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36a4e0-2f22-45e2-996e-bbadb49335a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:02.525396 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36a4e0-2f22-45e2-996e-bbadb49335a1 admin admin] PATH_INFO: `/v3/projects/3ddad176af054d1e8d0ebd7759e50961` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:02.526851 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b36a4e0-2f22-45e2-996e-bbadb49335a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ddad176af054d1e8d0ebd7759e50961)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:02.529703 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b36a4e0-2f22-45e2-996e-bbadb49335a1 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:02.593298 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0b36a4e0-2f22-45e2-996e-bbadb49335a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ddad176af054d1e8d0ebd7759e50961', 'request_id': 'req-0b36a4e0-2f22-45e2-996e-bbadb49335a1'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:02.605300 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0b36a4e0-2f22-45e2-996e-bbadb49335a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ddad176af054d1e8d0ebd7759e50961', 'request_id': 'req-0b36a4e0-2f22-45e2-996e-bbadb49335a1'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:02.614396 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0b36a4e0-2f22-45e2-996e-bbadb49335a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ddad176af054d1e8d0ebd7759e50961', 'request_id': 'req-0b36a4e0-2f22-45e2-996e-bbadb49335a1'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:02.628448 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0b36a4e0-2f22-45e2-996e-bbadb49335a1 admin admin] The token cache is being invalidate because project 3ddad176af054d1e8d0ebd7759e50961 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:31:02.628802 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0b36a4e0-2f22-45e2-996e-bbadb49335a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:02.629595 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0b36a4e0-2f22-45e2-996e-bbadb49335a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:02.631369 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1285/2555] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:31:02 2022] DELETE /identity/v3/projects/3ddad176af054d1e8d0ebd7759e50961 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:02.636522 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071689c-0646-4844-b494-4dcff517fbfb None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:02.636865 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071689c-0646-4844-b494-4dcff517fbfb None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:02.637181 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071689c-0646-4844-b494-4dcff517fbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:02.661061 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-0071689c-0646-4844-b494-4dcff517fbfb None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:02.662320 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-0071689c-0646-4844-b494-4dcff517fbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:02.687700 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:02.749227 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1271/2556] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:31:02.759316 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c6188-5ffe-4464-bb09-4fe4800e94b1 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:02.759737 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c6188-5ffe-4464-bb09-4fe4800e94b1 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:02.760122 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c6188-5ffe-4464-bb09-4fe4800e94b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:02.788622 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-ce0c6188-5ffe-4464-bb09-4fe4800e94b1 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:02.790788 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ce0c6188-5ffe-4464-bb09-4fe4800e94b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:02.805677 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1286/2557] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:31:02.810536 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0071689c-0646-4844-b494-4dcff517fbfb None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:02.821873 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0071689c-0646-4844-b494-4dcff517fbfb None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:02.827558 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5584aba6-242a-498f-8a0f-c3b56cac336b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:02.828176 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584aba6-242a-498f-8a0f-c3b56cac336b admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:02.828452 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584aba6-242a-498f-8a0f-c3b56cac336b admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:02.828718 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584aba6-242a-498f-8a0f-c3b56cac336b admin admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:02.829374 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5584aba6-242a-498f-8a0f-c3b56cac336b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:31:02.829675 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5584aba6-242a-498f-8a0f-c3b56cac336b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:02.831331 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5584aba6-242a-498f-8a0f-c3b56cac336b admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:02.851253 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1272/2558] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:31:02.853069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c6188-5ffe-4464-bb09-4fe4800e94b1 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:02.869692 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c6188-5ffe-4464-bb09-4fe4800e94b1 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:02.883214 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc29dc-e02d-4191-9d8c-d65c19afe6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:02.884151 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc29dc-e02d-4191-9d8c-d65c19afe6c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:02.884775 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc29dc-e02d-4191-9d8c-d65c19afe6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:02.885178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc29dc-e02d-4191-9d8c-d65c19afe6c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:02.886175 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fc29dc-e02d-4191-9d8c-d65c19afe6c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:02.890219 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fc29dc-e02d-4191-9d8c-d65c19afe6c4 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:02.933073 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1287/2559] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:31:02 2022] POST /identity/v3/projects => generated 375 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:31:02.939609 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5584aba6-242a-498f-8a0f-c3b56cac336b admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:02.955263 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5584aba6-242a-498f-8a0f-c3b56cac336b admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:03.036516 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e45987-7e05-4b31-a999-b32c0a969768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:03.037572 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e45987-7e05-4b31-a999-b32c0a969768 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:03.038070 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e45987-7e05-4b31-a999-b32c0a969768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:03.038775 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e45987-7e05-4b31-a999-b32c0a969768 admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:03.040041 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e45987-7e05-4b31-a999-b32c0a969768 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:03.044383 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e45987-7e05-4b31-a999-b32c0a969768 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:03.087572 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1273/2560] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:31:02 2022] POST /identity/v3/users => generated 288 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:31:03.089789 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc29dc-e02d-4191-9d8c-d65c19afe6c4 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:03.108330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc29dc-e02d-4191-9d8c-d65c19afe6c4 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:03.115918 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db30efe-232b-46d9-a812-2648ab0ca309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:03.116990 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db30efe-232b-46d9-a812-2648ab0ca309 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:03.117540 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db30efe-232b-46d9-a812-2648ab0ca309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:03.118004 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db30efe-232b-46d9-a812-2648ab0ca309 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:03.118913 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db30efe-232b-46d9-a812-2648ab0ca309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:03.121888 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db30efe-232b-46d9-a812-2648ab0ca309 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:03.144969 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1288/2561] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:31:03.146686 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e45987-7e05-4b31-a999-b32c0a969768 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:03.160369 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e45987-7e05-4b31-a999-b32c0a969768 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:03.167380 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813e408-0554-4013-a4de-e50dab2477d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:03.168220 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813e408-0554-4013-a4de-e50dab2477d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:03.168658 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813e408-0554-4013-a4de-e50dab2477d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:03.169187 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813e408-0554-4013-a4de-e50dab2477d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:03.170032 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813e408-0554-4013-a4de-e50dab2477d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:03.172306 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813e408-0554-4013-a4de-e50dab2477d2 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:03.188353 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1274/2562] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:31:03.194285 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db30efe-232b-46d9-a812-2648ab0ca309 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:03.212169 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db30efe-232b-46d9-a812-2648ab0ca309 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:03.221384 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b0c1f-64d3-4239-a189-531503312cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:03.222657 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b0c1f-64d3-4239-a189-531503312cf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:03.223157 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b0c1f-64d3-4239-a189-531503312cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:03.223668 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b0c1f-64d3-4239-a189-531503312cf0 admin admin] PATH_INFO: `/v3/projects/4484a0dd57824fd1baa36f0ca8c68dfd/users/e02f9e55db914df09f54cd24e082f922/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:03.256886 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b0c1f-64d3-4239-a189-531503312cf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4484a0dd57824fd1baa36f0ca8c68dfd, user_id=e02f9e55db914df09f54cd24e082f922, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:03.260666 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b0c1f-64d3-4239-a189-531503312cf0 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:03.284625 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1289/2563] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:31:03 2022] PUT /identity/v3/projects/4484a0dd57824fd1baa36f0ca8c68dfd/users/e02f9e55db914df09f54cd24e082f922/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:03.302304 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f6633-e571-4a2d-9d7f-1ebbf12db5b2 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:03.302912 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f6633-e571-4a2d-9d7f-1ebbf12db5b2 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:03.303403 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f6633-e571-4a2d-9d7f-1ebbf12db5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:03.360468 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-f76f6633-e571-4a2d-9d7f-1ebbf12db5b2 None None] MFA Rules not processed for user `e02f9e55db914df09f54cd24e082f922`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:03.362626 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-f76f6633-e571-4a2d-9d7f-1ebbf12db5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:03.483839 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1275/2564] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:31:03.488633 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b0c1f-64d3-4239-a189-531503312cf0 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:03.545157 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:03.608213 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b0c1f-64d3-4239-a189-531503312cf0 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:03.616756 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615db5cf-e727-4c60-8ce3-eda3fb223801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:03.617748 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615db5cf-e727-4c60-8ce3-eda3fb223801 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:03.618218 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615db5cf-e727-4c60-8ce3-eda3fb223801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:03.618732 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615db5cf-e727-4c60-8ce3-eda3fb223801 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:03.619927 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615db5cf-e727-4c60-8ce3-eda3fb223801 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:03.623888 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615db5cf-e727-4c60-8ce3-eda3fb223801 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:03.672414 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1290/2565] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:31:03 2022] POST /identity/v3/projects => generated 377 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:31:03.674609 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f6633-e571-4a2d-9d7f-1ebbf12db5b2 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:03.710195 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f6633-e571-4a2d-9d7f-1ebbf12db5b2 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:03.740189 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:03.797439 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c86721-9dbf-4c71-89a7-5ced32265fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:03.798228 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c86721-9dbf-4c71-89a7-5ced32265fc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:03.798627 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c86721-9dbf-4c71-89a7-5ced32265fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:03.799006 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c86721-9dbf-4c71-89a7-5ced32265fc3 admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:03.800157 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c86721-9dbf-4c71-89a7-5ced32265fc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:03.802289 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c86721-9dbf-4c71-89a7-5ced32265fc3 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:03.832779 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1276/2566] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:31:03 2022] POST /identity/v3/users => generated 289 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:31:03.838081 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615db5cf-e727-4c60-8ce3-eda3fb223801 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:03.857508 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615db5cf-e727-4c60-8ce3-eda3fb223801 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:03.865684 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd50484d-333e-4d98-bb83-b86a51ca8adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:03.866831 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd50484d-333e-4d98-bb83-b86a51ca8adf admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:03.867342 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd50484d-333e-4d98-bb83-b86a51ca8adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:03.867718 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd50484d-333e-4d98-bb83-b86a51ca8adf admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:03.868970 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd50484d-333e-4d98-bb83-b86a51ca8adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:03.872205 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd50484d-333e-4d98-bb83-b86a51ca8adf admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:03.897810 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1291/2567] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:31:03.899839 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c86721-9dbf-4c71-89a7-5ced32265fc3 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:03.912527 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c86721-9dbf-4c71-89a7-5ced32265fc3 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:03.919838 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b12802-23a6-4623-bea9-16c47a890ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:03.920689 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b12802-23a6-4623-bea9-16c47a890ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:03.921028 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b12802-23a6-4623-bea9-16c47a890ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:03.921466 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b12802-23a6-4623-bea9-16c47a890ce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:03.922718 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b12802-23a6-4623-bea9-16c47a890ce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:03.925745 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b12802-23a6-4623-bea9-16c47a890ce5 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:03.943262 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1277/2568] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:31:03.947847 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd50484d-333e-4d98-bb83-b86a51ca8adf admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:03.960791 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd50484d-333e-4d98-bb83-b86a51ca8adf admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:03.967368 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a39fd-5354-4ef1-af0e-192ee70710ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:03.968062 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a39fd-5354-4ef1-af0e-192ee70710ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:03.968343 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a39fd-5354-4ef1-af0e-192ee70710ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:03.968616 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a39fd-5354-4ef1-af0e-192ee70710ab admin admin] PATH_INFO: `/v3/projects/775ffde72a554e228c910e63114f738d/users/9c63aece11304306942832c32902592f/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:03.988777 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a39fd-5354-4ef1-af0e-192ee70710ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=775ffde72a554e228c910e63114f738d, user_id=9c63aece11304306942832c32902592f, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:03.991488 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a39fd-5354-4ef1-af0e-192ee70710ab admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:04.007492 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1292/2569] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:31:03 2022] PUT /identity/v3/projects/775ffde72a554e228c910e63114f738d/users/9c63aece11304306942832c32902592f/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:04.018336 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc470d4-4600-4af9-bede-7d9e526d925f None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:04.018660 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc470d4-4600-4af9-bede-7d9e526d925f None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:04.018926 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc470d4-4600-4af9-bede-7d9e526d925f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:04.066740 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-9cc470d4-4600-4af9-bede-7d9e526d925f None None] MFA Rules not processed for user `9c63aece11304306942832c32902592f`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:04.069091 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-9cc470d4-4600-4af9-bede-7d9e526d925f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:04.281425 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1278/2570] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:31:04.290513 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a39fd-5354-4ef1-af0e-192ee70710ab admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:04.453116 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a39fd-5354-4ef1-af0e-192ee70710ab admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:04.459123 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8844449-02f6-4dd7-9bfe-ed30d2be2fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:04.459755 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8844449-02f6-4dd7-9bfe-ed30d2be2fcc admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:04.460033 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8844449-02f6-4dd7-9bfe-ed30d2be2fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:04.460302 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8844449-02f6-4dd7-9bfe-ed30d2be2fcc admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:04.460954 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8844449-02f6-4dd7-9bfe-ed30d2be2fcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:04.463016 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8844449-02f6-4dd7-9bfe-ed30d2be2fcc admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:04.498140 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1293/2571] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:31:04 2022] POST /identity/v3/projects => generated 377 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:31:04.503348 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc470d4-4600-4af9-bede-7d9e526d925f None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:04.516879 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc470d4-4600-4af9-bede-7d9e526d925f None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:04.611464 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94509f1b-7d08-417b-8204-cf99e21bcd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:04.612550 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94509f1b-7d08-417b-8204-cf99e21bcd21 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:04.613062 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94509f1b-7d08-417b-8204-cf99e21bcd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:04.613566 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94509f1b-7d08-417b-8204-cf99e21bcd21 admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:04.614825 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94509f1b-7d08-417b-8204-cf99e21bcd21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:04.618968 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94509f1b-7d08-417b-8204-cf99e21bcd21 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:04.666560 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1279/2572] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:31:04 2022] POST /identity/v3/users => generated 295 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:31:04.671308 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8844449-02f6-4dd7-9bfe-ed30d2be2fcc admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:04.694728 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8844449-02f6-4dd7-9bfe-ed30d2be2fcc admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:04.723780 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c156b-6d50-46f2-b735-c504a2ded692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:04.726551 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c156b-6d50-46f2-b735-c504a2ded692 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:04.727645 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c156b-6d50-46f2-b735-c504a2ded692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:04.728402 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c156b-6d50-46f2-b735-c504a2ded692 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:04.730088 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465c156b-6d50-46f2-b735-c504a2ded692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:04.735066 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465c156b-6d50-46f2-b735-c504a2ded692 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:04.760235 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1294/2573] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:31:04.765574 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94509f1b-7d08-417b-8204-cf99e21bcd21 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:04.784362 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94509f1b-7d08-417b-8204-cf99e21bcd21 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:04.795492 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10fa275-d778-4546-99f3-51af8a968864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:04.796793 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fa275-d778-4546-99f3-51af8a968864 admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:04.797311 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fa275-d778-4546-99f3-51af8a968864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:04.798446 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fa275-d778-4546-99f3-51af8a968864 admin admin] PATH_INFO: `/v3/projects/4f6a12cf0a794265a9044bcfbc696da4/users/529f85faff0c497884048c5e00f35372/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:04.819185 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10fa275-d778-4546-99f3-51af8a968864 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f6a12cf0a794265a9044bcfbc696da4, user_id=529f85faff0c497884048c5e00f35372, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:04.822771 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10fa275-d778-4546-99f3-51af8a968864 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:04.828923 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:04.848062 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1280/2574] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:31:04 2022] PUT /identity/v3/projects/4f6a12cf0a794265a9044bcfbc696da4/users/529f85faff0c497884048c5e00f35372/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:04.850200 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c156b-6d50-46f2-b735-c504a2ded692 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:04.863411 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c156b-6d50-46f2-b735-c504a2ded692 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:04.928158 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:04.940951 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02ca22-5b43-4447-b5fe-2aaffca0fb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:04.941776 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02ca22-5b43-4447-b5fe-2aaffca0fb91 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:04.942163 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02ca22-5b43-4447-b5fe-2aaffca0fb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:04.942579 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02ca22-5b43-4447-b5fe-2aaffca0fb91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:04.943350 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e02ca22-5b43-4447-b5fe-2aaffca0fb91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:04.945138 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e02ca22-5b43-4447-b5fe-2aaffca0fb91 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:04.958037 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1295/2575] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:31:04.963922 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10fa275-d778-4546-99f3-51af8a968864 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:04.977893 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10fa275-d778-4546-99f3-51af8a968864 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:04.983895 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d686e2-e265-4e50-a552-e90a177e035c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:04.984683 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d686e2-e265-4e50-a552-e90a177e035c admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:04.985041 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d686e2-e265-4e50-a552-e90a177e035c admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:04.985395 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d686e2-e265-4e50-a552-e90a177e035c admin admin] PATH_INFO: `/v3/projects/4f6a12cf0a794265a9044bcfbc696da4/users/529f85faff0c497884048c5e00f35372/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:04.987749 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d686e2-e265-4e50-a552-e90a177e035c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f6a12cf0a794265a9044bcfbc696da4, user_id=529f85faff0c497884048c5e00f35372, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:04.990686 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d686e2-e265-4e50-a552-e90a177e035c admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:05.004969 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1281/2576] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:31:04 2022] PUT /identity/v3/projects/4f6a12cf0a794265a9044bcfbc696da4/users/529f85faff0c497884048c5e00f35372/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:31:05.021655 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df18b0-83b4-498e-8792-93da2c19e82a None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:05.022204 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df18b0-83b4-498e-8792-93da2c19e82a None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:05.022626 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df18b0-83b4-498e-8792-93da2c19e82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:05.061463 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-46df18b0-83b4-498e-8792-93da2c19e82a None None] MFA Rules not processed for user `529f85faff0c497884048c5e00f35372`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:05.063068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-46df18b0-83b4-498e-8792-93da2c19e82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:05.162167 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1296/2577] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:05 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:31:05.180290 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d686e2-e265-4e50-a552-e90a177e035c admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:05.183438 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-15d686e2-e265-4e50-a552-e90a177e035c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:05.278041 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d686e2-e265-4e50-a552-e90a177e035c admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:05.282717 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46706b03-3d2d-4c7c-aa8f-676fed48d3d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:05.283350 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46706b03-3d2d-4c7c-aa8f-676fed48d3d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:05.283628 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46706b03-3d2d-4c7c-aa8f-676fed48d3d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:05.283904 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46706b03-3d2d-4c7c-aa8f-676fed48d3d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:05.379097 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46706b03-3d2d-4c7c-aa8f-676fed48d3d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:05.380670 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46706b03-3d2d-4c7c-aa8f-676fed48d3d2 service cinder] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:05.393908 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1282/2578] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:31:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:31:07.237361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df18b0-83b4-498e-8792-93da2c19e82a None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:07.255124 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df18b0-83b4-498e-8792-93da2c19e82a None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:07.262185 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775be35a-2e33-4bd6-b589-795ff7e03021 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:07.263833 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775be35a-2e33-4bd6-b589-795ff7e03021 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:07.264328 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775be35a-2e33-4bd6-b589-795ff7e03021 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:07.264900 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775be35a-2e33-4bd6-b589-795ff7e03021 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:07.355546 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775be35a-2e33-4bd6-b589-795ff7e03021 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:07.357116 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775be35a-2e33-4bd6-b589-795ff7e03021 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:07.368030 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1297/2579] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:31:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:31:08.072725 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46706b03-3d2d-4c7c-aa8f-676fed48d3d2 service cinder] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:08.084062 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46706b03-3d2d-4c7c-aa8f-676fed48d3d2 service cinder] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:08.088329 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b4eb9-1a86-470e-9fe4-d2ebbd726556 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:08.089024 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b4eb9-1a86-470e-9fe4-d2ebbd726556 service cinder] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:08.089450 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b4eb9-1a86-470e-9fe4-d2ebbd726556 service cinder] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:08.089728 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b4eb9-1a86-470e-9fe4-d2ebbd726556 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:08.100829 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b4eb9-1a86-470e-9fe4-d2ebbd726556 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:08.102464 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b4eb9-1a86-470e-9fe4-d2ebbd726556 service cinder] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:08.114341 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1283/2580] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:31:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:31:11.147362 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775be35a-2e33-4bd6-b589-795ff7e03021 service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:11.149023 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-775be35a-2e33-4bd6-b589-795ff7e03021 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:11.222179 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775be35a-2e33-4bd6-b589-795ff7e03021 service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:11.227138 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356158ba-429c-4c7c-8686-61f1db2c93a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:11.227776 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356158ba-429c-4c7c-8686-61f1db2c93a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:11.228056 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356158ba-429c-4c7c-8686-61f1db2c93a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:11.228321 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356158ba-429c-4c7c-8686-61f1db2c93a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:11.230296 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-356158ba-429c-4c7c-8686-61f1db2c93a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:11.263852 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:11.313403 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356158ba-429c-4c7c-8686-61f1db2c93a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:11.315055 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356158ba-429c-4c7c-8686-61f1db2c93a2 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:11.328254 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1298/2581] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:31:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:31:12.273929 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b4eb9-1a86-470e-9fe4-d2ebbd726556 service cinder] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:12.296608 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b4eb9-1a86-470e-9fe4-d2ebbd726556 service cinder] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:12.304930 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94303a6-3b8f-4454-b3ff-c3648a7c999e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:12.306139 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94303a6-3b8f-4454-b3ff-c3648a7c999e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:12.306792 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94303a6-3b8f-4454-b3ff-c3648a7c999e admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:12.307528 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94303a6-3b8f-4454-b3ff-c3648a7c999e admin admin] PATH_INFO: `/v3/users/e02f9e55db914df09f54cd24e082f922` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:12.309997 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94303a6-3b8f-4454-b3ff-c3648a7c999e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e02f9e55db914df09f54cd24e082f922)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:12.313525 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94303a6-3b8f-4454-b3ff-c3648a7c999e admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:12.403636 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-f94303a6-3b8f-4454-b3ff-c3648a7c999e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e02f9e55db914df09f54cd24e082f922'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:12.430697 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-f94303a6-3b8f-4454-b3ff-c3648a7c999e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e02f9e55db914df09f54cd24e082f922'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:12.454506 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-f94303a6-3b8f-4454-b3ff-c3648a7c999e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e02f9e55db914df09f54cd24e082f922'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:12.455681 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-f94303a6-3b8f-4454-b3ff-c3648a7c999e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e02f9e55db914df09f54cd24e082f922'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:12.468952 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:12.470595 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-f94303a6-3b8f-4454-b3ff-c3648a7c999e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e02f9e55db914df09f54cd24e082f922'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:12.499236 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1284/2582] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:31:12 2022] DELETE /identity/v3/users/e02f9e55db914df09f54cd24e082f922 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:12.506668 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afe4f7-b54c-4b7f-ae11-b14066bc1d88 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:12.507279 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afe4f7-b54c-4b7f-ae11-b14066bc1d88 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:12.507631 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afe4f7-b54c-4b7f-ae11-b14066bc1d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:12.544949 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-07afe4f7-b54c-4b7f-ae11-b14066bc1d88 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:12.547662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-07afe4f7-b54c-4b7f-ae11-b14066bc1d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:12.739354 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1299/2583] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:31:12.777233 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94303a6-3b8f-4454-b3ff-c3648a7c999e admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:12.779786 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-f94303a6-3b8f-4454-b3ff-c3648a7c999e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:12.912238 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94303a6-3b8f-4454-b3ff-c3648a7c999e admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:12.916432 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463fe01-1293-42fa-9957-ff134bfdcf65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:12.917067 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463fe01-1293-42fa-9957-ff134bfdcf65 service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:12.917346 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463fe01-1293-42fa-9957-ff134bfdcf65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:12.917621 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463fe01-1293-42fa-9957-ff134bfdcf65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:12.929009 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9463fe01-1293-42fa-9957-ff134bfdcf65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:12.930504 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9463fe01-1293-42fa-9957-ff134bfdcf65 service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:12.942637 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1285/2584] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:31:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:31:13.431194 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07afe4f7-b54c-4b7f-ae11-b14066bc1d88 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:13.435829 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-07afe4f7-b54c-4b7f-ae11-b14066bc1d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:13.487346 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07afe4f7-b54c-4b7f-ae11-b14066bc1d88 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:13.495758 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0850c7-4491-409b-9698-0493adcd0664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:13.497295 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0850c7-4491-409b-9698-0493adcd0664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:13.498884 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0850c7-4491-409b-9698-0493adcd0664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:13.499693 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0850c7-4491-409b-9698-0493adcd0664 admin admin] PATH_INFO: `/v3/projects/4484a0dd57824fd1baa36f0ca8c68dfd` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:13.502215 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0850c7-4491-409b-9698-0493adcd0664 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4484a0dd57824fd1baa36f0ca8c68dfd)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:13.506221 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0850c7-4491-409b-9698-0493adcd0664 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:13.596593 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-cf0850c7-4491-409b-9698-0493adcd0664 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4484a0dd57824fd1baa36f0ca8c68dfd', 'request_id': 'req-cf0850c7-4491-409b-9698-0493adcd0664'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:13.610973 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-cf0850c7-4491-409b-9698-0493adcd0664 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4484a0dd57824fd1baa36f0ca8c68dfd', 'request_id': 'req-cf0850c7-4491-409b-9698-0493adcd0664'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:13.624006 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-cf0850c7-4491-409b-9698-0493adcd0664 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4484a0dd57824fd1baa36f0ca8c68dfd', 'request_id': 'req-cf0850c7-4491-409b-9698-0493adcd0664'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:13.648624 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-cf0850c7-4491-409b-9698-0493adcd0664 admin admin] The token cache is being invalidate because project 4484a0dd57824fd1baa36f0ca8c68dfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:31:13.649394 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-cf0850c7-4491-409b-9698-0493adcd0664 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:13.650625 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-cf0850c7-4491-409b-9698-0493adcd0664 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:13.653994 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1300/2585] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:31:13 2022] DELETE /identity/v3/projects/4484a0dd57824fd1baa36f0ca8c68dfd => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:13.660764 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463fe01-1293-42fa-9957-ff134bfdcf65 service neutron] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:13.680034 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463fe01-1293-42fa-9957-ff134bfdcf65 service neutron] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:13.791617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa177bc4-9138-43f6-a65a-16b59cf8152a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:13.793154 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa177bc4-9138-43f6-a65a-16b59cf8152a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:13.793800 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa177bc4-9138-43f6-a65a-16b59cf8152a admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:13.794528 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa177bc4-9138-43f6-a65a-16b59cf8152a admin admin] PATH_INFO: `/v3/users/9c63aece11304306942832c32902592f` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:13.799536 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa177bc4-9138-43f6-a65a-16b59cf8152a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c63aece11304306942832c32902592f)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:13.801245 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa177bc4-9138-43f6-a65a-16b59cf8152a admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:13.907832 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-aa177bc4-9138-43f6-a65a-16b59cf8152a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c63aece11304306942832c32902592f'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:13.947216 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-aa177bc4-9138-43f6-a65a-16b59cf8152a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c63aece11304306942832c32902592f'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:13.969244 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-aa177bc4-9138-43f6-a65a-16b59cf8152a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c63aece11304306942832c32902592f'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:13.974930 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-aa177bc4-9138-43f6-a65a-16b59cf8152a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c63aece11304306942832c32902592f'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:13.991873 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-aa177bc4-9138-43f6-a65a-16b59cf8152a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c63aece11304306942832c32902592f'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:14.006417 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1286/2586] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:31:13 2022] DELETE /identity/v3/users/9c63aece11304306942832c32902592f => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:14.743186 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0850c7-4491-409b-9698-0493adcd0664 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:14.745507 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-cf0850c7-4491-409b-9698-0493adcd0664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:14.764279 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0850c7-4491-409b-9698-0493adcd0664 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:14.843386 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:14.874921 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0db09-6abd-4865-a22b-6243800300b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:14.876651 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0db09-6abd-4865-a22b-6243800300b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:14.877163 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0db09-6abd-4865-a22b-6243800300b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:14.877656 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0db09-6abd-4865-a22b-6243800300b9 admin admin] PATH_INFO: `/v3/projects/775ffde72a554e228c910e63114f738d` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:14.880543 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b0db09-6abd-4865-a22b-6243800300b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=775ffde72a554e228c910e63114f738d)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:14.884541 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b0db09-6abd-4865-a22b-6243800300b9 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:14.982172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f2b0db09-6abd-4865-a22b-6243800300b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '775ffde72a554e228c910e63114f738d', 'request_id': 'req-f2b0db09-6abd-4865-a22b-6243800300b9'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:14.995749 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f2b0db09-6abd-4865-a22b-6243800300b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '775ffde72a554e228c910e63114f738d', 'request_id': 'req-f2b0db09-6abd-4865-a22b-6243800300b9'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:15.008945 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f2b0db09-6abd-4865-a22b-6243800300b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '775ffde72a554e228c910e63114f738d', 'request_id': 'req-f2b0db09-6abd-4865-a22b-6243800300b9'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:15.030606 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f2b0db09-6abd-4865-a22b-6243800300b9 admin admin] The token cache is being invalidate because project 775ffde72a554e228c910e63114f738d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:31:15.031079 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f2b0db09-6abd-4865-a22b-6243800300b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:15.031950 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f2b0db09-6abd-4865-a22b-6243800300b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:15.034099 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1301/2587] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:31:14 2022] DELETE /identity/v3/projects/775ffde72a554e228c910e63114f738d => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:15.038157 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa177bc4-9138-43f6-a65a-16b59cf8152a admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:15.040344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-aa177bc4-9138-43f6-a65a-16b59cf8152a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:15.056395 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa177bc4-9138-43f6-a65a-16b59cf8152a admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:15.089839 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:15.205887 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c898bab-fb39-46a9-8243-2d76c7922957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:15.206643 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c898bab-fb39-46a9-8243-2d76c7922957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:15.206927 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c898bab-fb39-46a9-8243-2d76c7922957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:15.207204 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c898bab-fb39-46a9-8243-2d76c7922957 admin admin] PATH_INFO: `/v3/users/529f85faff0c497884048c5e00f35372` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:15.208565 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c898bab-fb39-46a9-8243-2d76c7922957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=529f85faff0c497884048c5e00f35372)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:15.210671 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c898bab-fb39-46a9-8243-2d76c7922957 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:15.312585 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-3c898bab-fb39-46a9-8243-2d76c7922957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '529f85faff0c497884048c5e00f35372'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:15.345840 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-3c898bab-fb39-46a9-8243-2d76c7922957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '529f85faff0c497884048c5e00f35372'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:15.359289 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-3c898bab-fb39-46a9-8243-2d76c7922957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '529f85faff0c497884048c5e00f35372'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:15.360379 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-3c898bab-fb39-46a9-8243-2d76c7922957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '529f85faff0c497884048c5e00f35372'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:15.403601 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-3c898bab-fb39-46a9-8243-2d76c7922957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '529f85faff0c497884048c5e00f35372'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:15.416534 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1287/2588] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:31:15 2022] DELETE /identity/v3/users/529f85faff0c497884048c5e00f35372 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:16.128821 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0db09-6abd-4865-a22b-6243800300b9 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:16.133147 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f2b0db09-6abd-4865-a22b-6243800300b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:16.161112 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0db09-6abd-4865-a22b-6243800300b9 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:16.319778 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f677d3-aaa0-4313-a976-ecead3a95e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:16.322190 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f677d3-aaa0-4313-a976-ecead3a95e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:16.322586 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f677d3-aaa0-4313-a976-ecead3a95e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:16.322869 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f677d3-aaa0-4313-a976-ecead3a95e60 admin admin] PATH_INFO: `/v3/projects/4f6a12cf0a794265a9044bcfbc696da4` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:16.329280 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f677d3-aaa0-4313-a976-ecead3a95e60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f6a12cf0a794265a9044bcfbc696da4)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:16.340507 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f677d3-aaa0-4313-a976-ecead3a95e60 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:16.494201 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-e6f677d3-aaa0-4313-a976-ecead3a95e60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f6a12cf0a794265a9044bcfbc696da4', 'request_id': 'req-e6f677d3-aaa0-4313-a976-ecead3a95e60'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:16.519065 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-e6f677d3-aaa0-4313-a976-ecead3a95e60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f6a12cf0a794265a9044bcfbc696da4', 'request_id': 'req-e6f677d3-aaa0-4313-a976-ecead3a95e60'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:16.539808 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-e6f677d3-aaa0-4313-a976-ecead3a95e60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f6a12cf0a794265a9044bcfbc696da4', 'request_id': 'req-e6f677d3-aaa0-4313-a976-ecead3a95e60'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:16.575079 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-e6f677d3-aaa0-4313-a976-ecead3a95e60 admin admin] The token cache is being invalidate because project 4f6a12cf0a794265a9044bcfbc696da4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:31:16.575079 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-e6f677d3-aaa0-4313-a976-ecead3a95e60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:16.578246 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-e6f677d3-aaa0-4313-a976-ecead3a95e60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:16.585308 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1302/2589] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:31:16 2022] DELETE /identity/v3/projects/4f6a12cf0a794265a9044bcfbc696da4 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:16.587920 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f7416-2e98-43d1-98fb-5f9b22424d56 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:16.588520 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f7416-2e98-43d1-98fb-5f9b22424d56 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:16.588520 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f7416-2e98-43d1-98fb-5f9b22424d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:16.618021 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-c36f7416-2e98-43d1-98fb-5f9b22424d56 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:16.623435 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-c36f7416-2e98-43d1-98fb-5f9b22424d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:16.725819 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1288/2590] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:31:16.735883 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bda679-e65f-4635-aaec-b523a46836c0 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:16.736160 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bda679-e65f-4635-aaec-b523a46836c0 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:16.736530 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bda679-e65f-4635-aaec-b523a46836c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:16.765070 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:16.779714 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-83bda679-e65f-4635-aaec-b523a46836c0 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:16.782679 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-83bda679-e65f-4635-aaec-b523a46836c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:16.805231 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1303/2591] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:31:16.812181 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f7416-2e98-43d1-98fb-5f9b22424d56 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:16.833833 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f7416-2e98-43d1-98fb-5f9b22424d56 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:16.841162 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22457fbf-b91f-4fe0-915a-96be5195e6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:16.843734 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22457fbf-b91f-4fe0-915a-96be5195e6e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:16.844570 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22457fbf-b91f-4fe0-915a-96be5195e6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:16.845102 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22457fbf-b91f-4fe0-915a-96be5195e6e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:16.846339 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22457fbf-b91f-4fe0-915a-96be5195e6e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:31:16.846913 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22457fbf-b91f-4fe0-915a-96be5195e6e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:16.850014 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22457fbf-b91f-4fe0-915a-96be5195e6e3 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:16.878475 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1289/2592] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:31:16.881616 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bda679-e65f-4635-aaec-b523a46836c0 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:16.894796 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bda679-e65f-4635-aaec-b523a46836c0 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:16.907409 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8918ae2-5cf8-4496-94ca-fe391447c59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:16.909208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8918ae2-5cf8-4496-94ca-fe391447c59f admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:16.910083 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8918ae2-5cf8-4496-94ca-fe391447c59f admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:16.910884 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8918ae2-5cf8-4496-94ca-fe391447c59f admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:16.912469 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8918ae2-5cf8-4496-94ca-fe391447c59f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:16.920212 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8918ae2-5cf8-4496-94ca-fe391447c59f admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:16.981752 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1304/2593] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:31:16 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:31:16.984472 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22457fbf-b91f-4fe0-915a-96be5195e6e3 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:17.014399 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22457fbf-b91f-4fe0-915a-96be5195e6e3 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:17.066581 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8918ae2-5cf8-4496-94ca-fe391447c59f admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:17.077032 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d8918ae2-5cf8-4496-94ca-fe391447c59f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:17.097594 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:17.171957 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ac1ca-c14f-470c-ac6e-8cd1cbc1d55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:17.173099 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ac1ca-c14f-470c-ac6e-8cd1cbc1d55f admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:17.173663 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ac1ca-c14f-470c-ac6e-8cd1cbc1d55f admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:17.174261 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ac1ca-c14f-470c-ac6e-8cd1cbc1d55f admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:17.176329 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ac1ca-c14f-470c-ac6e-8cd1cbc1d55f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:17.179897 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ac1ca-c14f-470c-ac6e-8cd1cbc1d55f admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:17.222908 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1290/2594] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:31:16 2022] POST /identity/v3/users => generated 293 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:31:17.230600 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ac1ca-c14f-470c-ac6e-8cd1cbc1d55f admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:17.246428 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ac1ca-c14f-470c-ac6e-8cd1cbc1d55f admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:17.257818 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfc970-6e36-41f0-9eb5-65c657573402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:17.260558 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfc970-6e36-41f0-9eb5-65c657573402 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:17.261030 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfc970-6e36-41f0-9eb5-65c657573402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:17.261561 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfc970-6e36-41f0-9eb5-65c657573402 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:17.263373 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbfc970-6e36-41f0-9eb5-65c657573402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:17.264479 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8918ae2-5cf8-4496-94ca-fe391447c59f admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:17.266671 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbfc970-6e36-41f0-9eb5-65c657573402 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:17.279588 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf08f90-b97e-4243-978e-33abe81d2574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:17.280679 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf08f90-b97e-4243-978e-33abe81d2574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:17.281172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf08f90-b97e-4243-978e-33abe81d2574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:17.281680 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf08f90-b97e-4243-978e-33abe81d2574 admin admin] PATH_INFO: `/v3/users/cf20489fb7624e34b71ed9f03c2f50d7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:17.283955 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf08f90-b97e-4243-978e-33abe81d2574 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf20489fb7624e34b71ed9f03c2f50d7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:17.284591 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1291/2595] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:31:17.288501 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf08f90-b97e-4243-978e-33abe81d2574 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:17.288826 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfc970-6e36-41f0-9eb5-65c657573402 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:17.302534 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfc970-6e36-41f0-9eb5-65c657573402 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:17.309006 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c241a95-aa60-490a-b194-7d2b37bcfce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:17.310109 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c241a95-aa60-490a-b194-7d2b37bcfce4 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:17.310649 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c241a95-aa60-490a-b194-7d2b37bcfce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:17.311320 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c241a95-aa60-490a-b194-7d2b37bcfce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:17.312216 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c241a95-aa60-490a-b194-7d2b37bcfce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:17.314261 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c241a95-aa60-490a-b194-7d2b37bcfce4 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:17.327856 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1292/2596] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:31:17.332721 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c241a95-aa60-490a-b194-7d2b37bcfce4 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:17.346785 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c241a95-aa60-490a-b194-7d2b37bcfce4 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:17.355570 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf7910-504a-4bd6-8396-b7eaa0ee1424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:17.356623 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf7910-504a-4bd6-8396-b7eaa0ee1424 admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:17.357133 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf7910-504a-4bd6-8396-b7eaa0ee1424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:17.357633 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf7910-504a-4bd6-8396-b7eaa0ee1424 admin admin] PATH_INFO: `/v3/projects/b6bae04488944a7a9f21a75031cc6d30/users/1f98f45747b14768aaca7464fbf94a2f/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:17.379969 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bf7910-504a-4bd6-8396-b7eaa0ee1424 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6bae04488944a7a9f21a75031cc6d30, user_id=1f98f45747b14768aaca7464fbf94a2f, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:17.383500 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bf7910-504a-4bd6-8396-b7eaa0ee1424 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:17.413446 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1293/2597] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:31:17 2022] PUT /identity/v3/projects/b6bae04488944a7a9f21a75031cc6d30/users/1f98f45747b14768aaca7464fbf94a2f/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:17.414307 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ecf08f90-b97e-4243-978e-33abe81d2574 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf20489fb7624e34b71ed9f03c2f50d7'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:17.430699 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e09563-55b4-4f83-aef2-fdea9dda9942 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:17.431519 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e09563-55b4-4f83-aef2-fdea9dda9942 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:17.432183 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e09563-55b4-4f83-aef2-fdea9dda9942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:17.438200 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ecf08f90-b97e-4243-978e-33abe81d2574 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf20489fb7624e34b71ed9f03c2f50d7'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:17.467760 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ecf08f90-b97e-4243-978e-33abe81d2574 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf20489fb7624e34b71ed9f03c2f50d7'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:17.468983 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ecf08f90-b97e-4243-978e-33abe81d2574 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf20489fb7624e34b71ed9f03c2f50d7'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:17.487692 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ecf08f90-b97e-4243-978e-33abe81d2574 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf20489fb7624e34b71ed9f03c2f50d7'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:17.497113 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-b1e09563-55b4-4f83-aef2-fdea9dda9942 None None] MFA Rules not processed for user `1f98f45747b14768aaca7464fbf94a2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:17.500230 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-b1e09563-55b4-4f83-aef2-fdea9dda9942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:17.509508 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1305/2598] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:31:17 2022] DELETE /identity/v3/users/cf20489fb7624e34b71ed9f03c2f50d7 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:17.666412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1294/2599] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:31:17.674433 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf08f90-b97e-4243-978e-33abe81d2574 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:17.677735 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ecf08f90-b97e-4243-978e-33abe81d2574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:17.845197 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:17.867462 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf08f90-b97e-4243-978e-33abe81d2574 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:17.883174 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0892818-e292-4f6a-85e1-e7355dd4d33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:17.884669 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0892818-e292-4f6a-85e1-e7355dd4d33f admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:17.885427 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0892818-e292-4f6a-85e1-e7355dd4d33f admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:17.885760 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0892818-e292-4f6a-85e1-e7355dd4d33f admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:17.888191 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0892818-e292-4f6a-85e1-e7355dd4d33f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:17.897068 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0892818-e292-4f6a-85e1-e7355dd4d33f admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:17.920052 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e09563-55b4-4f83-aef2-fdea9dda9942 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:17.924871 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-b1e09563-55b4-4f83-aef2-fdea9dda9942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:17.970272 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1306/2600] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:31:17 2022] POST /identity/v3/projects => generated 385 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:31:17.973844 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0892818-e292-4f6a-85e1-e7355dd4d33f admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:18.119502 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:18.135685 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e09563-55b4-4f83-aef2-fdea9dda9942 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:18.201346 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0892818-e292-4f6a-85e1-e7355dd4d33f admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:18.210122 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14549f-60ab-47a9-8393-c0adbd023eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:18.211140 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14549f-60ab-47a9-8393-c0adbd023eab admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:18.211613 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14549f-60ab-47a9-8393-c0adbd023eab admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:18.212081 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14549f-60ab-47a9-8393-c0adbd023eab admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:18.213227 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc14549f-60ab-47a9-8393-c0adbd023eab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:18.228268 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc14549f-60ab-47a9-8393-c0adbd023eab admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:18.268988 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fd5c9-e7bb-4f91-a06b-61b39ae07136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:18.269531 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fd5c9-e7bb-4f91-a06b-61b39ae07136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:18.270102 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fd5c9-e7bb-4f91-a06b-61b39ae07136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:18.270558 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fd5c9-e7bb-4f91-a06b-61b39ae07136 admin admin] PATH_INFO: `/v3/projects/6aac7fa433e54b0989e78322432d20f7` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:18.272363 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3fd5c9-e7bb-4f91-a06b-61b39ae07136 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aac7fa433e54b0989e78322432d20f7)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:18.275902 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3fd5c9-e7bb-4f91-a06b-61b39ae07136 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:18.286081 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1307/2601] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:31:17 2022] POST /identity/v3/users => generated 293 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:31:18.292418 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14549f-60ab-47a9-8393-c0adbd023eab admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:18.333390 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14549f-60ab-47a9-8393-c0adbd023eab admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:18.343825 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6dc9c-c631-4b1b-8a5b-eb983fe6deef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:18.344916 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6dc9c-c631-4b1b-8a5b-eb983fe6deef admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:18.345840 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6dc9c-c631-4b1b-8a5b-eb983fe6deef admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:18.346324 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6dc9c-c631-4b1b-8a5b-eb983fe6deef admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:18.347490 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6dc9c-c631-4b1b-8a5b-eb983fe6deef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:18.350292 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6dc9c-c631-4b1b-8a5b-eb983fe6deef admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:18.374524 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1308/2602] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:31:18.378242 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6dc9c-c631-4b1b-8a5b-eb983fe6deef admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:18.385340 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-cd3fd5c9-e7bb-4f91-a06b-61b39ae07136 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aac7fa433e54b0989e78322432d20f7', 'request_id': 'req-cd3fd5c9-e7bb-4f91-a06b-61b39ae07136'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:18.398757 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-cd3fd5c9-e7bb-4f91-a06b-61b39ae07136 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aac7fa433e54b0989e78322432d20f7', 'request_id': 'req-cd3fd5c9-e7bb-4f91-a06b-61b39ae07136'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:18.406187 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6dc9c-c631-4b1b-8a5b-eb983fe6deef admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:18.417975 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-cd3fd5c9-e7bb-4f91-a06b-61b39ae07136 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aac7fa433e54b0989e78322432d20f7', 'request_id': 'req-cd3fd5c9-e7bb-4f91-a06b-61b39ae07136'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:18.444852 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-cd3fd5c9-e7bb-4f91-a06b-61b39ae07136 admin admin] The token cache is being invalidate because project 6aac7fa433e54b0989e78322432d20f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:31:18.445555 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-cd3fd5c9-e7bb-4f91-a06b-61b39ae07136 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:18.446964 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-cd3fd5c9-e7bb-4f91-a06b-61b39ae07136 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:18.449668 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1295/2603] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:31:17 2022] DELETE /identity/v3/projects/6aac7fa433e54b0989e78322432d20f7 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:31:18.456914 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec12bb-7ebe-4f01-9f62-64b8855d659d None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:18.457972 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec12bb-7ebe-4f01-9f62-64b8855d659d None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:18.457972 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec12bb-7ebe-4f01-9f62-64b8855d659d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:18.487866 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-79ec12bb-7ebe-4f01-9f62-64b8855d659d None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:18.489842 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-79ec12bb-7ebe-4f01-9f62-64b8855d659d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:18.509582 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5591531-7a9c-43c3-9870-d2fe02d4451e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:18.510679 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5591531-7a9c-43c3-9870-d2fe02d4451e admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:18.511187 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5591531-7a9c-43c3-9870-d2fe02d4451e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:18.511644 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5591531-7a9c-43c3-9870-d2fe02d4451e admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:18.514354 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5591531-7a9c-43c3-9870-d2fe02d4451e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:18.516682 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5591531-7a9c-43c3-9870-d2fe02d4451e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:18.540203 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1309/2604] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:31:18.541882 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5591531-7a9c-43c3-9870-d2fe02d4451e admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:18.544888 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a5591531-7a9c-43c3-9870-d2fe02d4451e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:18.568947 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5591531-7a9c-43c3-9870-d2fe02d4451e admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:18.583061 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a57f5-e391-43b7-afa8-4154d414b164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:18.584207 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a57f5-e391-43b7-afa8-4154d414b164 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:18.584706 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a57f5-e391-43b7-afa8-4154d414b164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:18.585244 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a57f5-e391-43b7-afa8-4154d414b164 admin admin] PATH_INFO: `/v3/projects/dc6f4dd58fc64ca79a14536a8f020a92/users/b6d69ca331f6439584710c900becbcda/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:18.607279 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a57f5-e391-43b7-afa8-4154d414b164 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc6f4dd58fc64ca79a14536a8f020a92, user_id=b6d69ca331f6439584710c900becbcda, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:18.609565 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1296/2605] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:31:18.611086 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a57f5-e391-43b7-afa8-4154d414b164 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:18.621378 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea7b22-c270-4bad-8969-aacbd2097107 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:18.622486 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea7b22-c270-4bad-8969-aacbd2097107 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:18.622887 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea7b22-c270-4bad-8969-aacbd2097107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:18.634875 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1310/2606] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:31:18 2022] PUT /identity/v3/projects/dc6f4dd58fc64ca79a14536a8f020a92/users/b6d69ca331f6439584710c900becbcda/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:18.646950 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-b4ea7b22-c270-4bad-8969-aacbd2097107 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:18.648412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-b4ea7b22-c270-4bad-8969-aacbd2097107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:18.653486 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a339d4-d22f-4760-862f-3e0fdee83ad0 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:18.653959 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a339d4-d22f-4760-862f-3e0fdee83ad0 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:18.654453 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a339d4-d22f-4760-862f-3e0fdee83ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:18.694960 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:18.702860 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-41a339d4-d22f-4760-862f-3e0fdee83ad0 None None] MFA Rules not processed for user `b6d69ca331f6439584710c900becbcda`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:18.704966 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-41a339d4-d22f-4760-862f-3e0fdee83ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:18.739129 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:18.744330 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1297/2607] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:31:18.749812 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea7b22-c270-4bad-8969-aacbd2097107 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:18.763368 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea7b22-c270-4bad-8969-aacbd2097107 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:18.769022 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a962f-0a15-441c-9c69-c9a479369230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:18.769786 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a962f-0a15-441c-9c69-c9a479369230 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:18.770171 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a962f-0a15-441c-9c69-c9a479369230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:18.770588 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a962f-0a15-441c-9c69-c9a479369230 admin admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:18.771421 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a962f-0a15-441c-9c69-c9a479369230 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:31:18.771874 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a962f-0a15-441c-9c69-c9a479369230 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:18.773774 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a962f-0a15-441c-9c69-c9a479369230 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:18.794724 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1298/2608] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:31:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:31:18.796170 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a962f-0a15-441c-9c69-c9a479369230 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:18.804863 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1311/2609] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:31:18.810045 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a962f-0a15-441c-9c69-c9a479369230 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:18.810473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a339d4-d22f-4760-862f-3e0fdee83ad0 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:18.817961 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f90e3-7d6d-4db7-b3b9-32da1b11dd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:18.818970 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f90e3-7d6d-4db7-b3b9-32da1b11dd30 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:18.819449 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f90e3-7d6d-4db7-b3b9-32da1b11dd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:18.819912 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f90e3-7d6d-4db7-b3b9-32da1b11dd30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:18.820995 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f90e3-7d6d-4db7-b3b9-32da1b11dd30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:18.824083 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f90e3-7d6d-4db7-b3b9-32da1b11dd30 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:18.828573 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a339d4-d22f-4760-862f-3e0fdee83ad0 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:18.835460 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d80d7-3f51-48cc-a8a8-f1f2b9d9dd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:18.836351 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d80d7-3f51-48cc-a8a8-f1f2b9d9dd24 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:18.836734 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d80d7-3f51-48cc-a8a8-f1f2b9d9dd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:18.837151 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d80d7-3f51-48cc-a8a8-f1f2b9d9dd24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:18.838684 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793d80d7-3f51-48cc-a8a8-f1f2b9d9dd24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:18.842300 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793d80d7-3f51-48cc-a8a8-f1f2b9d9dd24 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:18.861420 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1299/2610] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:31:18 2022] POST /identity/v3/projects => generated 371 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:31:18.866570 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f90e3-7d6d-4db7-b3b9-32da1b11dd30 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:18.884338 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1312/2611] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:31:18 2022] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:31:18.886220 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d80d7-3f51-48cc-a8a8-f1f2b9d9dd24 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:18.956393 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f90e3-7d6d-4db7-b3b9-32da1b11dd30 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:18.983459 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d80d7-3f51-48cc-a8a8-f1f2b9d9dd24 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:18.991627 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9364f-1d81-4f9b-9844-8c47d7e64b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:18.992647 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9364f-1d81-4f9b-9844-8c47d7e64b82 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:18.993116 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9364f-1d81-4f9b-9844-8c47d7e64b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:18.993597 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9364f-1d81-4f9b-9844-8c47d7e64b82 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:18.994814 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9364f-1d81-4f9b-9844-8c47d7e64b82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:18.999056 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9364f-1d81-4f9b-9844-8c47d7e64b82 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:19.036528 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1313/2612] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:31:18 2022] POST /identity/v3/users => generated 299 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:31:19.038577 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9364f-1d81-4f9b-9844-8c47d7e64b82 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:19.051524 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9364f-1d81-4f9b-9844-8c47d7e64b82 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:19.052481 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32c6b9-6dac-4b1e-9a6d-4c3c410d4793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:19.053332 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32c6b9-6dac-4b1e-9a6d-4c3c410d4793 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:19.053765 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32c6b9-6dac-4b1e-9a6d-4c3c410d4793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:19.054139 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32c6b9-6dac-4b1e-9a6d-4c3c410d4793 admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:19.054935 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e32c6b9-6dac-4b1e-9a6d-4c3c410d4793 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:19.057086 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e32c6b9-6dac-4b1e-9a6d-4c3c410d4793 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:19.057545 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb4ad60-aaf4-467f-a33e-c1ea272d29e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:19.058243 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4ad60-aaf4-467f-a33e-c1ea272d29e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:19.058620 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4ad60-aaf4-467f-a33e-c1ea272d29e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:19.059550 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4ad60-aaf4-467f-a33e-c1ea272d29e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:19.060295 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb4ad60-aaf4-467f-a33e-c1ea272d29e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:19.062406 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb4ad60-aaf4-467f-a33e-c1ea272d29e8 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:19.082793 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1314/2613] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:31:19.084689 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb4ad60-aaf4-467f-a33e-c1ea272d29e8 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:19.094408 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1300/2614] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:31:18 2022] POST /identity/v3/users => generated 286 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:31:19.096694 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32c6b9-6dac-4b1e-9a6d-4c3c410d4793 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:19.101533 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb4ad60-aaf4-467f-a33e-c1ea272d29e8 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:19.111044 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d8b32-1fb9-4054-8913-252ca4824c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:19.112100 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d8b32-1fb9-4054-8913-252ca4824c64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:19.112583 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d8b32-1fb9-4054-8913-252ca4824c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:19.113050 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d8b32-1fb9-4054-8913-252ca4824c64 admin admin] PATH_INFO: `/v3/projects/dc6b7486a922499bb1ec48f488985608/users/e024893771ed41048e9d6708f43aeebd/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:19.114780 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32c6b9-6dac-4b1e-9a6d-4c3c410d4793 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:19.122142 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c69df69-1da7-4110-aa44-3ff70e9d6db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:19.123155 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69df69-1da7-4110-aa44-3ff70e9d6db4 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:19.123796 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69df69-1da7-4110-aa44-3ff70e9d6db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:19.124216 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69df69-1da7-4110-aa44-3ff70e9d6db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:19.125425 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c69df69-1da7-4110-aa44-3ff70e9d6db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:19.128345 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c69df69-1da7-4110-aa44-3ff70e9d6db4 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:19.141112 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d8b32-1fb9-4054-8913-252ca4824c64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc6b7486a922499bb1ec48f488985608, user_id=e024893771ed41048e9d6708f43aeebd, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:19.145942 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d8b32-1fb9-4054-8913-252ca4824c64 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:19.150070 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1301/2615] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:31:19.151388 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c69df69-1da7-4110-aa44-3ff70e9d6db4 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:19.166768 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c69df69-1da7-4110-aa44-3ff70e9d6db4 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:19.170790 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1315/2616] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:31:19 2022] PUT /identity/v3/projects/dc6b7486a922499bb1ec48f488985608/users/e024893771ed41048e9d6708f43aeebd/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:31:19.176862 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d8b32-1fb9-4054-8913-252ca4824c64 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:19.207974 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:19.267929 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a512dd-ff50-49aa-ad1d-fd1b3d2c7709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:19.269009 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a512dd-ff50-49aa-ad1d-fd1b3d2c7709 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:19.269507 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a512dd-ff50-49aa-ad1d-fd1b3d2c7709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:19.270004 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a512dd-ff50-49aa-ad1d-fd1b3d2c7709 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:19.270555 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:19.271256 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a512dd-ff50-49aa-ad1d-fd1b3d2c7709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:19.274878 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a512dd-ff50-49aa-ad1d-fd1b3d2c7709 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:19.279793 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d8b32-1fb9-4054-8913-252ca4824c64 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:19.286559 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869da109-6535-4bec-a045-99e3172585e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:19.287280 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869da109-6535-4bec-a045-99e3172585e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:19.287614 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869da109-6535-4bec-a045-99e3172585e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:19.288037 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869da109-6535-4bec-a045-99e3172585e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:19.288806 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869da109-6535-4bec-a045-99e3172585e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:19.290950 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869da109-6535-4bec-a045-99e3172585e8 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:19.300581 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1302/2617] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:31:19.302200 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a512dd-ff50-49aa-ad1d-fd1b3d2c7709 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:19.307815 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1316/2618] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:31:19.313689 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869da109-6535-4bec-a045-99e3172585e8 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:19.314980 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a512dd-ff50-49aa-ad1d-fd1b3d2c7709 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:19.320238 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63786f6f-adb2-4be3-978f-ac575e9341ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:19.323376 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63786f6f-adb2-4be3-978f-ac575e9341ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:19.323376 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63786f6f-adb2-4be3-978f-ac575e9341ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:19.323376 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63786f6f-adb2-4be3-978f-ac575e9341ca admin admin] PATH_INFO: `/v3/projects/68e4f8dd99a542e4bcb4714538813f04/users/67451f759261420d903ffea113a883fc/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:19.330405 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869da109-6535-4bec-a045-99e3172585e8 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:19.340096 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ab886-cb1a-4140-9334-8f2f6ef17ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:19.341577 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63786f6f-adb2-4be3-978f-ac575e9341ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=68e4f8dd99a542e4bcb4714538813f04, user_id=67451f759261420d903ffea113a883fc, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:19.341709 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ab886-cb1a-4140-9334-8f2f6ef17ecc admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:19.346655 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ab886-cb1a-4140-9334-8f2f6ef17ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:19.346655 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ab886-cb1a-4140-9334-8f2f6ef17ecc admin admin] PATH_INFO: `/v3/projects/dc6b7486a922499bb1ec48f488985608/users/e024893771ed41048e9d6708f43aeebd/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:19.346990 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63786f6f-adb2-4be3-978f-ac575e9341ca admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:19.354957 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ab886-cb1a-4140-9334-8f2f6ef17ecc admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc6b7486a922499bb1ec48f488985608, user_id=e024893771ed41048e9d6708f43aeebd, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:19.361268 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ab886-cb1a-4140-9334-8f2f6ef17ecc admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:19.378401 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1303/2619] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:31:19 2022] PUT /identity/v3/projects/68e4f8dd99a542e4bcb4714538813f04/users/67451f759261420d903ffea113a883fc/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:19.381008 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3f4d1-95cf-4921-b1e4-3e5e2aa4f5f4 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:19.381494 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3f4d1-95cf-4921-b1e4-3e5e2aa4f5f4 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:19.382037 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3f4d1-95cf-4921-b1e4-3e5e2aa4f5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:19.393707 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1317/2620] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:31:19 2022] PUT /identity/v3/projects/dc6b7486a922499bb1ec48f488985608/users/e024893771ed41048e9d6708f43aeebd/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:31:19.408145 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd032f-8aa8-48ce-82be-355ff5d37755 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:19.408861 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd032f-8aa8-48ce-82be-355ff5d37755 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:19.409255 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd032f-8aa8-48ce-82be-355ff5d37755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:19.429602 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-77b3f4d1-95cf-4921-b1e4-3e5e2aa4f5f4 None None] MFA Rules not processed for user `67451f759261420d903ffea113a883fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:19.443359 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-77b3f4d1-95cf-4921-b1e4-3e5e2aa4f5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:19.464236 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-3ccd032f-8aa8-48ce-82be-355ff5d37755 None None] MFA Rules not processed for user `e024893771ed41048e9d6708f43aeebd`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:19.466822 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-3ccd032f-8aa8-48ce-82be-355ff5d37755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:19.572657 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1304/2621] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:31:19.580967 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3f4d1-95cf-4921-b1e4-3e5e2aa4f5f4 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:19.604212 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1318/2622] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:19 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:31:19.624992 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd032f-8aa8-48ce-82be-355ff5d37755 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:19.627746 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-3ccd032f-8aa8-48ce-82be-355ff5d37755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:19.726889 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3f4d1-95cf-4921-b1e4-3e5e2aa4f5f4 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:19.737056 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94ea9f-f0e2-41ba-86e5-f230ac5be686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:19.738042 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94ea9f-f0e2-41ba-86e5-f230ac5be686 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:19.738498 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94ea9f-f0e2-41ba-86e5-f230ac5be686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:19.738905 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94ea9f-f0e2-41ba-86e5-f230ac5be686 admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:19.739966 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b94ea9f-f0e2-41ba-86e5-f230ac5be686 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:19.742610 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b94ea9f-f0e2-41ba-86e5-f230ac5be686 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:19.746130 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd032f-8aa8-48ce-82be-355ff5d37755 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:19.751474 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b456f-9d3f-48e2-ae8f-61a7fad940c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:19.752325 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b456f-9d3f-48e2-ae8f-61a7fad940c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:19.752744 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b456f-9d3f-48e2-ae8f-61a7fad940c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:19.753046 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b456f-9d3f-48e2-ae8f-61a7fad940c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:19.755656 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b42b456f-9d3f-48e2-ae8f-61a7fad940c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:19.786277 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1305/2623] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:31:19 2022] POST /identity/v3/projects => generated 371 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:31:19.791728 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94ea9f-f0e2-41ba-86e5-f230ac5be686 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:19.809953 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:19.854178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b456f-9d3f-48e2-ae8f-61a7fad940c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:19.857156 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b456f-9d3f-48e2-ae8f-61a7fad940c8 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:19.876174 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1319/2624] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:31:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:31:19.888453 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94ea9f-f0e2-41ba-86e5-f230ac5be686 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:19.897142 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4425cb-b428-4cf8-aaa3-d8f043b75e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:19.898251 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4425cb-b428-4cf8-aaa3-d8f043b75e2e admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:19.898805 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4425cb-b428-4cf8-aaa3-d8f043b75e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:19.899549 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4425cb-b428-4cf8-aaa3-d8f043b75e2e admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:19.900753 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4425cb-b428-4cf8-aaa3-d8f043b75e2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:19.905163 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4425cb-b428-4cf8-aaa3-d8f043b75e2e admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:19.943126 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1306/2625] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:31:19 2022] POST /identity/v3/users => generated 292 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:31:19.944448 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b456f-9d3f-48e2-ae8f-61a7fad940c8 service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:19.965766 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b456f-9d3f-48e2-ae8f-61a7fad940c8 service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:19.976176 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01228e65-7ae5-4853-ab42-81b421b0bb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:19.977001 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01228e65-7ae5-4853-ab42-81b421b0bb2f admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:19.977159 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01228e65-7ae5-4853-ab42-81b421b0bb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:19.977348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01228e65-7ae5-4853-ab42-81b421b0bb2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:19.978009 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01228e65-7ae5-4853-ab42-81b421b0bb2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:19.979723 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01228e65-7ae5-4853-ab42-81b421b0bb2f admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:19.992912 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1320/2626] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:31:19.997730 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4425cb-b428-4cf8-aaa3-d8f043b75e2e admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:20.008968 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4425cb-b428-4cf8-aaa3-d8f043b75e2e admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:20.015807 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7304a-1738-4bfb-a801-b994cd1c9174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:20.016511 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7304a-1738-4bfb-a801-b994cd1c9174 admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:20.016801 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7304a-1738-4bfb-a801-b994cd1c9174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:20.017077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7304a-1738-4bfb-a801-b994cd1c9174 admin admin] PATH_INFO: `/v3/projects/9ed9449000c04598b062707196fbe9ea/users/4733b49205544f4fa0cd68abf05705c9/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:20.051267 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7304a-1738-4bfb-a801-b994cd1c9174 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ed9449000c04598b062707196fbe9ea, user_id=4733b49205544f4fa0cd68abf05705c9, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:20.054279 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7304a-1738-4bfb-a801-b994cd1c9174 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:20.073345 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1307/2627] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:31:19 2022] PUT /identity/v3/projects/9ed9449000c04598b062707196fbe9ea/users/4733b49205544f4fa0cd68abf05705c9/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:20.078231 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01228e65-7ae5-4853-ab42-81b421b0bb2f admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:20.092575 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01228e65-7ae5-4853-ab42-81b421b0bb2f admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:20.098714 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:20.193345 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd76133-2d48-4898-8bef-aff01ecf2252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:20.194342 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd76133-2d48-4898-8bef-aff01ecf2252 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:20.194766 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd76133-2d48-4898-8bef-aff01ecf2252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:20.195205 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd76133-2d48-4898-8bef-aff01ecf2252 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:20.196384 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd76133-2d48-4898-8bef-aff01ecf2252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:20.199972 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd76133-2d48-4898-8bef-aff01ecf2252 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:20.219217 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1321/2628] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:31:20.223925 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7304a-1738-4bfb-a801-b994cd1c9174 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:20.239762 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7304a-1738-4bfb-a801-b994cd1c9174 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:20.259470 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c121f-cbd3-464f-88cc-c828266ede31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:20.260183 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c121f-cbd3-464f-88cc-c828266ede31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:20.260469 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c121f-cbd3-464f-88cc-c828266ede31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:20.260770 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c121f-cbd3-464f-88cc-c828266ede31 admin admin] PATH_INFO: `/v3/projects/9ed9449000c04598b062707196fbe9ea/users/4733b49205544f4fa0cd68abf05705c9/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:20.263435 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c121f-cbd3-464f-88cc-c828266ede31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ed9449000c04598b062707196fbe9ea, user_id=4733b49205544f4fa0cd68abf05705c9, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:20.268200 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c121f-cbd3-464f-88cc-c828266ede31 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:20.292748 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1308/2629] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:31:20 2022] PUT /identity/v3/projects/9ed9449000c04598b062707196fbe9ea/users/4733b49205544f4fa0cd68abf05705c9/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:31:20.307231 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3b2de-6f38-4d14-8ce0-8a0341aa3d1f None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:20.308339 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3b2de-6f38-4d14-8ce0-8a0341aa3d1f None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:20.308339 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc3b2de-6f38-4d14-8ce0-8a0341aa3d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:20.353840 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-dbc3b2de-6f38-4d14-8ce0-8a0341aa3d1f None None] MFA Rules not processed for user `4733b49205544f4fa0cd68abf05705c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:20.355060 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-dbc3b2de-6f38-4d14-8ce0-8a0341aa3d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:20.463397 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1322/2630] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:31:20.476397 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c121f-cbd3-464f-88cc-c828266ede31 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:20.549871 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c121f-cbd3-464f-88cc-c828266ede31 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:20.553935 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34337111-064c-47d3-bf46-80a3cd3792e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:20.554696 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34337111-064c-47d3-bf46-80a3cd3792e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:20.554923 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34337111-064c-47d3-bf46-80a3cd3792e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:20.555310 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34337111-064c-47d3-bf46-80a3cd3792e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:20.569378 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34337111-064c-47d3-bf46-80a3cd3792e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:20.570965 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34337111-064c-47d3-bf46-80a3cd3792e3 service cinder] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:20.585918 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1309/2631] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:31:20 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:31:20.878167 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3b2de-6f38-4d14-8ce0-8a0341aa3d1f None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:20.880164 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-dbc3b2de-6f38-4d14-8ce0-8a0341aa3d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:20.976733 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc3b2de-6f38-4d14-8ce0-8a0341aa3d1f None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:20.983155 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4098c-4e31-48c0-9e02-d09c30b605e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:20.984071 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4098c-4e31-48c0-9e02-d09c30b605e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:20.984532 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4098c-4e31-48c0-9e02-d09c30b605e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:20.985007 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4098c-4e31-48c0-9e02-d09c30b605e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:20.988349 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-e0c4098c-4e31-48c0-9e02-d09c30b605e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:21.068454 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:21.102213 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4098c-4e31-48c0-9e02-d09c30b605e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:21.103884 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4098c-4e31-48c0-9e02-d09c30b605e7 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:21.118411 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1323/2632] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:31:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:31:21.152130 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34337111-064c-47d3-bf46-80a3cd3792e3 service cinder] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:21.173937 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34337111-064c-47d3-bf46-80a3cd3792e3 service cinder] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:21.184242 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab81178-6446-4dcb-899c-1864e24da4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:21.185067 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab81178-6446-4dcb-899c-1864e24da4ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:21.185450 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab81178-6446-4dcb-899c-1864e24da4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:21.185842 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab81178-6446-4dcb-899c-1864e24da4ce admin admin] PATH_INFO: `/v3/users/67451f759261420d903ffea113a883fc` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:21.187375 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab81178-6446-4dcb-899c-1864e24da4ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=67451f759261420d903ffea113a883fc)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:21.189789 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab81178-6446-4dcb-899c-1864e24da4ce admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:21.255481 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-3ab81178-6446-4dcb-899c-1864e24da4ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67451f759261420d903ffea113a883fc'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:21.270635 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:21.272997 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-3ab81178-6446-4dcb-899c-1864e24da4ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67451f759261420d903ffea113a883fc'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:21.286160 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-3ab81178-6446-4dcb-899c-1864e24da4ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67451f759261420d903ffea113a883fc'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:21.287557 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-3ab81178-6446-4dcb-899c-1864e24da4ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67451f759261420d903ffea113a883fc'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:21.303295 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-3ab81178-6446-4dcb-899c-1864e24da4ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67451f759261420d903ffea113a883fc'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:21.312266 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1310/2633] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:31:21 2022] DELETE /identity/v3/users/67451f759261420d903ffea113a883fc => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:21.318653 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390e612-c056-45df-a205-9548d0b441b7 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:21.319507 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390e612-c056-45df-a205-9548d0b441b7 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:21.320013 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390e612-c056-45df-a205-9548d0b441b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:21.349511 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-5390e612-c056-45df-a205-9548d0b441b7 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:21.350951 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-5390e612-c056-45df-a205-9548d0b441b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:21.472343 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1324/2634] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:31:21.487612 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab81178-6446-4dcb-899c-1864e24da4ce admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:21.490334 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-3ab81178-6446-4dcb-899c-1864e24da4ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:21.610277 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab81178-6446-4dcb-899c-1864e24da4ce admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:21.618146 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ccaa91-8b6f-4831-bebc-3b0f0fb91d0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:21.618914 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ccaa91-8b6f-4831-bebc-3b0f0fb91d0d service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:21.619528 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ccaa91-8b6f-4831-bebc-3b0f0fb91d0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:21.620135 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ccaa91-8b6f-4831-bebc-3b0f0fb91d0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:21.641556 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ccaa91-8b6f-4831-bebc-3b0f0fb91d0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:21.644501 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ccaa91-8b6f-4831-bebc-3b0f0fb91d0d service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:21.665281 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1311/2635] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:31:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:31:21.779079 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390e612-c056-45df-a205-9548d0b441b7 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:21.781957 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-5390e612-c056-45df-a205-9548d0b441b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:21.895039 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390e612-c056-45df-a205-9548d0b441b7 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:21.901761 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13847d1-997a-4a08-99b4-2427b1308325 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:21.902497 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13847d1-997a-4a08-99b4-2427b1308325 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:21.902784 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13847d1-997a-4a08-99b4-2427b1308325 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:21.903058 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13847d1-997a-4a08-99b4-2427b1308325 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:21.908146 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-e13847d1-997a-4a08-99b4-2427b1308325 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:22.039031 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13847d1-997a-4a08-99b4-2427b1308325 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:22.040573 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13847d1-997a-4a08-99b4-2427b1308325 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:22.051768 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1325/2636] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:31:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:31:22.149744 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ccaa91-8b6f-4831-bebc-3b0f0fb91d0d service neutron] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:22.154339 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-32ccaa91-8b6f-4831-bebc-3b0f0fb91d0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:22.176766 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ccaa91-8b6f-4831-bebc-3b0f0fb91d0d service neutron] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:22.183217 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de344b-1a9e-420c-a24a-f8c72a1f3ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:22.185293 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de344b-1a9e-420c-a24a-f8c72a1f3ac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:22.185767 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de344b-1a9e-420c-a24a-f8c72a1f3ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:22.186215 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de344b-1a9e-420c-a24a-f8c72a1f3ac2 admin admin] PATH_INFO: `/v3/projects/68e4f8dd99a542e4bcb4714538813f04` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:22.187817 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de344b-1a9e-420c-a24a-f8c72a1f3ac2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68e4f8dd99a542e4bcb4714538813f04)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:22.189937 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de344b-1a9e-420c-a24a-f8c72a1f3ac2 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:22.275792 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-40de344b-1a9e-420c-a24a-f8c72a1f3ac2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68e4f8dd99a542e4bcb4714538813f04', 'request_id': 'req-40de344b-1a9e-420c-a24a-f8c72a1f3ac2'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:22.292240 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-40de344b-1a9e-420c-a24a-f8c72a1f3ac2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68e4f8dd99a542e4bcb4714538813f04', 'request_id': 'req-40de344b-1a9e-420c-a24a-f8c72a1f3ac2'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:22.304104 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-40de344b-1a9e-420c-a24a-f8c72a1f3ac2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68e4f8dd99a542e4bcb4714538813f04', 'request_id': 'req-40de344b-1a9e-420c-a24a-f8c72a1f3ac2'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:22.321430 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-40de344b-1a9e-420c-a24a-f8c72a1f3ac2 admin admin] The token cache is being invalidate because project 68e4f8dd99a542e4bcb4714538813f04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:31:22.321877 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-40de344b-1a9e-420c-a24a-f8c72a1f3ac2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:22.322858 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-40de344b-1a9e-420c-a24a-f8c72a1f3ac2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:22.325648 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1312/2637] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:31:22 2022] DELETE /identity/v3/projects/68e4f8dd99a542e4bcb4714538813f04 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:22.332454 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13847d1-997a-4a08-99b4-2427b1308325 service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:22.351932 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13847d1-997a-4a08-99b4-2427b1308325 service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:22.414329 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:22.485765 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05010577-c39b-4ff3-b34e-030767b4fe87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:22.486477 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05010577-c39b-4ff3-b34e-030767b4fe87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:22.486809 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05010577-c39b-4ff3-b34e-030767b4fe87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:22.487064 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05010577-c39b-4ff3-b34e-030767b4fe87 admin admin] PATH_INFO: `/v3/users/4733b49205544f4fa0cd68abf05705c9` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:22.488385 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05010577-c39b-4ff3-b34e-030767b4fe87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4733b49205544f4fa0cd68abf05705c9)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:22.492164 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05010577-c39b-4ff3-b34e-030767b4fe87 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:22.618456 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-05010577-c39b-4ff3-b34e-030767b4fe87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4733b49205544f4fa0cd68abf05705c9'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:22.632834 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-05010577-c39b-4ff3-b34e-030767b4fe87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4733b49205544f4fa0cd68abf05705c9'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:22.651076 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-05010577-c39b-4ff3-b34e-030767b4fe87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4733b49205544f4fa0cd68abf05705c9'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:22.653633 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-05010577-c39b-4ff3-b34e-030767b4fe87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4733b49205544f4fa0cd68abf05705c9'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:22.668755 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-05010577-c39b-4ff3-b34e-030767b4fe87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4733b49205544f4fa0cd68abf05705c9'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:22.677286 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1326/2638] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:31:22 2022] DELETE /identity/v3/users/4733b49205544f4fa0cd68abf05705c9 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:23.113774 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de344b-1a9e-420c-a24a-f8c72a1f3ac2 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:23.116205 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-40de344b-1a9e-420c-a24a-f8c72a1f3ac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:23.159565 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05010577-c39b-4ff3-b34e-030767b4fe87 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:23.163870 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-05010577-c39b-4ff3-b34e-030767b4fe87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:23.235012 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de344b-1a9e-420c-a24a-f8c72a1f3ac2 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:23.263133 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:23.307248 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05010577-c39b-4ff3-b34e-030767b4fe87 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:23.316937 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405a02e-3da0-4a74-8a9a-3c17d22af9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:23.317629 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405a02e-3da0-4a74-8a9a-3c17d22af9b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:23.318084 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405a02e-3da0-4a74-8a9a-3c17d22af9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:23.318548 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405a02e-3da0-4a74-8a9a-3c17d22af9b0 admin admin] PATH_INFO: `/v3/projects/9ed9449000c04598b062707196fbe9ea` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:23.320551 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3405a02e-3da0-4a74-8a9a-3c17d22af9b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ed9449000c04598b062707196fbe9ea)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:23.324837 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3405a02e-3da0-4a74-8a9a-3c17d22af9b0 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:23.359319 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a4d8a2-e3e5-4baa-b9da-1db9772063ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:23.361912 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4d8a2-e3e5-4baa-b9da-1db9772063ff service cinder] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:23.362498 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4d8a2-e3e5-4baa-b9da-1db9772063ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:23.363059 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a4d8a2-e3e5-4baa-b9da-1db9772063ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:23.367072 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-04a4d8a2-e3e5-4baa-b9da-1db9772063ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:23.432475 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-3405a02e-3da0-4a74-8a9a-3c17d22af9b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ed9449000c04598b062707196fbe9ea', 'request_id': 'req-3405a02e-3da0-4a74-8a9a-3c17d22af9b0'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:23.442649 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:23.452514 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-3405a02e-3da0-4a74-8a9a-3c17d22af9b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ed9449000c04598b062707196fbe9ea', 'request_id': 'req-3405a02e-3da0-4a74-8a9a-3c17d22af9b0'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:23.465819 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-3405a02e-3da0-4a74-8a9a-3c17d22af9b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ed9449000c04598b062707196fbe9ea', 'request_id': 'req-3405a02e-3da0-4a74-8a9a-3c17d22af9b0'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:23.483135 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-3405a02e-3da0-4a74-8a9a-3c17d22af9b0 admin admin] The token cache is being invalidate because project 9ed9449000c04598b062707196fbe9ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:31:23.483530 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-3405a02e-3da0-4a74-8a9a-3c17d22af9b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:23.486027 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-3405a02e-3da0-4a74-8a9a-3c17d22af9b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:23.488371 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1327/2639] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:31:23 2022] DELETE /identity/v3/projects/9ed9449000c04598b062707196fbe9ea => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:23.494896 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36be2e3-41de-4728-825e-fff9ec0543c6 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:23.495312 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36be2e3-41de-4728-825e-fff9ec0543c6 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:23.495628 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36be2e3-41de-4728-825e-fff9ec0543c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:23.498028 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a4d8a2-e3e5-4baa-b9da-1db9772063ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:23.503273 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a4d8a2-e3e5-4baa-b9da-1db9772063ff service cinder] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:23.521641 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-a36be2e3-41de-4728-825e-fff9ec0543c6 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:23.523505 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a36be2e3-41de-4728-825e-fff9ec0543c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:23.550399 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1313/2640] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:31:23 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:31:23.660543 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1328/2641] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:31:23.674410 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc7ce2-2101-4a23-8e5b-910180f1a9a7 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:23.674906 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc7ce2-2101-4a23-8e5b-910180f1a9a7 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:23.676447 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc7ce2-2101-4a23-8e5b-910180f1a9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:23.747914 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-01dc7ce2-2101-4a23-8e5b-910180f1a9a7 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:23.756802 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-01dc7ce2-2101-4a23-8e5b-910180f1a9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:23.788204 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1314/2642] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:31:23.797003 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36be2e3-41de-4728-825e-fff9ec0543c6 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:23.822147 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36be2e3-41de-4728-825e-fff9ec0543c6 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:23.832811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1aab58-673f-4182-82db-d3cb4d14e2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:23.834062 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1aab58-673f-4182-82db-d3cb4d14e2ad admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:23.835143 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1aab58-673f-4182-82db-d3cb4d14e2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:23.835863 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1aab58-673f-4182-82db-d3cb4d14e2ad admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:23.837550 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1aab58-673f-4182-82db-d3cb4d14e2ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:31:23.838330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1aab58-673f-4182-82db-d3cb4d14e2ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:23.842515 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1aab58-673f-4182-82db-d3cb4d14e2ad admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:23.870414 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1329/2643] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:31:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:31:23.876258 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc7ce2-2101-4a23-8e5b-910180f1a9a7 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:23.891115 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc7ce2-2101-4a23-8e5b-910180f1a9a7 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:23.897285 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f915f-fcf5-4134-8f00-014472c89a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:23.897926 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f915f-fcf5-4134-8f00-014472c89a9b admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:23.898199 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f915f-fcf5-4134-8f00-014472c89a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:23.898512 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f915f-fcf5-4134-8f00-014472c89a9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:23.899886 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f915f-fcf5-4134-8f00-014472c89a9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:23.903774 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f915f-fcf5-4134-8f00-014472c89a9b admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:23.965090 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1315/2644] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:31:23 2022] POST /identity/v3/projects => generated 399 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:31:23.967446 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1aab58-673f-4182-82db-d3cb4d14e2ad admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:23.987005 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1aab58-673f-4182-82db-d3cb4d14e2ad admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:24.118684 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3011c-39d3-4f84-a4bc-a54e8d740429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:24.119499 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3011c-39d3-4f84-a4bc-a54e8d740429 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:24.119914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3011c-39d3-4f84-a4bc-a54e8d740429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:24.120352 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3011c-39d3-4f84-a4bc-a54e8d740429 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:24.121210 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3011c-39d3-4f84-a4bc-a54e8d740429 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:24.124313 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3011c-39d3-4f84-a4bc-a54e8d740429 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:24.161544 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1330/2645] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:31:23 2022] POST /identity/v3/users => generated 300 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:31:24.168482 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f915f-fcf5-4134-8f00-014472c89a9b admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:24.189054 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f915f-fcf5-4134-8f00-014472c89a9b admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:24.197201 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d06564-75f6-4f3a-940f-a93d782b2e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:24.198261 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d06564-75f6-4f3a-940f-a93d782b2e96 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:24.198810 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d06564-75f6-4f3a-940f-a93d782b2e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:24.199982 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d06564-75f6-4f3a-940f-a93d782b2e96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:24.201161 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d06564-75f6-4f3a-940f-a93d782b2e96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:24.204266 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d06564-75f6-4f3a-940f-a93d782b2e96 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:24.227760 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1316/2646] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:31:24.233022 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3011c-39d3-4f84-a4bc-a54e8d740429 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:24.248746 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3011c-39d3-4f84-a4bc-a54e8d740429 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:24.257657 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f46b43-24ce-4977-9641-4b4991ca4d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:24.258764 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f46b43-24ce-4977-9641-4b4991ca4d01 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:24.259242 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f46b43-24ce-4977-9641-4b4991ca4d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:24.259731 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f46b43-24ce-4977-9641-4b4991ca4d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:24.260926 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f46b43-24ce-4977-9641-4b4991ca4d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:24.264747 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f46b43-24ce-4977-9641-4b4991ca4d01 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:24.287278 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1331/2647] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:31:24.292824 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d06564-75f6-4f3a-940f-a93d782b2e96 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:24.312050 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d06564-75f6-4f3a-940f-a93d782b2e96 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:24.317991 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d97f3-f524-43b2-ae65-c31771b8a2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:24.318831 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d97f3-f524-43b2-ae65-c31771b8a2d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:24.319223 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d97f3-f524-43b2-ae65-c31771b8a2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:24.319909 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d97f3-f524-43b2-ae65-c31771b8a2d1 admin admin] PATH_INFO: `/v3/projects/4d1dc07c8ff447a7aa067847cbf045a7/users/20a41505cd2847ecaa90df48cff3cd07/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:24.344344 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d97f3-f524-43b2-ae65-c31771b8a2d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d1dc07c8ff447a7aa067847cbf045a7, user_id=20a41505cd2847ecaa90df48cff3cd07, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:24.349864 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d97f3-f524-43b2-ae65-c31771b8a2d1 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:24.374990 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1317/2648] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:31:24 2022] PUT /identity/v3/projects/4d1dc07c8ff447a7aa067847cbf045a7/users/20a41505cd2847ecaa90df48cff3cd07/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:24.393856 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74befbbe-4fd5-48a1-b3ba-f947d11dca98 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:24.394288 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74befbbe-4fd5-48a1-b3ba-f947d11dca98 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:24.394724 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74befbbe-4fd5-48a1-b3ba-f947d11dca98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:24.431411 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-74befbbe-4fd5-48a1-b3ba-f947d11dca98 None None] MFA Rules not processed for user `20a41505cd2847ecaa90df48cff3cd07`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:24.433514 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-74befbbe-4fd5-48a1-b3ba-f947d11dca98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:24.510486 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:24.562460 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1332/2649] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:24 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:31:24.571132 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d97f3-f524-43b2-ae65-c31771b8a2d1 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:24.725321 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d97f3-f524-43b2-ae65-c31771b8a2d1 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:24.739622 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c9819-b9a7-4c42-9d91-d97ef7790dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:24.740427 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c9819-b9a7-4c42-9d91-d97ef7790dc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:24.740602 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c9819-b9a7-4c42-9d91-d97ef7790dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:24.740839 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c9819-b9a7-4c42-9d91-d97ef7790dc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:24.741438 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c9819-b9a7-4c42-9d91-d97ef7790dc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:24.743755 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c9819-b9a7-4c42-9d91-d97ef7790dc6 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:24.767991 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:24.801634 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1318/2650] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:31:24 2022] POST /identity/v3/projects => generated 401 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:31:24.805960 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74befbbe-4fd5-48a1-b3ba-f947d11dca98 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:24.830616 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74befbbe-4fd5-48a1-b3ba-f947d11dca98 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:24.943018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70fa186-3406-4e63-a37a-4e78709619e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:24.943630 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70fa186-3406-4e63-a37a-4e78709619e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:24.943910 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70fa186-3406-4e63-a37a-4e78709619e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:24.944256 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70fa186-3406-4e63-a37a-4e78709619e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:24.944845 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70fa186-3406-4e63-a37a-4e78709619e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:24.946874 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70fa186-3406-4e63-a37a-4e78709619e8 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:24.993914 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1333/2651] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:31:24 2022] POST /identity/v3/users => generated 307 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:31:24.995329 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c9819-b9a7-4c42-9d91-d97ef7790dc6 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:25.006949 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c9819-b9a7-4c42-9d91-d97ef7790dc6 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:25.014020 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b8019-7cce-4d2c-bbe6-d15a68f09408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:25.014955 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b8019-7cce-4d2c-bbe6-d15a68f09408 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:25.015148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b8019-7cce-4d2c-bbe6-d15a68f09408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:25.015703 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b8019-7cce-4d2c-bbe6-d15a68f09408 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:25.016120 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b8019-7cce-4d2c-bbe6-d15a68f09408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:25.017805 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b8019-7cce-4d2c-bbe6-d15a68f09408 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:25.033285 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1319/2652] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:31:25.038164 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70fa186-3406-4e63-a37a-4e78709619e8 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:25.056887 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70fa186-3406-4e63-a37a-4e78709619e8 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:25.078642 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1dbde4-b11b-427a-a9f0-5f5f276a9e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:25.079660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1dbde4-b11b-427a-a9f0-5f5f276a9e3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:25.080111 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1dbde4-b11b-427a-a9f0-5f5f276a9e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:25.081208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1dbde4-b11b-427a-a9f0-5f5f276a9e3c admin admin] PATH_INFO: `/v3/projects/48551a756469463c8fb8aeb9662d33d4/users/5f66cb79444f47c99f90e9c9cee8651a/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:25.118656 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1dbde4-b11b-427a-a9f0-5f5f276a9e3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=48551a756469463c8fb8aeb9662d33d4, user_id=5f66cb79444f47c99f90e9c9cee8651a, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:25.123418 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1dbde4-b11b-427a-a9f0-5f5f276a9e3c admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:25.159517 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1334/2653] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:31:25 2022] PUT /identity/v3/projects/48551a756469463c8fb8aeb9662d33d4/users/5f66cb79444f47c99f90e9c9cee8651a/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:31:25.163734 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b8019-7cce-4d2c-bbe6-d15a68f09408 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:25.186192 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b8019-7cce-4d2c-bbe6-d15a68f09408 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:25.348365 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fad15c-30af-464f-9fbf-9c096aa0038c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:25.349080 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fad15c-30af-464f-9fbf-9c096aa0038c admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:25.349271 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fad15c-30af-464f-9fbf-9c096aa0038c admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:25.349729 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fad15c-30af-464f-9fbf-9c096aa0038c admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:25.352618 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fad15c-30af-464f-9fbf-9c096aa0038c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:25.354837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fad15c-30af-464f-9fbf-9c096aa0038c admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:25.368945 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1320/2654] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:31:25.373836 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1dbde4-b11b-427a-a9f0-5f5f276a9e3c admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:25.399957 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1dbde4-b11b-427a-a9f0-5f5f276a9e3c admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:25.408160 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da536c4-7d20-4520-bab9-95bb7dfb510f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:25.409394 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da536c4-7d20-4520-bab9-95bb7dfb510f admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:25.409744 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da536c4-7d20-4520-bab9-95bb7dfb510f admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:25.410230 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da536c4-7d20-4520-bab9-95bb7dfb510f admin admin] PATH_INFO: `/v3/projects/48551a756469463c8fb8aeb9662d33d4/users/5f66cb79444f47c99f90e9c9cee8651a/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:25.413663 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da536c4-7d20-4520-bab9-95bb7dfb510f admin admin] RBAC: Authorizing `identity:create_grant(project_id=48551a756469463c8fb8aeb9662d33d4, user_id=5f66cb79444f47c99f90e9c9cee8651a, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:25.416901 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da536c4-7d20-4520-bab9-95bb7dfb510f admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:25.455362 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1335/2655] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:31:25 2022] PUT /identity/v3/projects/48551a756469463c8fb8aeb9662d33d4/users/5f66cb79444f47c99f90e9c9cee8651a/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:25.464689 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2211b8-58f4-4325-b29c-64f801ef2924 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:25.465676 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2211b8-58f4-4325-b29c-64f801ef2924 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:25.466165 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2211b8-58f4-4325-b29c-64f801ef2924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:25.509933 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-2d2211b8-58f4-4325-b29c-64f801ef2924 None None] MFA Rules not processed for user `5f66cb79444f47c99f90e9c9cee8651a`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:25.512449 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-2d2211b8-58f4-4325-b29c-64f801ef2924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:25.743189 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1321/2656] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:25 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:31:25.764748 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da536c4-7d20-4520-bab9-95bb7dfb510f admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:25.770927 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7da536c4-7d20-4520-bab9-95bb7dfb510f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:25.884177 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da536c4-7d20-4520-bab9-95bb7dfb510f admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:25.897991 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638489df-a423-4b47-8ac4-ea96cee4afc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:25.900297 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638489df-a423-4b47-8ac4-ea96cee4afc4 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:25.900900 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638489df-a423-4b47-8ac4-ea96cee4afc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:25.901413 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638489df-a423-4b47-8ac4-ea96cee4afc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:25.922002 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638489df-a423-4b47-8ac4-ea96cee4afc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:25.924959 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638489df-a423-4b47-8ac4-ea96cee4afc4 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:25.947031 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1336/2657] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:31:25 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:31:26.102611 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2211b8-58f4-4325-b29c-64f801ef2924 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:26.115851 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2211b8-58f4-4325-b29c-64f801ef2924 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:26.120151 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133290b-d2f2-4fef-b2d6-fb0c5a503494 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:26.121814 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133290b-d2f2-4fef-b2d6-fb0c5a503494 service cinder] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:26.121814 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133290b-d2f2-4fef-b2d6-fb0c5a503494 service cinder] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:26.122168 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133290b-d2f2-4fef-b2d6-fb0c5a503494 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:26.206774 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133290b-d2f2-4fef-b2d6-fb0c5a503494 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:26.208390 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133290b-d2f2-4fef-b2d6-fb0c5a503494 service cinder] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:26.220822 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1322/2658] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:31:26 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:31:26.716737 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638489df-a423-4b47-8ac4-ea96cee4afc4 service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:26.719591 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-638489df-a423-4b47-8ac4-ea96cee4afc4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:26.814206 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:26.891503 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638489df-a423-4b47-8ac4-ea96cee4afc4 service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:26.903624 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b0726-7041-46c2-ab99-d8f03d80a709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:26.904645 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b0726-7041-46c2-ab99-d8f03d80a709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:26.905239 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b0726-7041-46c2-ab99-d8f03d80a709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:26.905531 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b0726-7041-46c2-ab99-d8f03d80a709 admin admin] PATH_INFO: `/v3/users/e82cb48b04eb42b99160934b1c8b1f7f` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:26.907302 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244b0726-7041-46c2-ab99-d8f03d80a709 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e82cb48b04eb42b99160934b1c8b1f7f)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:26.912945 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244b0726-7041-46c2-ab99-d8f03d80a709 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:27.012701 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-244b0726-7041-46c2-ab99-d8f03d80a709 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e82cb48b04eb42b99160934b1c8b1f7f'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:27.023013 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-244b0726-7041-46c2-ab99-d8f03d80a709 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e82cb48b04eb42b99160934b1c8b1f7f'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:27.045014 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-244b0726-7041-46c2-ab99-d8f03d80a709 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e82cb48b04eb42b99160934b1c8b1f7f'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:27.046119 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-244b0726-7041-46c2-ab99-d8f03d80a709 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e82cb48b04eb42b99160934b1c8b1f7f'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:27.062293 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-244b0726-7041-46c2-ab99-d8f03d80a709 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e82cb48b04eb42b99160934b1c8b1f7f'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:27.074990 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1337/2659] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:31:26 2022] DELETE /identity/v3/users/e82cb48b04eb42b99160934b1c8b1f7f => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:27.308663 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133290b-d2f2-4fef-b2d6-fb0c5a503494 service cinder] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:27.315724 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:27.325048 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133290b-d2f2-4fef-b2d6-fb0c5a503494 service cinder] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:27.419413 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c8b7a-ea77-4777-92ab-1e8a53ab8ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:27.420381 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c8b7a-ea77-4777-92ab-1e8a53ab8ea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:27.420848 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c8b7a-ea77-4777-92ab-1e8a53ab8ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:27.421241 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c8b7a-ea77-4777-92ab-1e8a53ab8ea5 admin admin] PATH_INFO: `/v3/projects/2bb52cc7397e4539a89fe5a831c85894` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:27.423133 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c8b7a-ea77-4777-92ab-1e8a53ab8ea5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bb52cc7397e4539a89fe5a831c85894)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:27.426995 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c8b7a-ea77-4777-92ab-1e8a53ab8ea5 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:27.492514 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-9a3c8b7a-ea77-4777-92ab-1e8a53ab8ea5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bb52cc7397e4539a89fe5a831c85894', 'request_id': 'req-9a3c8b7a-ea77-4777-92ab-1e8a53ab8ea5'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:27.503138 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-9a3c8b7a-ea77-4777-92ab-1e8a53ab8ea5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bb52cc7397e4539a89fe5a831c85894', 'request_id': 'req-9a3c8b7a-ea77-4777-92ab-1e8a53ab8ea5'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:27.516882 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-9a3c8b7a-ea77-4777-92ab-1e8a53ab8ea5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bb52cc7397e4539a89fe5a831c85894', 'request_id': 'req-9a3c8b7a-ea77-4777-92ab-1e8a53ab8ea5'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:27.541530 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-9a3c8b7a-ea77-4777-92ab-1e8a53ab8ea5 admin admin] The token cache is being invalidate because project 2bb52cc7397e4539a89fe5a831c85894 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:31:27.542037 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-9a3c8b7a-ea77-4777-92ab-1e8a53ab8ea5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:27.543143 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-9a3c8b7a-ea77-4777-92ab-1e8a53ab8ea5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:27.544968 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1323/2660] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:31:27 2022] DELETE /identity/v3/projects/2bb52cc7397e4539a89fe5a831c85894 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:27.551666 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91069292-4480-4713-9abd-12d46a0ea9a3 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:27.552016 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91069292-4480-4713-9abd-12d46a0ea9a3 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:27.552339 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91069292-4480-4713-9abd-12d46a0ea9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:27.587451 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-91069292-4480-4713-9abd-12d46a0ea9a3 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:27.589636 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-91069292-4480-4713-9abd-12d46a0ea9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:27.705080 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1338/2661] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:31:27.712900 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbfba28-abef-4912-a8bc-0a80c765b696 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:27.713702 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbfba28-abef-4912-a8bc-0a80c765b696 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:27.714476 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbfba28-abef-4912-a8bc-0a80c765b696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:27.752539 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-bfbfba28-abef-4912-a8bc-0a80c765b696 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:27.755233 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-bfbfba28-abef-4912-a8bc-0a80c765b696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:27.769930 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1324/2662] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:31:27.776242 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91069292-4480-4713-9abd-12d46a0ea9a3 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:27.795181 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91069292-4480-4713-9abd-12d46a0ea9a3 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:27.803686 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70781396-dca5-4585-a269-8c4ee0e10d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:27.804810 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70781396-dca5-4585-a269-8c4ee0e10d0b admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:27.805576 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70781396-dca5-4585-a269-8c4ee0e10d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:27.806066 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70781396-dca5-4585-a269-8c4ee0e10d0b admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:27.807599 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70781396-dca5-4585-a269-8c4ee0e10d0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:31:27.808168 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70781396-dca5-4585-a269-8c4ee0e10d0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:27.811523 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70781396-dca5-4585-a269-8c4ee0e10d0b admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:27.832951 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1339/2663] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:31:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:31:27.838994 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbfba28-abef-4912-a8bc-0a80c765b696 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:27.851005 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbfba28-abef-4912-a8bc-0a80c765b696 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:27.858606 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193d808-56ef-4d07-b3f5-cbc1f10d493e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:27.859235 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193d808-56ef-4d07-b3f5-cbc1f10d493e admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:27.859518 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193d808-56ef-4d07-b3f5-cbc1f10d493e admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:27.859887 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193d808-56ef-4d07-b3f5-cbc1f10d493e admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:27.860548 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b193d808-56ef-4d07-b3f5-cbc1f10d493e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:27.862529 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b193d808-56ef-4d07-b3f5-cbc1f10d493e admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:27.895309 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1325/2664] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:31:27 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:31:27.901971 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70781396-dca5-4585-a269-8c4ee0e10d0b admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:27.921018 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70781396-dca5-4585-a269-8c4ee0e10d0b admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:27.999283 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:28.038549 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a3cc9e-fd90-4fd3-aae1-459030433726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:28.039765 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3cc9e-fd90-4fd3-aae1-459030433726 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:28.040212 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3cc9e-fd90-4fd3-aae1-459030433726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:28.040681 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3cc9e-fd90-4fd3-aae1-459030433726 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:28.041821 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a3cc9e-fd90-4fd3-aae1-459030433726 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:28.046020 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a3cc9e-fd90-4fd3-aae1-459030433726 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:28.077413 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1340/2665] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:31:27 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:31:28.082733 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193d808-56ef-4d07-b3f5-cbc1f10d493e admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:28.100672 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193d808-56ef-4d07-b3f5-cbc1f10d493e admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:28.107319 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddfd406-e9da-4614-8321-e70fbb26faa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:28.108490 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfd406-e9da-4614-8321-e70fbb26faa6 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:28.108891 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfd406-e9da-4614-8321-e70fbb26faa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:28.109261 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfd406-e9da-4614-8321-e70fbb26faa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:28.110143 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddfd406-e9da-4614-8321-e70fbb26faa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:28.112364 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddfd406-e9da-4614-8321-e70fbb26faa6 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:28.128147 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1326/2666] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:31:28.133299 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a3cc9e-fd90-4fd3-aae1-459030433726 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:28.148421 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a3cc9e-fd90-4fd3-aae1-459030433726 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:28.163452 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56552459-b78c-4460-a603-db571e30f445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:28.168374 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56552459-b78c-4460-a603-db571e30f445 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:28.168849 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56552459-b78c-4460-a603-db571e30f445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:28.169323 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56552459-b78c-4460-a603-db571e30f445 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:28.170539 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56552459-b78c-4460-a603-db571e30f445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:28.173585 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56552459-b78c-4460-a603-db571e30f445 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:28.194641 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1341/2667] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:31:28.200451 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddfd406-e9da-4614-8321-e70fbb26faa6 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:28.217393 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddfd406-e9da-4614-8321-e70fbb26faa6 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:28.236315 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b9ec6a-0b0e-4608-90f7-5a6192bdae30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:28.239629 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9ec6a-0b0e-4608-90f7-5a6192bdae30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:28.240369 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9ec6a-0b0e-4608-90f7-5a6192bdae30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:28.240604 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9ec6a-0b0e-4608-90f7-5a6192bdae30 admin admin] PATH_INFO: `/v3/projects/3ac9251da55540a686f6774b1993352e/users/17861b8f0abe4378945ee578a7f5a3d6/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:28.272248 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b9ec6a-0b0e-4608-90f7-5a6192bdae30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ac9251da55540a686f6774b1993352e, user_id=17861b8f0abe4378945ee578a7f5a3d6, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:28.277447 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b9ec6a-0b0e-4608-90f7-5a6192bdae30 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:28.284815 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56552459-b78c-4460-a603-db571e30f445 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:28.288751 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-56552459-b78c-4460-a603-db571e30f445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:28.302952 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1327/2668] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:31:28 2022] PUT /identity/v3/projects/3ac9251da55540a686f6774b1993352e/users/17861b8f0abe4378945ee578a7f5a3d6/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:31:28.315567 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56552459-b78c-4460-a603-db571e30f445 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:28.321149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc0328-48c2-44f7-8448-19ea82aad5ce None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:28.321985 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc0328-48c2-44f7-8448-19ea82aad5ce None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:28.322179 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc0328-48c2-44f7-8448-19ea82aad5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:28.376664 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-fbbc0328-48c2-44f7-8448-19ea82aad5ce None None] MFA Rules not processed for user `17861b8f0abe4378945ee578a7f5a3d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:28.378841 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-fbbc0328-48c2-44f7-8448-19ea82aad5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:28.421971 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:28.446723 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b3aa6-f3fc-4ac6-9b43-2859a502fa45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:28.447514 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b3aa6-f3fc-4ac6-9b43-2859a502fa45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:28.447951 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b3aa6-f3fc-4ac6-9b43-2859a502fa45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:28.452347 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b3aa6-f3fc-4ac6-9b43-2859a502fa45 admin admin] PATH_INFO: `/v3/users/1f98f45747b14768aaca7464fbf94a2f` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:28.455069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b3aa6-f3fc-4ac6-9b43-2859a502fa45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f98f45747b14768aaca7464fbf94a2f)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:28.458631 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b3aa6-f3fc-4ac6-9b43-2859a502fa45 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:28.526758 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1328/2669] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:31:28.540329 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-3e9b3aa6-f3fc-4ac6-9b43-2859a502fa45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f98f45747b14768aaca7464fbf94a2f'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:28.543871 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc0328-48c2-44f7-8448-19ea82aad5ce None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:28.546216 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-fbbc0328-48c2-44f7-8448-19ea82aad5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:28.551172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-3e9b3aa6-f3fc-4ac6-9b43-2859a502fa45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f98f45747b14768aaca7464fbf94a2f'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:28.582846 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-3e9b3aa6-f3fc-4ac6-9b43-2859a502fa45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f98f45747b14768aaca7464fbf94a2f'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:28.583977 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-3e9b3aa6-f3fc-4ac6-9b43-2859a502fa45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f98f45747b14768aaca7464fbf94a2f'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:28.594774 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-3e9b3aa6-f3fc-4ac6-9b43-2859a502fa45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f98f45747b14768aaca7464fbf94a2f'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:28.604838 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1342/2670] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:31:28 2022] DELETE /identity/v3/users/1f98f45747b14768aaca7464fbf94a2f => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:28.610970 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82528175-8538-4bbc-b363-bf1b898af1bd None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:28.611334 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82528175-8538-4bbc-b363-bf1b898af1bd None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:28.611724 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82528175-8538-4bbc-b363-bf1b898af1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:28.642245 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-82528175-8538-4bbc-b363-bf1b898af1bd None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:28.644402 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-82528175-8538-4bbc-b363-bf1b898af1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:28.676220 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc0328-48c2-44f7-8448-19ea82aad5ce None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:28.702595 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:28.749549 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1343/2671] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:31:28.762243 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82528175-8538-4bbc-b363-bf1b898af1bd None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:28.764061 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-82528175-8538-4bbc-b363-bf1b898af1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:28.775197 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0992160-3690-46b2-a42c-1c49860029ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:28.775980 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0992160-3690-46b2-a42c-1c49860029ec service nova] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:28.776348 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0992160-3690-46b2-a42c-1c49860029ec service nova] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:28.776737 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0992160-3690-46b2-a42c-1c49860029ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:28.779592 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-d0992160-3690-46b2-a42c-1c49860029ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:28.848135 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82528175-8538-4bbc-b363-bf1b898af1bd None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:28.854762 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c87849-a33c-4d7d-a0c1-9ee036410fdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:28.856085 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:28.857081 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c87849-a33c-4d7d-a0c1-9ee036410fdf service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:28.857673 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c87849-a33c-4d7d-a0c1-9ee036410fdf service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:28.858139 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c87849-a33c-4d7d-a0c1-9ee036410fdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:28.862220 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0992160-3690-46b2-a42c-1c49860029ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:28.864343 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0992160-3690-46b2-a42c-1c49860029ec service nova] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:28.876090 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c87849-a33c-4d7d-a0c1-9ee036410fdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:28.876395 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1329/2672] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:31:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:31:28.879722 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c87849-a33c-4d7d-a0c1-9ee036410fdf service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:28.901035 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1344/2673] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:31:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:31:29.312574 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0992160-3690-46b2-a42c-1c49860029ec service nova] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:29.314705 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-d0992160-3690-46b2-a42c-1c49860029ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:29.351348 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0992160-3690-46b2-a42c-1c49860029ec service nova] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:29.363056 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057e6f2-efa2-4fb4-b2d4-ea4642da5c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:29.364425 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057e6f2-efa2-4fb4-b2d4-ea4642da5c37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:29.365442 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057e6f2-efa2-4fb4-b2d4-ea4642da5c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:29.366144 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057e6f2-efa2-4fb4-b2d4-ea4642da5c37 admin admin] PATH_INFO: `/v3/projects/b6bae04488944a7a9f21a75031cc6d30` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:29.368798 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9057e6f2-efa2-4fb4-b2d4-ea4642da5c37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6bae04488944a7a9f21a75031cc6d30)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:29.375535 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9057e6f2-efa2-4fb4-b2d4-ea4642da5c37 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:29.465279 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-9057e6f2-efa2-4fb4-b2d4-ea4642da5c37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6bae04488944a7a9f21a75031cc6d30', 'request_id': 'req-9057e6f2-efa2-4fb4-b2d4-ea4642da5c37'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:29.475616 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-9057e6f2-efa2-4fb4-b2d4-ea4642da5c37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6bae04488944a7a9f21a75031cc6d30', 'request_id': 'req-9057e6f2-efa2-4fb4-b2d4-ea4642da5c37'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:29.492131 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-9057e6f2-efa2-4fb4-b2d4-ea4642da5c37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6bae04488944a7a9f21a75031cc6d30', 'request_id': 'req-9057e6f2-efa2-4fb4-b2d4-ea4642da5c37'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:29.509298 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-9057e6f2-efa2-4fb4-b2d4-ea4642da5c37 admin admin] The token cache is being invalidate because project b6bae04488944a7a9f21a75031cc6d30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:31:29.509731 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-9057e6f2-efa2-4fb4-b2d4-ea4642da5c37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:29.510777 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-9057e6f2-efa2-4fb4-b2d4-ea4642da5c37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:29.513471 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1330/2674] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:31:29 2022] DELETE /identity/v3/projects/b6bae04488944a7a9f21a75031cc6d30 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:29.517994 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c87849-a33c-4d7d-a0c1-9ee036410fdf service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:29.532421 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c87849-a33c-4d7d-a0c1-9ee036410fdf service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:29.628477 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1fb68-62b2-4303-920a-ecfbc7f968af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:29.629787 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1fb68-62b2-4303-920a-ecfbc7f968af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:29.630277 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1fb68-62b2-4303-920a-ecfbc7f968af admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:29.630767 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1fb68-62b2-4303-920a-ecfbc7f968af admin admin] PATH_INFO: `/v3/users/b6d69ca331f6439584710c900becbcda` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:29.632788 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d1fb68-62b2-4303-920a-ecfbc7f968af admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6d69ca331f6439584710c900becbcda)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:29.636363 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d1fb68-62b2-4303-920a-ecfbc7f968af admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:29.712234 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-c4d1fb68-62b2-4303-920a-ecfbc7f968af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6d69ca331f6439584710c900becbcda'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:29.724768 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-c4d1fb68-62b2-4303-920a-ecfbc7f968af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6d69ca331f6439584710c900becbcda'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:29.747687 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-c4d1fb68-62b2-4303-920a-ecfbc7f968af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6d69ca331f6439584710c900becbcda'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:29.748796 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-c4d1fb68-62b2-4303-920a-ecfbc7f968af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6d69ca331f6439584710c900becbcda'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:29.761176 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-c4d1fb68-62b2-4303-920a-ecfbc7f968af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6d69ca331f6439584710c900becbcda'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:29.765472 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:29.774910 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1345/2675] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:31:29 2022] DELETE /identity/v3/users/b6d69ca331f6439584710c900becbcda => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:30.172614 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057e6f2-efa2-4fb4-b2d4-ea4642da5c37 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:30.174988 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-9057e6f2-efa2-4fb4-b2d4-ea4642da5c37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:30.194439 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057e6f2-efa2-4fb4-b2d4-ea4642da5c37 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:30.268085 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4b5dc-5981-4ce3-8170-d49bf17ea264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:30.268858 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4b5dc-5981-4ce3-8170-d49bf17ea264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:30.269293 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4b5dc-5981-4ce3-8170-d49bf17ea264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:30.269657 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4b5dc-5981-4ce3-8170-d49bf17ea264 admin admin] PATH_INFO: `/v3/projects/dc6f4dd58fc64ca79a14536a8f020a92` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:30.271422 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee4b5dc-5981-4ce3-8170-d49bf17ea264 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc6f4dd58fc64ca79a14536a8f020a92)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:30.273623 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee4b5dc-5981-4ce3-8170-d49bf17ea264 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:30.332389 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-cee4b5dc-5981-4ce3-8170-d49bf17ea264 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc6f4dd58fc64ca79a14536a8f020a92', 'request_id': 'req-cee4b5dc-5981-4ce3-8170-d49bf17ea264'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:30.342032 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-cee4b5dc-5981-4ce3-8170-d49bf17ea264 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc6f4dd58fc64ca79a14536a8f020a92', 'request_id': 'req-cee4b5dc-5981-4ce3-8170-d49bf17ea264'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:30.349148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-cee4b5dc-5981-4ce3-8170-d49bf17ea264 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc6f4dd58fc64ca79a14536a8f020a92', 'request_id': 'req-cee4b5dc-5981-4ce3-8170-d49bf17ea264'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:30.363521 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-cee4b5dc-5981-4ce3-8170-d49bf17ea264 admin admin] The token cache is being invalidate because project dc6f4dd58fc64ca79a14536a8f020a92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:31:30.364276 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-cee4b5dc-5981-4ce3-8170-d49bf17ea264 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:30.364497 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-cee4b5dc-5981-4ce3-8170-d49bf17ea264 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:30.366038 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1331/2676] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:31:30 2022] DELETE /identity/v3/projects/dc6f4dd58fc64ca79a14536a8f020a92 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:31:30.370478 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1fb68-62b2-4303-920a-ecfbc7f968af admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:30.371961 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-c4d1fb68-62b2-4303-920a-ecfbc7f968af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:30.386574 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1fb68-62b2-4303-920a-ecfbc7f968af admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:30.457009 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f69924-812d-41bc-8005-3db0e8c5114e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:30.457663 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f69924-812d-41bc-8005-3db0e8c5114e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:30.457938 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f69924-812d-41bc-8005-3db0e8c5114e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:30.458227 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f69924-812d-41bc-8005-3db0e8c5114e admin admin] PATH_INFO: `/v3/users/e024893771ed41048e9d6708f43aeebd` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:30.459506 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f69924-812d-41bc-8005-3db0e8c5114e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e024893771ed41048e9d6708f43aeebd)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:30.461762 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f69924-812d-41bc-8005-3db0e8c5114e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:30.548859 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-33f69924-812d-41bc-8005-3db0e8c5114e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e024893771ed41048e9d6708f43aeebd'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:30.559940 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-33f69924-812d-41bc-8005-3db0e8c5114e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e024893771ed41048e9d6708f43aeebd'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:30.587140 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-33f69924-812d-41bc-8005-3db0e8c5114e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e024893771ed41048e9d6708f43aeebd'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:30.587140 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-33f69924-812d-41bc-8005-3db0e8c5114e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e024893771ed41048e9d6708f43aeebd'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:30.596783 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-33f69924-812d-41bc-8005-3db0e8c5114e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e024893771ed41048e9d6708f43aeebd'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:30.604875 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1346/2677] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:31:30 2022] DELETE /identity/v3/users/e024893771ed41048e9d6708f43aeebd => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:31.023241 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4b5dc-5981-4ce3-8170-d49bf17ea264 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:31.025455 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-cee4b5dc-5981-4ce3-8170-d49bf17ea264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:31.048289 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4b5dc-5981-4ce3-8170-d49bf17ea264 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:31.055763 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:31.147660 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52eb08-9662-4a7f-87be-19f321751d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:31.148462 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52eb08-9662-4a7f-87be-19f321751d75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:31.148798 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52eb08-9662-4a7f-87be-19f321751d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:31.149395 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52eb08-9662-4a7f-87be-19f321751d75 admin admin] PATH_INFO: `/v3/projects/dc6b7486a922499bb1ec48f488985608` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:31.150961 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52eb08-9662-4a7f-87be-19f321751d75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc6b7486a922499bb1ec48f488985608)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:31.153732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52eb08-9662-4a7f-87be-19f321751d75 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:31.226513 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-5f52eb08-9662-4a7f-87be-19f321751d75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc6b7486a922499bb1ec48f488985608', 'request_id': 'req-5f52eb08-9662-4a7f-87be-19f321751d75'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:31.241541 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f69924-812d-41bc-8005-3db0e8c5114e admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:31.243479 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-33f69924-812d-41bc-8005-3db0e8c5114e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:31.244012 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-5f52eb08-9662-4a7f-87be-19f321751d75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc6b7486a922499bb1ec48f488985608', 'request_id': 'req-5f52eb08-9662-4a7f-87be-19f321751d75'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:31.256466 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-5f52eb08-9662-4a7f-87be-19f321751d75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc6b7486a922499bb1ec48f488985608', 'request_id': 'req-5f52eb08-9662-4a7f-87be-19f321751d75'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:31.263899 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f69924-812d-41bc-8005-3db0e8c5114e admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:31.273763 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-5f52eb08-9662-4a7f-87be-19f321751d75 admin admin] The token cache is being invalidate because project dc6b7486a922499bb1ec48f488985608 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:31:31.277142 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-5f52eb08-9662-4a7f-87be-19f321751d75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:31.277142 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-5f52eb08-9662-4a7f-87be-19f321751d75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:31.277512 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1332/2678] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:31:31 2022] DELETE /identity/v3/projects/dc6b7486a922499bb1ec48f488985608 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:31.284409 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c19ba9-0941-46d6-a2a0-4b8fce140a33 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:31.284692 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c19ba9-0941-46d6-a2a0-4b8fce140a33 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:31.284955 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c19ba9-0941-46d6-a2a0-4b8fce140a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:31.310674 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-a4c19ba9-0941-46d6-a2a0-4b8fce140a33 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:31.312135 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-a4c19ba9-0941-46d6-a2a0-4b8fce140a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:31.361364 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01521fab-faad-4401-863e-3c862a8578f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:31.362288 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01521fab-faad-4401-863e-3c862a8578f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:31.362793 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01521fab-faad-4401-863e-3c862a8578f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:31.363276 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01521fab-faad-4401-863e-3c862a8578f0 admin admin] PATH_INFO: `/v3/users/20a41505cd2847ecaa90df48cff3cd07` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:31.365345 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01521fab-faad-4401-863e-3c862a8578f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20a41505cd2847ecaa90df48cff3cd07)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:31.368142 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01521fab-faad-4401-863e-3c862a8578f0 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:31.398225 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:31.412852 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1333/2679] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:31:31.425835 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a77c9-4188-417a-82e6-e1d5fb42857b None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:31.426265 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a77c9-4188-417a-82e6-e1d5fb42857b None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:31.426680 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a77c9-4188-417a-82e6-e1d5fb42857b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:31.435891 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-01521fab-faad-4401-863e-3c862a8578f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20a41505cd2847ecaa90df48cff3cd07'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:31.445058 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-01521fab-faad-4401-863e-3c862a8578f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20a41505cd2847ecaa90df48cff3cd07'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:31.457695 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-b61a77c9-4188-417a-82e6-e1d5fb42857b None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:31.459725 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-b61a77c9-4188-417a-82e6-e1d5fb42857b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:31.460384 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-01521fab-faad-4401-863e-3c862a8578f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20a41505cd2847ecaa90df48cff3cd07'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:31.461245 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-01521fab-faad-4401-863e-3c862a8578f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20a41505cd2847ecaa90df48cff3cd07'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:31.469876 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-01521fab-faad-4401-863e-3c862a8578f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20a41505cd2847ecaa90df48cff3cd07'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:31.473003 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1334/2680] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:31:31.476603 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1347/2681] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:31:31 2022] DELETE /identity/v3/users/20a41505cd2847ecaa90df48cff3cd07 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:31:31.479565 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a77c9-4188-417a-82e6-e1d5fb42857b None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:31.481628 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7453132-9371-4cfa-943c-b08f55b37f1a None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:31.481919 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7453132-9371-4cfa-943c-b08f55b37f1a None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:31.482183 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7453132-9371-4cfa-943c-b08f55b37f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:31.492832 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a77c9-4188-417a-82e6-e1d5fb42857b None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:31.505303 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-f7453132-9371-4cfa-943c-b08f55b37f1a None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:31.506617 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f7453132-9371-4cfa-943c-b08f55b37f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:31.533210 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:31.588589 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7877a7d1-944b-4751-bd3f-cb2da62e817f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:31.589388 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877a7d1-944b-4751-bd3f-cb2da62e817f admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:31.589831 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877a7d1-944b-4751-bd3f-cb2da62e817f admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:31.590274 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877a7d1-944b-4751-bd3f-cb2da62e817f admin admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:31.591600 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7877a7d1-944b-4751-bd3f-cb2da62e817f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:31:31.592058 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7877a7d1-944b-4751-bd3f-cb2da62e817f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:31.592217 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1348/2682] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:31:31.594107 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7877a7d1-944b-4751-bd3f-cb2da62e817f admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:31.605876 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7453132-9371-4cfa-943c-b08f55b37f1a None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:31.607456 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f7453132-9371-4cfa-943c-b08f55b37f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:31.616598 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1335/2683] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:31:31.618970 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7877a7d1-944b-4751-bd3f-cb2da62e817f admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:31.638553 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7877a7d1-944b-4751-bd3f-cb2da62e817f admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:31.645929 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de2c07-1692-4074-ac8b-eded42abe593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:31.646583 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de2c07-1692-4074-ac8b-eded42abe593 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:31.646955 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de2c07-1692-4074-ac8b-eded42abe593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:31.647196 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de2c07-1692-4074-ac8b-eded42abe593 admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:31.647862 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89de2c07-1692-4074-ac8b-eded42abe593 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:31.650102 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89de2c07-1692-4074-ac8b-eded42abe593 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:31.700436 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7453132-9371-4cfa-943c-b08f55b37f1a None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:31.702452 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1336/2684] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:31:31 2022] POST /identity/v3/projects => generated 373 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:31:31.704861 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de2c07-1692-4074-ac8b-eded42abe593 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:31.778117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44361eb0-7418-439c-94e4-7377c212e36f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:31.779019 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44361eb0-7418-439c-94e4-7377c212e36f service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:31.779403 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44361eb0-7418-439c-94e4-7377c212e36f service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:31.779813 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44361eb0-7418-439c-94e4-7377c212e36f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:31.791084 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:31.801115 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de2c07-1692-4074-ac8b-eded42abe593 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:31.807298 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c76dbb-ff57-455f-971c-0ebc7f2f3e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:31.808186 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c76dbb-ff57-455f-971c-0ebc7f2f3e62 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:31.809411 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c76dbb-ff57-455f-971c-0ebc7f2f3e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:31.810229 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c76dbb-ff57-455f-971c-0ebc7f2f3e62 admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:31.811414 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c76dbb-ff57-455f-971c-0ebc7f2f3e62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:31.814172 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c76dbb-ff57-455f-971c-0ebc7f2f3e62 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:31.849869 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1337/2685] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:31:31 2022] POST /identity/v3/users => generated 287 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:31:31.855494 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c76dbb-ff57-455f-971c-0ebc7f2f3e62 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:31.871898 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c76dbb-ff57-455f-971c-0ebc7f2f3e62 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:31.879036 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44361eb0-7418-439c-94e4-7377c212e36f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:31.879369 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91542a-53c9-481c-b067-1f0fa1d3f334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:31.879913 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91542a-53c9-481c-b067-1f0fa1d3f334 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:31.880317 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91542a-53c9-481c-b067-1f0fa1d3f334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:31.880691 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91542a-53c9-481c-b067-1f0fa1d3f334 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:31.881012 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44361eb0-7418-439c-94e4-7377c212e36f service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:31.881625 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b91542a-53c9-481c-b067-1f0fa1d3f334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:31.883801 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b91542a-53c9-481c-b067-1f0fa1d3f334 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:31.896888 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1349/2686] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:31:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:31:31.903057 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1338/2687] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:31:31.908123 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44361eb0-7418-439c-94e4-7377c212e36f service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:31.927664 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44361eb0-7418-439c-94e4-7377c212e36f service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:31.934196 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2802287-c1ce-4437-bdef-e4d6dbf5bd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:31.934985 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2802287-c1ce-4437-bdef-e4d6dbf5bd4b admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:31.935321 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2802287-c1ce-4437-bdef-e4d6dbf5bd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:31.937542 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2802287-c1ce-4437-bdef-e4d6dbf5bd4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:31.937542 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2802287-c1ce-4437-bdef-e4d6dbf5bd4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:31.939723 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2802287-c1ce-4437-bdef-e4d6dbf5bd4b admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:31.958428 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1350/2688] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:31:31.973130 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2802287-c1ce-4437-bdef-e4d6dbf5bd4b admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:31.975085 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91542a-53c9-481c-b067-1f0fa1d3f334 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:31.975272 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-a2802287-c1ce-4437-bdef-e4d6dbf5bd4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:31.991140 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91542a-53c9-481c-b067-1f0fa1d3f334 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:31.997840 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2802287-c1ce-4437-bdef-e4d6dbf5bd4b admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:32.001221 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630f462-a89d-4eda-94ab-c24adf5d19ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:32.002412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630f462-a89d-4eda-94ab-c24adf5d19ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:32.003054 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630f462-a89d-4eda-94ab-c24adf5d19ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:32.003584 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630f462-a89d-4eda-94ab-c24adf5d19ee admin admin] PATH_INFO: `/v3/projects/fc379ee46ca6403c8057355b5675927f/users/b998c363b3704e9aa4564f39332159d8/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:32.005409 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41e3f7-5345-424d-9b5d-745ab381c514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:32.006220 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41e3f7-5345-424d-9b5d-745ab381c514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:32.006610 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41e3f7-5345-424d-9b5d-745ab381c514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:32.007091 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41e3f7-5345-424d-9b5d-745ab381c514 admin admin] PATH_INFO: `/v3/users/17861b8f0abe4378945ee578a7f5a3d6` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:32.008746 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f41e3f7-5345-424d-9b5d-745ab381c514 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17861b8f0abe4378945ee578a7f5a3d6)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:32.012093 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f41e3f7-5345-424d-9b5d-745ab381c514 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:32.037563 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630f462-a89d-4eda-94ab-c24adf5d19ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc379ee46ca6403c8057355b5675927f, user_id=b998c363b3704e9aa4564f39332159d8, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:32.046415 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630f462-a89d-4eda-94ab-c24adf5d19ee admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:32.068655 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1339/2689] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:31:31 2022] PUT /identity/v3/projects/fc379ee46ca6403c8057355b5675927f/users/b998c363b3704e9aa4564f39332159d8/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:32.075691 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11ce43-f308-403e-8c34-7addfd06796a None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:32.076200 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11ce43-f308-403e-8c34-7addfd06796a None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:32.076926 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a11ce43-f308-403e-8c34-7addfd06796a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:32.106316 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-4f41e3f7-5345-424d-9b5d-745ab381c514 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17861b8f0abe4378945ee578a7f5a3d6'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:32.120321 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-4f41e3f7-5345-424d-9b5d-745ab381c514 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17861b8f0abe4378945ee578a7f5a3d6'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:32.125681 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-1a11ce43-f308-403e-8c34-7addfd06796a None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:32.129016 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-1a11ce43-f308-403e-8c34-7addfd06796a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:32.137369 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-4f41e3f7-5345-424d-9b5d-745ab381c514 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17861b8f0abe4378945ee578a7f5a3d6'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:32.138270 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-4f41e3f7-5345-424d-9b5d-745ab381c514 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17861b8f0abe4378945ee578a7f5a3d6'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:32.150695 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-4f41e3f7-5345-424d-9b5d-745ab381c514 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17861b8f0abe4378945ee578a7f5a3d6'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:32.180129 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1351/2690] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:31:31 2022] DELETE /identity/v3/users/17861b8f0abe4378945ee578a7f5a3d6 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:32.182818 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c6ce6-c05a-42f8-89a2-192ffa32c958 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:32.183377 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c6ce6-c05a-42f8-89a2-192ffa32c958 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:32.184364 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c6ce6-c05a-42f8-89a2-192ffa32c958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:32.213892 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-918c6ce6-c05a-42f8-89a2-192ffa32c958 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:32.216149 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-918c6ce6-c05a-42f8-89a2-192ffa32c958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:32.229872 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:32.247214 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1340/2691] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:31:32.263867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11ce43-f308-403e-8c34-7addfd06796a None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:32.265740 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-1a11ce43-f308-403e-8c34-7addfd06796a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:32.353253 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1352/2692] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:31:32.371204 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c6ce6-c05a-42f8-89a2-192ffa32c958 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:32.378071 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a11ce43-f308-403e-8c34-7addfd06796a None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:32.393893 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:32.479393 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c6ce6-c05a-42f8-89a2-192ffa32c958 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:32.484350 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4eb03-0dbd-4be5-9659-b390cb30cbe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:32.485032 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b51686-ccfc-442d-abbc-ed63c9cfc219 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:32.485606 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b51686-ccfc-442d-abbc-ed63c9cfc219 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:32.485794 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4eb03-0dbd-4be5-9659-b390cb30cbe6 service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:32.485959 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b51686-ccfc-442d-abbc-ed63c9cfc219 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:32.486143 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4eb03-0dbd-4be5-9659-b390cb30cbe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:32.486302 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b51686-ccfc-442d-abbc-ed63c9cfc219 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:32.486620 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4eb03-0dbd-4be5-9659-b390cb30cbe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:32.500101 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b51686-ccfc-442d-abbc-ed63c9cfc219 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:32.501870 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b51686-ccfc-442d-abbc-ed63c9cfc219 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:32.505459 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace4eb03-0dbd-4be5-9659-b390cb30cbe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:32.508237 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace4eb03-0dbd-4be5-9659-b390cb30cbe6 service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:32.524415 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1353/2693] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:31:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:31:32.529374 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1341/2694] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:31:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:31:32.532010 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b51686-ccfc-442d-abbc-ed63c9cfc219 service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:32.534497 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-78b51686-ccfc-442d-abbc-ed63c9cfc219 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:32.553158 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b51686-ccfc-442d-abbc-ed63c9cfc219 service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:32.559081 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15b2a8-21e7-4693-a96c-62df7f6360c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:32.559863 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15b2a8-21e7-4693-a96c-62df7f6360c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:32.560181 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15b2a8-21e7-4693-a96c-62df7f6360c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:32.560949 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15b2a8-21e7-4693-a96c-62df7f6360c3 admin admin] PATH_INFO: `/v3/projects/4d1dc07c8ff447a7aa067847cbf045a7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:32.562457 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad15b2a8-21e7-4693-a96c-62df7f6360c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d1dc07c8ff447a7aa067847cbf045a7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:32.564415 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad15b2a8-21e7-4693-a96c-62df7f6360c3 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:32.642458 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ad15b2a8-21e7-4693-a96c-62df7f6360c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d1dc07c8ff447a7aa067847cbf045a7', 'request_id': 'req-ad15b2a8-21e7-4693-a96c-62df7f6360c3'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:32.656148 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ad15b2a8-21e7-4693-a96c-62df7f6360c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d1dc07c8ff447a7aa067847cbf045a7', 'request_id': 'req-ad15b2a8-21e7-4693-a96c-62df7f6360c3'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:32.669672 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ad15b2a8-21e7-4693-a96c-62df7f6360c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d1dc07c8ff447a7aa067847cbf045a7', 'request_id': 'req-ad15b2a8-21e7-4693-a96c-62df7f6360c3'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:32.688998 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ad15b2a8-21e7-4693-a96c-62df7f6360c3 admin admin] The token cache is being invalidate because project 4d1dc07c8ff447a7aa067847cbf045a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:31:32.689414 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ad15b2a8-21e7-4693-a96c-62df7f6360c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:32.690515 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ad15b2a8-21e7-4693-a96c-62df7f6360c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:32.693132 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1354/2695] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:31:32 2022] DELETE /identity/v3/projects/4d1dc07c8ff447a7aa067847cbf045a7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:32.699805 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4eb03-0dbd-4be5-9659-b390cb30cbe6 service neutron] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:32.714591 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4eb03-0dbd-4be5-9659-b390cb30cbe6 service neutron] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:32.816019 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd91e1-72ba-4098-b12b-d1a7563e9e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:32.817140 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd91e1-72ba-4098-b12b-d1a7563e9e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:32.817633 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd91e1-72ba-4098-b12b-d1a7563e9e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:32.818178 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd91e1-72ba-4098-b12b-d1a7563e9e43 admin admin] PATH_INFO: `/v3/users/5f66cb79444f47c99f90e9c9cee8651a` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:32.820620 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd91e1-72ba-4098-b12b-d1a7563e9e43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f66cb79444f47c99f90e9c9cee8651a)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:32.824913 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd91e1-72ba-4098-b12b-d1a7563e9e43 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:33.094312 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15b2a8-21e7-4693-a96c-62df7f6360c3 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:33.098019 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ad15b2a8-21e7-4693-a96c-62df7f6360c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:33.142850 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15b2a8-21e7-4693-a96c-62df7f6360c3 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:33.150175 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978d2d8-d0ca-4d23-ab76-b737c56de858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:33.151217 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978d2d8-d0ca-4d23-ab76-b737c56de858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:33.151706 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978d2d8-d0ca-4d23-ab76-b737c56de858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:33.152361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978d2d8-d0ca-4d23-ab76-b737c56de858 admin admin] PATH_INFO: `/v3/projects/3ac9251da55540a686f6774b1993352e` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:33.154870 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4978d2d8-d0ca-4d23-ab76-b737c56de858 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ac9251da55540a686f6774b1993352e)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:33.156962 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-74bd91e1-72ba-4098-b12b-d1a7563e9e43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f66cb79444f47c99f90e9c9cee8651a'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:33.157748 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4978d2d8-d0ca-4d23-ab76-b737c56de858 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:33.180668 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:33.195391 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-74bd91e1-72ba-4098-b12b-d1a7563e9e43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f66cb79444f47c99f90e9c9cee8651a'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:33.212101 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-74bd91e1-72ba-4098-b12b-d1a7563e9e43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f66cb79444f47c99f90e9c9cee8651a'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:33.213221 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-74bd91e1-72ba-4098-b12b-d1a7563e9e43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f66cb79444f47c99f90e9c9cee8651a'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:33.225931 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-74bd91e1-72ba-4098-b12b-d1a7563e9e43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f66cb79444f47c99f90e9c9cee8651a'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:33.258687 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-4978d2d8-d0ca-4d23-ab76-b737c56de858 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ac9251da55540a686f6774b1993352e', 'request_id': 'req-4978d2d8-d0ca-4d23-ab76-b737c56de858'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:33.271379 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1342/2696] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:31:32 2022] DELETE /identity/v3/users/5f66cb79444f47c99f90e9c9cee8651a => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:31:33.272935 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-4978d2d8-d0ca-4d23-ab76-b737c56de858 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ac9251da55540a686f6774b1993352e', 'request_id': 'req-4978d2d8-d0ca-4d23-ab76-b737c56de858'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:33.290085 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-4978d2d8-d0ca-4d23-ab76-b737c56de858 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ac9251da55540a686f6774b1993352e', 'request_id': 'req-4978d2d8-d0ca-4d23-ab76-b737c56de858'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:33.314304 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-4978d2d8-d0ca-4d23-ab76-b737c56de858 admin admin] The token cache is being invalidate because project 3ac9251da55540a686f6774b1993352e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:31:33.314827 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-4978d2d8-d0ca-4d23-ab76-b737c56de858 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:33.315807 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-4978d2d8-d0ca-4d23-ab76-b737c56de858 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:33.323812 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1355/2697] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:31:33 2022] DELETE /identity/v3/projects/3ac9251da55540a686f6774b1993352e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:31:33.325876 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3550b1c-cfcf-4da7-88be-5157759babd0 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:33.326396 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3550b1c-cfcf-4da7-88be-5157759babd0 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:33.327594 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3550b1c-cfcf-4da7-88be-5157759babd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:33.358265 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-d3550b1c-cfcf-4da7-88be-5157759babd0 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:33.360773 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-d3550b1c-cfcf-4da7-88be-5157759babd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:33.462115 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1343/2698] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:31:33.474709 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5848f-7128-46eb-8d2a-94c3ffd03767 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:33.475460 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5848f-7128-46eb-8d2a-94c3ffd03767 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:33.475923 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5848f-7128-46eb-8d2a-94c3ffd03767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:33.505132 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-76a5848f-7128-46eb-8d2a-94c3ffd03767 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:33.508188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-76a5848f-7128-46eb-8d2a-94c3ffd03767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:33.541774 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1356/2699] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:31:33.549072 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3550b1c-cfcf-4da7-88be-5157759babd0 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:33.578850 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3550b1c-cfcf-4da7-88be-5157759babd0 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:33.587300 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43594bd8-e0ec-4395-b495-e0377e126e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:33.588056 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43594bd8-e0ec-4395-b495-e0377e126e3e admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:33.588505 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43594bd8-e0ec-4395-b495-e0377e126e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:33.588924 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43594bd8-e0ec-4395-b495-e0377e126e3e admin admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:33.590264 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43594bd8-e0ec-4395-b495-e0377e126e3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:31:33.590614 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43594bd8-e0ec-4395-b495-e0377e126e3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:33.593128 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43594bd8-e0ec-4395-b495-e0377e126e3e admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:33.617842 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1344/2700] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:31:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:31:33.619253 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a5848f-7128-46eb-8d2a-94c3ffd03767 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:33.642286 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a5848f-7128-46eb-8d2a-94c3ffd03767 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:33.657097 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce8e02c-65c6-406e-bd69-c1ba8520cd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:33.664883 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8e02c-65c6-406e-bd69-c1ba8520cd24 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:33.665348 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8e02c-65c6-406e-bd69-c1ba8520cd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:33.668166 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8e02c-65c6-406e-bd69-c1ba8520cd24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:33.668166 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce8e02c-65c6-406e-bd69-c1ba8520cd24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:33.671518 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce8e02c-65c6-406e-bd69-c1ba8520cd24 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:33.681921 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:33.728825 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1357/2701] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:31:33 2022] POST /identity/v3/projects => generated 369 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:31:33.735891 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43594bd8-e0ec-4395-b495-e0377e126e3e admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:33.759871 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43594bd8-e0ec-4395-b495-e0377e126e3e admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:33.851370 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce8e02c-65c6-406e-bd69-c1ba8520cd24 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:33.853611 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-dce8e02c-65c6-406e-bd69-c1ba8520cd24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:33.944015 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22771a7f-1ab6-4642-bc26-43d9faf5c90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:33.944015 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22771a7f-1ab6-4642-bc26-43d9faf5c90c admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:33.944374 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22771a7f-1ab6-4642-bc26-43d9faf5c90c admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:33.945163 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22771a7f-1ab6-4642-bc26-43d9faf5c90c admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:33.948885 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22771a7f-1ab6-4642-bc26-43d9faf5c90c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:33.954008 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22771a7f-1ab6-4642-bc26-43d9faf5c90c admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:34.009339 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1345/2702] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:31:33 2022] POST /identity/v3/users => generated 285 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:31:34.016827 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22771a7f-1ab6-4642-bc26-43d9faf5c90c admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:34.041695 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22771a7f-1ab6-4642-bc26-43d9faf5c90c admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:34.045221 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce8e02c-65c6-406e-bd69-c1ba8520cd24 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:34.054318 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e9fc0-3b64-4aa1-89b2-6ab7f86aa238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:34.055165 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8ced2-e32c-46dc-9293-ecf9c2eb2791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:34.056126 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e9fc0-3b64-4aa1-89b2-6ab7f86aa238 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:34.056389 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8ced2-e32c-46dc-9293-ecf9c2eb2791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:34.057103 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8ced2-e32c-46dc-9293-ecf9c2eb2791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:34.057397 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e9fc0-3b64-4aa1-89b2-6ab7f86aa238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:34.057775 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8ced2-e32c-46dc-9293-ecf9c2eb2791 admin admin] PATH_INFO: `/v3/projects/48551a756469463c8fb8aeb9662d33d4` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:34.058402 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e9fc0-3b64-4aa1-89b2-6ab7f86aa238 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:34.059917 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e9fc0-3b64-4aa1-89b2-6ab7f86aa238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:34.060908 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8ced2-e32c-46dc-9293-ecf9c2eb2791 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48551a756469463c8fb8aeb9662d33d4)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:34.063731 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e9fc0-3b64-4aa1-89b2-6ab7f86aa238 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:34.067405 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8ced2-e32c-46dc-9293-ecf9c2eb2791 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:34.087068 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1346/2703] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:31:34.093138 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e9fc0-3b64-4aa1-89b2-6ab7f86aa238 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:34.115676 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e9fc0-3b64-4aa1-89b2-6ab7f86aa238 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:34.127760 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27bf7d-0a6c-46ba-a2f6-55029c03f914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:34.129050 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27bf7d-0a6c-46ba-a2f6-55029c03f914 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:34.129581 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27bf7d-0a6c-46ba-a2f6-55029c03f914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:34.130854 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27bf7d-0a6c-46ba-a2f6-55029c03f914 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:34.131279 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b27bf7d-0a6c-46ba-a2f6-55029c03f914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:34.135691 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b27bf7d-0a6c-46ba-a2f6-55029c03f914 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:34.158120 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1347/2704] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:31:34.164182 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27bf7d-0a6c-46ba-a2f6-55029c03f914 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:34.164743 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-3aa8ced2-e32c-46dc-9293-ecf9c2eb2791 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48551a756469463c8fb8aeb9662d33d4', 'request_id': 'req-3aa8ced2-e32c-46dc-9293-ecf9c2eb2791'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:34.179385 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-3aa8ced2-e32c-46dc-9293-ecf9c2eb2791 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48551a756469463c8fb8aeb9662d33d4', 'request_id': 'req-3aa8ced2-e32c-46dc-9293-ecf9c2eb2791'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:34.187916 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27bf7d-0a6c-46ba-a2f6-55029c03f914 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:34.189534 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-3aa8ced2-e32c-46dc-9293-ecf9c2eb2791 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48551a756469463c8fb8aeb9662d33d4', 'request_id': 'req-3aa8ced2-e32c-46dc-9293-ecf9c2eb2791'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:34.205234 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-3aa8ced2-e32c-46dc-9293-ecf9c2eb2791 admin admin] The token cache is being invalidate because project 48551a756469463c8fb8aeb9662d33d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:31:34.205944 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-3aa8ced2-e32c-46dc-9293-ecf9c2eb2791 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:34.208109 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-3aa8ced2-e32c-46dc-9293-ecf9c2eb2791 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:34.210801 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1358/2705] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:31:33 2022] DELETE /identity/v3/projects/48551a756469463c8fb8aeb9662d33d4 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:31:34.219484 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1ad00-417d-41ae-97d0-0d6c4189436c None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:34.220127 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1ad00-417d-41ae-97d0-0d6c4189436c None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:34.220651 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1ad00-417d-41ae-97d0-0d6c4189436c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:34.252644 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-8da1ad00-417d-41ae-97d0-0d6c4189436c None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:34.254931 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-8da1ad00-417d-41ae-97d0-0d6c4189436c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:34.260745 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:34.336961 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a5d7a-5f66-4108-b882-a15ddeec6d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:34.338470 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a5d7a-5f66-4108-b882-a15ddeec6d85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:34.339171 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a5d7a-5f66-4108-b882-a15ddeec6d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:34.341420 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a5d7a-5f66-4108-b882-a15ddeec6d85 admin admin] PATH_INFO: `/v3/projects/ec3a4e0a487a45af8880226a7fcdc35a/users/ec8ff29b21964e31bc189a6c75a89ee4/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:34.369828 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1359/2706] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:31:34.387735 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669efbe-b037-4af5-9cd9-2f75f2551de9 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:34.388343 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669efbe-b037-4af5-9cd9-2f75f2551de9 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:34.389235 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a5d7a-5f66-4108-b882-a15ddeec6d85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec3a4e0a487a45af8880226a7fcdc35a, user_id=ec8ff29b21964e31bc189a6c75a89ee4, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:34.389766 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669efbe-b037-4af5-9cd9-2f75f2551de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:34.394770 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a5d7a-5f66-4108-b882-a15ddeec6d85 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:34.425691 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1348/2707] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:31:34 2022] PUT /identity/v3/projects/ec3a4e0a487a45af8880226a7fcdc35a/users/ec8ff29b21964e31bc189a6c75a89ee4/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:34.427419 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-2669efbe-b037-4af5-9cd9-2f75f2551de9 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:34.429608 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2669efbe-b037-4af5-9cd9-2f75f2551de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:34.446686 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6013a-3c1b-458c-8473-d5137ee1e8ba None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:34.447005 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6013a-3c1b-458c-8473-d5137ee1e8ba None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:34.447534 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6013a-3c1b-458c-8473-d5137ee1e8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:34.462896 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:34.530596 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-01d6013a-3c1b-458c-8473-d5137ee1e8ba None None] MFA Rules not processed for user `ec8ff29b21964e31bc189a6c75a89ee4`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:34.533481 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-01d6013a-3c1b-458c-8473-d5137ee1e8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:34.550265 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1360/2708] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:31:34.556837 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669efbe-b037-4af5-9cd9-2f75f2551de9 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:34.584729 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669efbe-b037-4af5-9cd9-2f75f2551de9 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:34.592361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189643c2-bbde-42e5-8a74-12c533309f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:34.593534 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189643c2-bbde-42e5-8a74-12c533309f5e admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:34.594089 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189643c2-bbde-42e5-8a74-12c533309f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:34.594795 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189643c2-bbde-42e5-8a74-12c533309f5e admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:34.597128 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189643c2-bbde-42e5-8a74-12c533309f5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:31:34.597782 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189643c2-bbde-42e5-8a74-12c533309f5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:34.600015 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189643c2-bbde-42e5-8a74-12c533309f5e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:34.620110 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1361/2709] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:31:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:31:34.626418 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189643c2-bbde-42e5-8a74-12c533309f5e admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:34.641515 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189643c2-bbde-42e5-8a74-12c533309f5e admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:34.651628 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ff0f5-85e8-481e-9091-43f9d2d40ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:34.654514 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ff0f5-85e8-481e-9091-43f9d2d40ca9 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:34.654998 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ff0f5-85e8-481e-9091-43f9d2d40ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:34.655489 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ff0f5-85e8-481e-9091-43f9d2d40ca9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:34.656718 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ff0f5-85e8-481e-9091-43f9d2d40ca9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:34.664478 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ff0f5-85e8-481e-9091-43f9d2d40ca9 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:34.688500 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1349/2710] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:31:34.694877 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6013a-3c1b-458c-8473-d5137ee1e8ba None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:34.696971 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-01d6013a-3c1b-458c-8473-d5137ee1e8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:34.723759 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1362/2711] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:31:34 2022] POST /identity/v3/projects => generated 409 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:31:34.726959 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6013a-3c1b-458c-8473-d5137ee1e8ba None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:34.729444 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ff0f5-85e8-481e-9091-43f9d2d40ca9 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:34.849119 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ff0f5-85e8-481e-9091-43f9d2d40ca9 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:34.859025 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8843c-2dab-4b97-975a-41c180473c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:34.860102 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8843c-2dab-4b97-975a-41c180473c49 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:34.860602 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8843c-2dab-4b97-975a-41c180473c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:34.861326 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8843c-2dab-4b97-975a-41c180473c49 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:34.863344 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8843c-2dab-4b97-975a-41c180473c49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:34.867762 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8843c-2dab-4b97-975a-41c180473c49 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:34.895526 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe811ba-fdbe-414e-a427-5b0c16de795f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:34.896954 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe811ba-fdbe-414e-a427-5b0c16de795f admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:34.898102 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe811ba-fdbe-414e-a427-5b0c16de795f admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:34.898521 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe811ba-fdbe-414e-a427-5b0c16de795f admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:34.899885 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe811ba-fdbe-414e-a427-5b0c16de795f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:34.902829 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe811ba-fdbe-414e-a427-5b0c16de795f admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:34.922615 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1363/2712] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:31:34 2022] POST /identity/v3/users => generated 305 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:31:34.927572 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8843c-2dab-4b97-975a-41c180473c49 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:34.941606 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8843c-2dab-4b97-975a-41c180473c49 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:34.947444 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab685d8-a123-497f-86d3-f15b6e589837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:34.948257 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab685d8-a123-497f-86d3-f15b6e589837 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:34.948649 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab685d8-a123-497f-86d3-f15b6e589837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:34.949284 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab685d8-a123-497f-86d3-f15b6e589837 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:34.950087 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab685d8-a123-497f-86d3-f15b6e589837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:34.951946 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab685d8-a123-497f-86d3-f15b6e589837 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:34.955238 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1350/2713] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:31:34 2022] POST /identity/v3/projects => generated 367 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:31:34.958414 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe811ba-fdbe-414e-a427-5b0c16de795f admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:34.973605 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1364/2714] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:31:34.979718 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab685d8-a123-497f-86d3-f15b6e589837 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:34.999978 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab685d8-a123-497f-86d3-f15b6e589837 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:35.031462 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:35.082405 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe811ba-fdbe-414e-a427-5b0c16de795f admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:35.089243 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c5817-03d1-4395-b4f7-a7470460380e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:35.090233 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c5817-03d1-4395-b4f7-a7470460380e admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:35.090612 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c5817-03d1-4395-b4f7-a7470460380e admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:35.090957 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c5817-03d1-4395-b4f7-a7470460380e admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:35.091687 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c5817-03d1-4395-b4f7-a7470460380e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:35.095305 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c5817-03d1-4395-b4f7-a7470460380e admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:35.131888 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1351/2715] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:31:34 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:31:35.133113 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c5817-03d1-4395-b4f7-a7470460380e admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:35.154585 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c5817-03d1-4395-b4f7-a7470460380e admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:35.156356 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180adff0-da3e-4424-8968-df0e7c91dc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:35.157872 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180adff0-da3e-4424-8968-df0e7c91dc88 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:35.158637 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180adff0-da3e-4424-8968-df0e7c91dc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:35.159550 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180adff0-da3e-4424-8968-df0e7c91dc88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:35.165482 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180adff0-da3e-4424-8968-df0e7c91dc88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:35.168848 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f39a8-e83f-4bf0-8e55-be6280527b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:35.169614 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f39a8-e83f-4bf0-8e55-be6280527b7a admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:35.169896 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f39a8-e83f-4bf0-8e55-be6280527b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:35.170166 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f39a8-e83f-4bf0-8e55-be6280527b7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:35.170898 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f39a8-e83f-4bf0-8e55-be6280527b7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:35.172582 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f39a8-e83f-4bf0-8e55-be6280527b7a admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:35.181224 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180adff0-da3e-4424-8968-df0e7c91dc88 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:35.188226 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:35.202536 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1352/2716] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:31:35.208370 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f39a8-e83f-4bf0-8e55-be6280527b7a admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:35.213178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1365/2717] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:31:35.221204 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180adff0-da3e-4424-8968-df0e7c91dc88 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:35.232819 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f39a8-e83f-4bf0-8e55-be6280527b7a admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:35.244225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaee160-9dc8-478d-acea-bc5810be8c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:35.245696 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaee160-9dc8-478d-acea-bc5810be8c98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:35.246977 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaee160-9dc8-478d-acea-bc5810be8c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:35.247459 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaee160-9dc8-478d-acea-bc5810be8c98 admin admin] PATH_INFO: `/v3/projects/7e6db75a5b834833a54e2a0cf4807971/users/c4d68c417442434db5ed1754d48e1cb8/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:35.259958 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180adff0-da3e-4424-8968-df0e7c91dc88 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:35.279263 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67ce80-f03d-48b8-bfc6-63d087189030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:35.280577 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67ce80-f03d-48b8-bfc6-63d087189030 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:35.281065 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67ce80-f03d-48b8-bfc6-63d087189030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:35.281549 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67ce80-f03d-48b8-bfc6-63d087189030 admin admin] PATH_INFO: `/v3/projects/6e6a748dd458409a94f5f92eedd49310/users/88647f50db5f4b0b9ba03d78bccd6499/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:35.295914 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaee160-9dc8-478d-acea-bc5810be8c98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e6db75a5b834833a54e2a0cf4807971, user_id=c4d68c417442434db5ed1754d48e1cb8, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:35.302163 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaee160-9dc8-478d-acea-bc5810be8c98 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:35.307092 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f67ce80-f03d-48b8-bfc6-63d087189030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e6a748dd458409a94f5f92eedd49310, user_id=88647f50db5f4b0b9ba03d78bccd6499, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:35.317026 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f67ce80-f03d-48b8-bfc6-63d087189030 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:35.329132 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1353/2718] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:31:35 2022] PUT /identity/v3/projects/7e6db75a5b834833a54e2a0cf4807971/users/c4d68c417442434db5ed1754d48e1cb8/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:35.335018 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaee160-9dc8-478d-acea-bc5810be8c98 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:35.348823 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1366/2719] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:31:35 2022] PUT /identity/v3/projects/6e6a748dd458409a94f5f92eedd49310/users/88647f50db5f4b0b9ba03d78bccd6499/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:35.359701 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750ce61-5f48-442c-b084-22f355562a78 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:35.359970 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750ce61-5f48-442c-b084-22f355562a78 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:35.360136 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750ce61-5f48-442c-b084-22f355562a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:35.400183 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-b750ce61-5f48-442c-b084-22f355562a78 None None] MFA Rules not processed for user `88647f50db5f4b0b9ba03d78bccd6499`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:35.401513 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b750ce61-5f48-442c-b084-22f355562a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:35.531649 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaee160-9dc8-478d-acea-bc5810be8c98 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:35.575701 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1367/2720] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:35 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:31:35.583821 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750ce61-5f48-442c-b084-22f355562a78 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:35.696860 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac33f2-65b6-4c75-9fb1-5df75a45b787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:35.698891 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac33f2-65b6-4c75-9fb1-5df75a45b787 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:35.699868 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac33f2-65b6-4c75-9fb1-5df75a45b787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:35.700541 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac33f2-65b6-4c75-9fb1-5df75a45b787 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:35.701966 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eac33f2-65b6-4c75-9fb1-5df75a45b787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:35.706258 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eac33f2-65b6-4c75-9fb1-5df75a45b787 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:35.721895 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1354/2721] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:31:35.728636 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac33f2-65b6-4c75-9fb1-5df75a45b787 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:35.749049 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750ce61-5f48-442c-b084-22f355562a78 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:35.750576 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac33f2-65b6-4c75-9fb1-5df75a45b787 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:35.755126 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82881eb-09ac-4d54-950e-27a4b7935374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:35.755940 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82881eb-09ac-4d54-950e-27a4b7935374 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:35.756383 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82881eb-09ac-4d54-950e-27a4b7935374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:35.756713 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82881eb-09ac-4d54-950e-27a4b7935374 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:35.757793 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82881eb-09ac-4d54-950e-27a4b7935374 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:35.759912 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82881eb-09ac-4d54-950e-27a4b7935374 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:35.760327 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e31107-13e0-49c6-903b-41c03f503f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:35.761896 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e31107-13e0-49c6-903b-41c03f503f0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:35.762552 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e31107-13e0-49c6-903b-41c03f503f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:35.763118 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e31107-13e0-49c6-903b-41c03f503f0b admin admin] PATH_INFO: `/v3/projects/7e6db75a5b834833a54e2a0cf4807971/users/c4d68c417442434db5ed1754d48e1cb8/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:35.766945 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e31107-13e0-49c6-903b-41c03f503f0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e6db75a5b834833a54e2a0cf4807971, user_id=c4d68c417442434db5ed1754d48e1cb8, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:35.772747 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e31107-13e0-49c6-903b-41c03f503f0b admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:35.791551 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1355/2722] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:31:35 2022] PUT /identity/v3/projects/7e6db75a5b834833a54e2a0cf4807971/users/c4d68c417442434db5ed1754d48e1cb8/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:35.802513 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c19dd6-ba67-42c9-bf74-db7a8c1b63a5 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:35.802798 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c19dd6-ba67-42c9-bf74-db7a8c1b63a5 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:35.803044 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c19dd6-ba67-42c9-bf74-db7a8c1b63a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:35.805503 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1368/2723] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:31:35 2022] POST /identity/v3/projects => generated 407 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:31:35.810952 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82881eb-09ac-4d54-950e-27a4b7935374 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:35.857258 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:35.867732 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-05c19dd6-ba67-42c9-bf74-db7a8c1b63a5 None None] MFA Rules not processed for user `c4d68c417442434db5ed1754d48e1cb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:35.869334 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-05c19dd6-ba67-42c9-bf74-db7a8c1b63a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:35.931720 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:35.957557 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82881eb-09ac-4d54-950e-27a4b7935374 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:35.966651 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4b7bf-a3d0-4f57-ae46-39dd31a77e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:35.967908 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4b7bf-a3d0-4f57-ae46-39dd31a77e39 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:35.968196 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4b7bf-a3d0-4f57-ae46-39dd31a77e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:35.968645 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4b7bf-a3d0-4f57-ae46-39dd31a77e39 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:35.969780 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c4b7bf-a3d0-4f57-ae46-39dd31a77e39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:35.973196 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c4b7bf-a3d0-4f57-ae46-39dd31a77e39 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:36.012359 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1369/2724] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:31:35 2022] POST /identity/v3/users => generated 310 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:31:36.015424 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4b7bf-a3d0-4f57-ae46-39dd31a77e39 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:36.022335 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1356/2725] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:35 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:31:36.030015 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4b7bf-a3d0-4f57-ae46-39dd31a77e39 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:36.037478 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c19dd6-ba67-42c9-bf74-db7a8c1b63a5 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:36.039370 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f57e9-15bd-4d56-b774-7cfeb05cb13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:36.039763 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-05c19dd6-ba67-42c9-bf74-db7a8c1b63a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:36.040639 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f57e9-15bd-4d56-b774-7cfeb05cb13b admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:36.041206 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f57e9-15bd-4d56-b774-7cfeb05cb13b admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:36.041751 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f57e9-15bd-4d56-b774-7cfeb05cb13b admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:36.043573 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f57e9-15bd-4d56-b774-7cfeb05cb13b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:36.047032 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f57e9-15bd-4d56-b774-7cfeb05cb13b admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:36.067978 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1370/2726] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:31:36.082213 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f57e9-15bd-4d56-b774-7cfeb05cb13b admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:36.109082 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f57e9-15bd-4d56-b774-7cfeb05cb13b admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:36.122963 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31cc31a-820b-4aca-8ab9-847387d347e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:36.124946 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31cc31a-820b-4aca-8ab9-847387d347e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:36.125672 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31cc31a-820b-4aca-8ab9-847387d347e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:36.126495 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31cc31a-820b-4aca-8ab9-847387d347e8 admin admin] PATH_INFO: `/v3/projects/3dc96e1d7ef349388cc282b24a067a4d/users/2ba90d0eb9504b47b6e6bbd5c3ab7f88/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:36.157291 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31cc31a-820b-4aca-8ab9-847387d347e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dc96e1d7ef349388cc282b24a067a4d, user_id=2ba90d0eb9504b47b6e6bbd5c3ab7f88, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:36.160550 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31cc31a-820b-4aca-8ab9-847387d347e8 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:36.190220 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1371/2727] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:31:36 2022] PUT /identity/v3/projects/3dc96e1d7ef349388cc282b24a067a4d/users/2ba90d0eb9504b47b6e6bbd5c3ab7f88/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:36.191045 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c19dd6-ba67-42c9-bf74-db7a8c1b63a5 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:36.198065 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31cc31a-820b-4aca-8ab9-847387d347e8 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:36.276675 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ac8ac-595e-4082-913a-cacd9ebfed0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:36.277837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ac8ac-595e-4082-913a-cacd9ebfed0f service cinder] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:36.278994 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ac8ac-595e-4082-913a-cacd9ebfed0f service cinder] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:36.279498 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ac8ac-595e-4082-913a-cacd9ebfed0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:36.394310 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31cc31a-820b-4aca-8ab9-847387d347e8 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:36.416903 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afac06-5621-4de3-9b49-b9cb420ee010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:36.417985 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afac06-5621-4de3-9b49-b9cb420ee010 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:36.418499 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afac06-5621-4de3-9b49-b9cb420ee010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:36.418983 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afac06-5621-4de3-9b49-b9cb420ee010 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:36.420172 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7afac06-5621-4de3-9b49-b9cb420ee010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:36.425685 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7afac06-5621-4de3-9b49-b9cb420ee010 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:36.452159 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1372/2728] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:31:36.458823 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afac06-5621-4de3-9b49-b9cb420ee010 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:36.488733 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afac06-5621-4de3-9b49-b9cb420ee010 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:36.497317 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970108fd-37e1-4a9e-8efb-7f37797d15ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:36.499216 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970108fd-37e1-4a9e-8efb-7f37797d15ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:36.499934 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970108fd-37e1-4a9e-8efb-7f37797d15ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:36.500593 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970108fd-37e1-4a9e-8efb-7f37797d15ef admin admin] PATH_INFO: `/v3/projects/3dc96e1d7ef349388cc282b24a067a4d/users/2ba90d0eb9504b47b6e6bbd5c3ab7f88/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:36.507389 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970108fd-37e1-4a9e-8efb-7f37797d15ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dc96e1d7ef349388cc282b24a067a4d, user_id=2ba90d0eb9504b47b6e6bbd5c3ab7f88, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:36.518537 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970108fd-37e1-4a9e-8efb-7f37797d15ef admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:36.528247 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ac8ac-595e-4082-913a-cacd9ebfed0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:36.531114 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ac8ac-595e-4082-913a-cacd9ebfed0f service cinder] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:36.564977 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1373/2729] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:31:36 2022] PUT /identity/v3/projects/3dc96e1d7ef349388cc282b24a067a4d/users/2ba90d0eb9504b47b6e6bbd5c3ab7f88/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:31:36.595525 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bbcee-6f1a-40c3-876d-b1067ac3b1e9 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:36.596731 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bbcee-6f1a-40c3-876d-b1067ac3b1e9 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:36.596731 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bbcee-6f1a-40c3-876d-b1067ac3b1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:36.602454 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1357/2730] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:31:36 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:31:36.658981 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-610bbcee-6f1a-40c3-876d-b1067ac3b1e9 None None] MFA Rules not processed for user `2ba90d0eb9504b47b6e6bbd5c3ab7f88`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:36.662203 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-610bbcee-6f1a-40c3-876d-b1067ac3b1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:36.758318 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ac8ac-595e-4082-913a-cacd9ebfed0f service cinder] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:36.761116 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-617ac8ac-595e-4082-913a-cacd9ebfed0f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:36.797438 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:36.810021 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ac8ac-595e-4082-913a-cacd9ebfed0f service cinder] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:36.946667 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1374/2731] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:36 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:31:36.970697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610bbcee-6f1a-40c3-876d-b1067ac3b1e9 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:36.987150 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:36.988218 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87144c-6680-4bb2-8541-58a55471982d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:36.988868 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87144c-6680-4bb2-8541-58a55471982d service cinder] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:36.989141 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87144c-6680-4bb2-8541-58a55471982d service cinder] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:36.991144 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87144c-6680-4bb2-8541-58a55471982d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:37.108804 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610bbcee-6f1a-40c3-876d-b1067ac3b1e9 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:37.124511 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07afe50-f9b5-4cf1-a0a7-d25312ec56ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:37.125908 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07afe50-f9b5-4cf1-a0a7-d25312ec56ac service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:37.126629 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07afe50-f9b5-4cf1-a0a7-d25312ec56ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:37.127235 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07afe50-f9b5-4cf1-a0a7-d25312ec56ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:37.158911 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b87144c-6680-4bb2-8541-58a55471982d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:37.164441 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b87144c-6680-4bb2-8541-58a55471982d service cinder] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:37.168401 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07afe50-f9b5-4cf1-a0a7-d25312ec56ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:37.171517 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07afe50-f9b5-4cf1-a0a7-d25312ec56ac service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:37.223533 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1358/2732] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:31:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:31:37.232850 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1375/2733] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:31:36 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:31:37.636505 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87144c-6680-4bb2-8541-58a55471982d service cinder] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:37.661353 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b87144c-6680-4bb2-8541-58a55471982d service cinder] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:37.672586 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a5086-8f99-408a-a499-7807601a46d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:37.674617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a5086-8f99-408a-a499-7807601a46d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:37.675116 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a5086-8f99-408a-a499-7807601a46d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:37.675582 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a5086-8f99-408a-a499-7807601a46d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:37.805141 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a5086-8f99-408a-a499-7807601a46d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:37.807144 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a5086-8f99-408a-a499-7807601a46d5 service cinder] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:37.850147 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1359/2734] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:31:37 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:31:40.177069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf1a4b-3a8a-4eb8-bae9-88aca1d78313 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:40.178584 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf1a4b-3a8a-4eb8-bae9-88aca1d78313 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:40.179617 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf1a4b-3a8a-4eb8-bae9-88aca1d78313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:40.234300 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-99cf1a4b-3a8a-4eb8-bae9-88aca1d78313 None None] MFA Rules not processed for user `b998c363b3704e9aa4564f39332159d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:40.239831 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-99cf1a4b-3a8a-4eb8-bae9-88aca1d78313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:40.386894 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1376/2735] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:31:40.393307 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a5086-8f99-408a-a499-7807601a46d5 service cinder] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:40.395657 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-e37a5086-8f99-408a-a499-7807601a46d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:40.518087 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:40.527088 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a5086-8f99-408a-a499-7807601a46d5 service cinder] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:40.535506 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f380917-56b7-40a5-9f29-9bbec758e82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:40.536587 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f380917-56b7-40a5-9f29-9bbec758e82a admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:40.537079 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f380917-56b7-40a5-9f29-9bbec758e82a admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:40.537563 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f380917-56b7-40a5-9f29-9bbec758e82a admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:40.538805 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f380917-56b7-40a5-9f29-9bbec758e82a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:40.543164 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f380917-56b7-40a5-9f29-9bbec758e82a admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:40.597112 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1360/2736] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:31:40 2022] POST /identity/v3/projects => generated 371 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:31:40.598252 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf1a4b-3a8a-4eb8-bae9-88aca1d78313 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:40.611680 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf1a4b-3a8a-4eb8-bae9-88aca1d78313 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:40.705088 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e71d6-54f7-460c-b414-815e28bd9ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:40.705533 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e71d6-54f7-460c-b414-815e28bd9ac2 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:40.705805 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e71d6-54f7-460c-b414-815e28bd9ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:40.706080 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e71d6-54f7-460c-b414-815e28bd9ac2 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:40.706792 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3e71d6-54f7-460c-b414-815e28bd9ac2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:40.708791 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3e71d6-54f7-460c-b414-815e28bd9ac2 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:40.749865 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1377/2737] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:31:40 2022] POST /identity/v3/users => generated 292 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:31:40.753861 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f380917-56b7-40a5-9f29-9bbec758e82a admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:40.767284 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f380917-56b7-40a5-9f29-9bbec758e82a admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:40.772636 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb1ca2-3168-4cba-932e-affa271f448d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:40.773261 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb1ca2-3168-4cba-932e-affa271f448d admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:40.773539 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb1ca2-3168-4cba-932e-affa271f448d admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:40.773809 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb1ca2-3168-4cba-932e-affa271f448d admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:40.774850 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb1ca2-3168-4cba-932e-affa271f448d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:40.776494 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb1ca2-3168-4cba-932e-affa271f448d admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:40.790173 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1361/2738] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:31:40.796979 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e71d6-54f7-460c-b414-815e28bd9ac2 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:40.809060 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e71d6-54f7-460c-b414-815e28bd9ac2 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:40.816801 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123d3a6-efc7-4903-b730-6a2da680c92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:40.817917 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123d3a6-efc7-4903-b730-6a2da680c92a admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:40.818447 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123d3a6-efc7-4903-b730-6a2da680c92a admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:40.818937 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123d3a6-efc7-4903-b730-6a2da680c92a admin admin] PATH_INFO: `/v3/projects/d2c2cd45525649d593b2bc3774dc4976/users/fcc680110f4840e78e78af03f039c2c5/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:40.847779 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2123d3a6-efc7-4903-b730-6a2da680c92a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c2cd45525649d593b2bc3774dc4976, user_id=fcc680110f4840e78e78af03f039c2c5, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:40.853158 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2123d3a6-efc7-4903-b730-6a2da680c92a admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:40.879992 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1378/2739] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:31:40 2022] PUT /identity/v3/projects/d2c2cd45525649d593b2bc3774dc4976/users/fcc680110f4840e78e78af03f039c2c5/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:31:40.887378 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb1ca2-3168-4cba-932e-affa271f448d admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:40.903459 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb1ca2-3168-4cba-932e-affa271f448d admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:40.992068 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a130c7-1fcb-4a38-af56-6b274557ed77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:40.992842 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a130c7-1fcb-4a38-af56-6b274557ed77 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:40.993184 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a130c7-1fcb-4a38-af56-6b274557ed77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:40.993517 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a130c7-1fcb-4a38-af56-6b274557ed77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:40.994249 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a130c7-1fcb-4a38-af56-6b274557ed77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:40.996715 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a130c7-1fcb-4a38-af56-6b274557ed77 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:41.013747 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1362/2740] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:31:41.019099 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123d3a6-efc7-4903-b730-6a2da680c92a admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:41.038452 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123d3a6-efc7-4903-b730-6a2da680c92a admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:41.047087 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca2413-be0d-4e8c-a685-c4c31fd7f92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:41.048250 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca2413-be0d-4e8c-a685-c4c31fd7f92e admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:41.048734 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca2413-be0d-4e8c-a685-c4c31fd7f92e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:41.049231 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca2413-be0d-4e8c-a685-c4c31fd7f92e admin admin] PATH_INFO: `/v3/projects/d2c2cd45525649d593b2bc3774dc4976/users/fcc680110f4840e78e78af03f039c2c5/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:41.052893 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca2413-be0d-4e8c-a685-c4c31fd7f92e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c2cd45525649d593b2bc3774dc4976, user_id=fcc680110f4840e78e78af03f039c2c5, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:41.060008 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca2413-be0d-4e8c-a685-c4c31fd7f92e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:41.064003 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:41.080238 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1379/2741] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:31:41 2022] PUT /identity/v3/projects/d2c2cd45525649d593b2bc3774dc4976/users/fcc680110f4840e78e78af03f039c2c5/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:42.023830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a130c7-1fcb-4a38-af56-6b274557ed77 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:42.042080 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a130c7-1fcb-4a38-af56-6b274557ed77 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:42.160473 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ee985-f07e-421b-8e95-8826de313ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:42.161735 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ee985-f07e-421b-8e95-8826de313ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:42.162331 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ee985-f07e-421b-8e95-8826de313ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:42.162879 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ee985-f07e-421b-8e95-8826de313ac8 admin admin] PATH_INFO: `/v3/users/ec8ff29b21964e31bc189a6c75a89ee4` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:42.165579 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5ee985-f07e-421b-8e95-8826de313ac8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec8ff29b21964e31bc189a6c75a89ee4)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:42.170609 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5ee985-f07e-421b-8e95-8826de313ac8 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:42.271911 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-2b5ee985-f07e-421b-8e95-8826de313ac8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec8ff29b21964e31bc189a6c75a89ee4'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:42.300024 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-2b5ee985-f07e-421b-8e95-8826de313ac8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec8ff29b21964e31bc189a6c75a89ee4'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:42.310001 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:42.322819 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-2b5ee985-f07e-421b-8e95-8826de313ac8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec8ff29b21964e31bc189a6c75a89ee4'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:42.324993 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-2b5ee985-f07e-421b-8e95-8826de313ac8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec8ff29b21964e31bc189a6c75a89ee4'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:42.350310 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-2b5ee985-f07e-421b-8e95-8826de313ac8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec8ff29b21964e31bc189a6c75a89ee4'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:42.366437 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1363/2742] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:31:42 2022] DELETE /identity/v3/users/ec8ff29b21964e31bc189a6c75a89ee4 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:42.374081 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4952829-4c7f-4abd-b14f-7da5f743c2bd None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:42.375391 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4952829-4c7f-4abd-b14f-7da5f743c2bd None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:42.376058 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4952829-4c7f-4abd-b14f-7da5f743c2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:42.407050 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-d4952829-4c7f-4abd-b14f-7da5f743c2bd None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:42.408976 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d4952829-4c7f-4abd-b14f-7da5f743c2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:42.528216 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1380/2743] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:31:42.540188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ee985-f07e-421b-8e95-8826de313ac8 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:42.543872 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-2b5ee985-f07e-421b-8e95-8826de313ac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:42.630531 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ee985-f07e-421b-8e95-8826de313ac8 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:42.634895 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65cbb88-aa5d-4018-8cd8-77f007ae1258 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:42.635614 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65cbb88-aa5d-4018-8cd8-77f007ae1258 service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:42.636746 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65cbb88-aa5d-4018-8cd8-77f007ae1258 service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:42.637078 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65cbb88-aa5d-4018-8cd8-77f007ae1258 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:42.648691 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65cbb88-aa5d-4018-8cd8-77f007ae1258 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:42.650619 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65cbb88-aa5d-4018-8cd8-77f007ae1258 service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:42.664050 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1364/2744] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:31:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:31:43.193014 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4952829-4c7f-4abd-b14f-7da5f743c2bd None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:43.197772 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d4952829-4c7f-4abd-b14f-7da5f743c2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:43.234869 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4952829-4c7f-4abd-b14f-7da5f743c2bd None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:43.250308 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc611dfb-0dd2-4d3e-93b6-b43ad1a20fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:43.251462 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc611dfb-0dd2-4d3e-93b6-b43ad1a20fb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:43.253398 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc611dfb-0dd2-4d3e-93b6-b43ad1a20fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:43.254690 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc611dfb-0dd2-4d3e-93b6-b43ad1a20fb5 admin admin] PATH_INFO: `/v3/projects/ec3a4e0a487a45af8880226a7fcdc35a` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:43.257536 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc611dfb-0dd2-4d3e-93b6-b43ad1a20fb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec3a4e0a487a45af8880226a7fcdc35a)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:43.262044 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc611dfb-0dd2-4d3e-93b6-b43ad1a20fb5 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:43.382988 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-cc611dfb-0dd2-4d3e-93b6-b43ad1a20fb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec3a4e0a487a45af8880226a7fcdc35a', 'request_id': 'req-cc611dfb-0dd2-4d3e-93b6-b43ad1a20fb5'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:43.395725 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-cc611dfb-0dd2-4d3e-93b6-b43ad1a20fb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec3a4e0a487a45af8880226a7fcdc35a', 'request_id': 'req-cc611dfb-0dd2-4d3e-93b6-b43ad1a20fb5'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:43.407772 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-cc611dfb-0dd2-4d3e-93b6-b43ad1a20fb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec3a4e0a487a45af8880226a7fcdc35a', 'request_id': 'req-cc611dfb-0dd2-4d3e-93b6-b43ad1a20fb5'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:43.424285 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-cc611dfb-0dd2-4d3e-93b6-b43ad1a20fb5 admin admin] The token cache is being invalidate because project ec3a4e0a487a45af8880226a7fcdc35a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:31:43.424853 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-cc611dfb-0dd2-4d3e-93b6-b43ad1a20fb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:43.426410 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-cc611dfb-0dd2-4d3e-93b6-b43ad1a20fb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:43.429119 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1381/2745] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:31:43 2022] DELETE /identity/v3/projects/ec3a4e0a487a45af8880226a7fcdc35a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:43.435620 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65cbb88-aa5d-4018-8cd8-77f007ae1258 service neutron] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:43.458453 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65cbb88-aa5d-4018-8cd8-77f007ae1258 service neutron] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:43.600788 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044f6e9-5e9c-448a-bf12-877fbc601b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:43.602532 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044f6e9-5e9c-448a-bf12-877fbc601b5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:43.603609 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044f6e9-5e9c-448a-bf12-877fbc601b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:43.604305 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044f6e9-5e9c-448a-bf12-877fbc601b5c admin admin] PATH_INFO: `/v3/users/c4d68c417442434db5ed1754d48e1cb8` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:43.607417 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044f6e9-5e9c-448a-bf12-877fbc601b5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4d68c417442434db5ed1754d48e1cb8)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:43.612123 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044f6e9-5e9c-448a-bf12-877fbc601b5c admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:43.722402 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-4044f6e9-5e9c-448a-bf12-877fbc601b5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4d68c417442434db5ed1754d48e1cb8'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:43.759155 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-4044f6e9-5e9c-448a-bf12-877fbc601b5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4d68c417442434db5ed1754d48e1cb8'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:43.778161 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-4044f6e9-5e9c-448a-bf12-877fbc601b5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4d68c417442434db5ed1754d48e1cb8'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:43.779200 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-4044f6e9-5e9c-448a-bf12-877fbc601b5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4d68c417442434db5ed1754d48e1cb8'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:43.797309 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-4044f6e9-5e9c-448a-bf12-877fbc601b5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4d68c417442434db5ed1754d48e1cb8'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:43.811046 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1365/2746] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:31:43 2022] DELETE /identity/v3/users/c4d68c417442434db5ed1754d48e1cb8 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:44.284830 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc611dfb-0dd2-4d3e-93b6-b43ad1a20fb5 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:44.287119 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-cc611dfb-0dd2-4d3e-93b6-b43ad1a20fb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:44.318773 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc611dfb-0dd2-4d3e-93b6-b43ad1a20fb5 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:44.452858 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa00c42-54a6-4ec2-9b76-df3fb775a08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:44.455110 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa00c42-54a6-4ec2-9b76-df3fb775a08d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:44.455887 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa00c42-54a6-4ec2-9b76-df3fb775a08d admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:44.456579 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa00c42-54a6-4ec2-9b76-df3fb775a08d admin admin] PATH_INFO: `/v3/projects/7e6db75a5b834833a54e2a0cf4807971` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:44.459391 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa00c42-54a6-4ec2-9b76-df3fb775a08d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e6db75a5b834833a54e2a0cf4807971)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:44.465096 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa00c42-54a6-4ec2-9b76-df3fb775a08d admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:44.548784 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:44.644429 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0aa00c42-54a6-4ec2-9b76-df3fb775a08d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e6db75a5b834833a54e2a0cf4807971', 'request_id': 'req-0aa00c42-54a6-4ec2-9b76-df3fb775a08d'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:44.663281 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0aa00c42-54a6-4ec2-9b76-df3fb775a08d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e6db75a5b834833a54e2a0cf4807971', 'request_id': 'req-0aa00c42-54a6-4ec2-9b76-df3fb775a08d'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:44.681916 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0aa00c42-54a6-4ec2-9b76-df3fb775a08d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e6db75a5b834833a54e2a0cf4807971', 'request_id': 'req-0aa00c42-54a6-4ec2-9b76-df3fb775a08d'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:44.728965 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0aa00c42-54a6-4ec2-9b76-df3fb775a08d admin admin] The token cache is being invalidate because project 7e6db75a5b834833a54e2a0cf4807971 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:31:44.730871 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0aa00c42-54a6-4ec2-9b76-df3fb775a08d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:44.731727 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-0aa00c42-54a6-4ec2-9b76-df3fb775a08d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:44.734785 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1382/2747] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:31:44 2022] DELETE /identity/v3/projects/7e6db75a5b834833a54e2a0cf4807971 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:44.744902 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be8e17-2d9a-42f4-a4c0-72626b04ed92 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:44.747305 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be8e17-2d9a-42f4-a4c0-72626b04ed92 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:44.747915 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be8e17-2d9a-42f4-a4c0-72626b04ed92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:44.820236 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-62be8e17-2d9a-42f4-a4c0-72626b04ed92 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:44.820469 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa00c42-54a6-4ec2-9b76-df3fb775a08d admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:44.821910 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-0aa00c42-54a6-4ec2-9b76-df3fb775a08d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:44.824237 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-62be8e17-2d9a-42f4-a4c0-72626b04ed92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:44.834004 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:44.963734 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1366/2748] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:31:44.979357 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab992e0-d7d1-433b-aab4-eb3421ec8d4e None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:44.980348 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab992e0-d7d1-433b-aab4-eb3421ec8d4e None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:44.980816 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab992e0-d7d1-433b-aab4-eb3421ec8d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:45.015943 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-4ab992e0-d7d1-433b-aab4-eb3421ec8d4e None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:45.018589 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-4ab992e0-d7d1-433b-aab4-eb3421ec8d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:45.029076 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa00c42-54a6-4ec2-9b76-df3fb775a08d admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:45.060770 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e94a6-a5c9-48f4-ae71-a51c80768fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:45.061688 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e94a6-a5c9-48f4-ae71-a51c80768fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:45.062135 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e94a6-a5c9-48f4-ae71-a51c80768fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:45.062601 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e94a6-a5c9-48f4-ae71-a51c80768fe3 admin admin] PATH_INFO: `/v3/users/88647f50db5f4b0b9ba03d78bccd6499` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:45.066140 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1367/2749] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:31:45.067235 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6e94a6-a5c9-48f4-ae71-a51c80768fe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88647f50db5f4b0b9ba03d78bccd6499)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:45.078623 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab992e0-d7d1-433b-aab4-eb3421ec8d4e None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:45.083419 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6e94a6-a5c9-48f4-ae71-a51c80768fe3 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:45.097668 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab992e0-d7d1-433b-aab4-eb3421ec8d4e None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:45.118782 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5ebba-0f1e-46f6-88b3-5b3a76c175d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:45.119868 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5ebba-0f1e-46f6-88b3-5b3a76c175d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:45.124357 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5ebba-0f1e-46f6-88b3-5b3a76c175d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:45.124357 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5ebba-0f1e-46f6-88b3-5b3a76c175d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:45.124357 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e5ebba-0f1e-46f6-88b3-5b3a76c175d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:31:45.129665 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e5ebba-0f1e-46f6-88b3-5b3a76c175d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:45.145226 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e5ebba-0f1e-46f6-88b3-5b3a76c175d1 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:45.224399 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1368/2750] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:31:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:31:45.229256 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5ebba-0f1e-46f6-88b3-5b3a76c175d1 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:45.251325 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ee6e94a6-a5c9-48f4-ae71-a51c80768fe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88647f50db5f4b0b9ba03d78bccd6499'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:45.270859 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5ebba-0f1e-46f6-88b3-5b3a76c175d1 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:45.280365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ee6e94a6-a5c9-48f4-ae71-a51c80768fe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88647f50db5f4b0b9ba03d78bccd6499'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:45.294340 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b3c2b-e073-4b20-b57b-7d40f54ce48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:45.296372 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b3c2b-e073-4b20-b57b-7d40f54ce48f admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:45.297320 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b3c2b-e073-4b20-b57b-7d40f54ce48f admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:45.298248 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b3c2b-e073-4b20-b57b-7d40f54ce48f admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:45.305652 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b3c2b-e073-4b20-b57b-7d40f54ce48f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:45.314474 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b3c2b-e073-4b20-b57b-7d40f54ce48f admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:45.314699 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ee6e94a6-a5c9-48f4-ae71-a51c80768fe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88647f50db5f4b0b9ba03d78bccd6499'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:45.315674 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ee6e94a6-a5c9-48f4-ae71-a51c80768fe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88647f50db5f4b0b9ba03d78bccd6499'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:45.348656 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-ee6e94a6-a5c9-48f4-ae71-a51c80768fe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88647f50db5f4b0b9ba03d78bccd6499'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:45.371698 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1383/2751] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:31:44 2022] DELETE /identity/v3/users/88647f50db5f4b0b9ba03d78bccd6499 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:31:45.377365 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcd756-ddb7-4e1e-bb41-a2f39c0bcc93 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:45.379874 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcd756-ddb7-4e1e-bb41-a2f39c0bcc93 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:45.382054 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcd756-ddb7-4e1e-bb41-a2f39c0bcc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:45.390444 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1369/2752] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:31:45 2022] POST /identity/v3/projects => generated 387 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:31:45.396012 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b3c2b-e073-4b20-b57b-7d40f54ce48f admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:45.399973 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-e98b3c2b-e073-4b20-b57b-7d40f54ce48f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:45.465858 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-57fcd756-ddb7-4e1e-bb41-a2f39c0bcc93 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:45.474582 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-57fcd756-ddb7-4e1e-bb41-a2f39c0bcc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:45.515221 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b3c2b-e073-4b20-b57b-7d40f54ce48f admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:45.521980 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1db3c-e7b9-4711-a49c-0e6894c77c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:45.522934 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1db3c-e7b9-4711-a49c-0e6894c77c7d admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:45.523331 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1db3c-e7b9-4711-a49c-0e6894c77c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:45.523778 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1db3c-e7b9-4711-a49c-0e6894c77c7d admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:45.524845 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e1db3c-e7b9-4711-a49c-0e6894c77c7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:45.528172 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e1db3c-e7b9-4711-a49c-0e6894c77c7d admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:45.535142 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:45.574443 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1370/2753] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:31:45 2022] POST /identity/v3/users => generated 294 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:31:45.575680 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1db3c-e7b9-4711-a49c-0e6894c77c7d admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:45.592979 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1db3c-e7b9-4711-a49c-0e6894c77c7d admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:45.601085 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ecbdb-ddbf-4bc2-9822-aab1c87510b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:45.602026 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ecbdb-ddbf-4bc2-9822-aab1c87510b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:45.603871 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ecbdb-ddbf-4bc2-9822-aab1c87510b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:45.604352 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ecbdb-ddbf-4bc2-9822-aab1c87510b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:45.606453 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ecbdb-ddbf-4bc2-9822-aab1c87510b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:45.608557 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ecbdb-ddbf-4bc2-9822-aab1c87510b3 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:45.635072 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1371/2754] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:31:45.638145 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ecbdb-ddbf-4bc2-9822-aab1c87510b3 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:45.654004 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ecbdb-ddbf-4bc2-9822-aab1c87510b3 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:45.662281 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be883bb4-8318-48a9-9f6a-ec4b28524478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:45.663539 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be883bb4-8318-48a9-9f6a-ec4b28524478 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:45.664770 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be883bb4-8318-48a9-9f6a-ec4b28524478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:45.665291 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be883bb4-8318-48a9-9f6a-ec4b28524478 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:45.666259 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be883bb4-8318-48a9-9f6a-ec4b28524478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:45.674483 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be883bb4-8318-48a9-9f6a-ec4b28524478 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:45.694907 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1372/2755] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:31:45.697058 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be883bb4-8318-48a9-9f6a-ec4b28524478 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:45.710789 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be883bb4-8318-48a9-9f6a-ec4b28524478 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:45.715842 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1384/2756] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:31:45.722621 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2392b5d-200d-4834-a3e3-5d39eb31956c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:45.723769 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2392b5d-200d-4834-a3e3-5d39eb31956c admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:45.724291 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2392b5d-200d-4834-a3e3-5d39eb31956c admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:45.724916 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2392b5d-200d-4834-a3e3-5d39eb31956c admin admin] PATH_INFO: `/v3/projects/c2edf97087694f15a3dd8d9fd784e567/users/fc84989363d948d094b3e1bb4d82e33b/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:45.727303 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fcd756-ddb7-4e1e-bb41-a2f39c0bcc93 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:45.730132 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-57fcd756-ddb7-4e1e-bb41-a2f39c0bcc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:45.749906 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2392b5d-200d-4834-a3e3-5d39eb31956c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2edf97087694f15a3dd8d9fd784e567, user_id=fc84989363d948d094b3e1bb4d82e33b, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:45.754020 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2392b5d-200d-4834-a3e3-5d39eb31956c admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:45.788986 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1373/2757] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:31:45 2022] PUT /identity/v3/projects/c2edf97087694f15a3dd8d9fd784e567/users/fc84989363d948d094b3e1bb4d82e33b/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:45.808938 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03914399-60ce-4510-a908-977733616173 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:45.809673 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03914399-60ce-4510-a908-977733616173 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:45.810192 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03914399-60ce-4510-a908-977733616173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:45.880872 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:45.905633 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-03914399-60ce-4510-a908-977733616173 None None] MFA Rules not processed for user `fc84989363d948d094b3e1bb4d82e33b`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:45.908659 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-03914399-60ce-4510-a908-977733616173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:45.951190 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fcd756-ddb7-4e1e-bb41-a2f39c0bcc93 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:46.159658 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924da203-b982-4e17-aa44-b3eed9592888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:46.159945 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924da203-b982-4e17-aa44-b3eed9592888 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:46.160134 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924da203-b982-4e17-aa44-b3eed9592888 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:46.161718 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924da203-b982-4e17-aa44-b3eed9592888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:46.175018 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1374/2758] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:31:46.176185 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03914399-60ce-4510-a908-977733616173 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:46.363730 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03914399-60ce-4510-a908-977733616173 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:46.368905 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960128f-5aa3-4c63-9dec-0ec6f3b9c9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:46.369611 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960128f-5aa3-4c63-9dec-0ec6f3b9c9c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:46.369896 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960128f-5aa3-4c63-9dec-0ec6f3b9c9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:46.370245 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960128f-5aa3-4c63-9dec-0ec6f3b9c9c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:46.370880 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c960128f-5aa3-4c63-9dec-0ec6f3b9c9c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:46.373071 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c960128f-5aa3-4c63-9dec-0ec6f3b9c9c4 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:46.392261 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924da203-b982-4e17-aa44-b3eed9592888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:46.396011 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924da203-b982-4e17-aa44-b3eed9592888 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:46.445215 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1385/2759] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:31:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 719 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:31:46.480801 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1375/2760] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:31:46 2022] POST /identity/v3/projects => generated 387 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:31:46.484922 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924da203-b982-4e17-aa44-b3eed9592888 service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:46.501927 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924da203-b982-4e17-aa44-b3eed9592888 service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:46.609728 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:46.674939 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941ed6a-eace-4373-903e-c76d5c9a729e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:46.676227 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941ed6a-eace-4373-903e-c76d5c9a729e admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:46.677493 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941ed6a-eace-4373-903e-c76d5c9a729e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:46.678249 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941ed6a-eace-4373-903e-c76d5c9a729e admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:46.680432 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941ed6a-eace-4373-903e-c76d5c9a729e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:46.685811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941ed6a-eace-4373-903e-c76d5c9a729e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:46.738215 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1386/2761] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:31:46 2022] POST /identity/v3/users => generated 300 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:31:46.739645 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960128f-5aa3-4c63-9dec-0ec6f3b9c9c4 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:46.779346 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960128f-5aa3-4c63-9dec-0ec6f3b9c9c4 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:46.791723 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079f72f-2b42-4979-81a8-9b29498855c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:46.793230 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079f72f-2b42-4979-81a8-9b29498855c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:46.793673 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079f72f-2b42-4979-81a8-9b29498855c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:46.794104 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079f72f-2b42-4979-81a8-9b29498855c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:46.797625 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079f72f-2b42-4979-81a8-9b29498855c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:46.799644 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079f72f-2b42-4979-81a8-9b29498855c6 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:46.824133 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1376/2762] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:31:46.831418 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941ed6a-eace-4373-903e-c76d5c9a729e admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:46.852740 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941ed6a-eace-4373-903e-c76d5c9a729e admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:46.867798 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8aa18-5820-4b91-a379-167f604890ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:46.868616 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8aa18-5820-4b91-a379-167f604890ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:46.869130 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8aa18-5820-4b91-a379-167f604890ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:46.871398 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8aa18-5820-4b91-a379-167f604890ac admin admin] PATH_INFO: `/v3/projects/1f213eb68c874fa5a07568665c0044ca/users/53ac14aa523e40c09b1c144903552593/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:46.929686 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8aa18-5820-4b91-a379-167f604890ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f213eb68c874fa5a07568665c0044ca, user_id=53ac14aa523e40c09b1c144903552593, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:46.935645 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8aa18-5820-4b91-a379-167f604890ac admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:46.967224 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1387/2763] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:31:46 2022] PUT /identity/v3/projects/1f213eb68c874fa5a07568665c0044ca/users/53ac14aa523e40c09b1c144903552593/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:46.974917 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079f72f-2b42-4979-81a8-9b29498855c6 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:46.997685 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079f72f-2b42-4979-81a8-9b29498855c6 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:47.137413 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f9cc92-3d25-42c2-9c29-cbf59762d0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:47.138069 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9cc92-3d25-42c2-9c29-cbf59762d0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:47.138355 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9cc92-3d25-42c2-9c29-cbf59762d0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:47.138662 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9cc92-3d25-42c2-9c29-cbf59762d0a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:47.139547 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f9cc92-3d25-42c2-9c29-cbf59762d0a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:47.141123 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f9cc92-3d25-42c2-9c29-cbf59762d0a3 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:47.175298 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1377/2764] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:31:47.184309 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8aa18-5820-4b91-a379-167f604890ac admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:47.234294 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8aa18-5820-4b91-a379-167f604890ac admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:47.249707 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f54506-dfd2-4f33-a324-f1d8d1aeac35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:47.253654 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f54506-dfd2-4f33-a324-f1d8d1aeac35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:47.256628 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f54506-dfd2-4f33-a324-f1d8d1aeac35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:47.257203 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f54506-dfd2-4f33-a324-f1d8d1aeac35 admin admin] PATH_INFO: `/v3/projects/1f213eb68c874fa5a07568665c0044ca/users/53ac14aa523e40c09b1c144903552593/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:47.267377 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f54506-dfd2-4f33-a324-f1d8d1aeac35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f213eb68c874fa5a07568665c0044ca, user_id=53ac14aa523e40c09b1c144903552593, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:47.275969 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f54506-dfd2-4f33-a324-f1d8d1aeac35 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:47.326704 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1388/2765] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:31:47 2022] PUT /identity/v3/projects/1f213eb68c874fa5a07568665c0044ca/users/53ac14aa523e40c09b1c144903552593/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:47.328316 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506a44c-ee5e-4ee2-9cf2-5d1a2b1ec418 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:47.328645 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506a44c-ee5e-4ee2-9cf2-5d1a2b1ec418 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:47.328951 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506a44c-ee5e-4ee2-9cf2-5d1a2b1ec418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:47.356505 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:47.370194 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-9506a44c-ee5e-4ee2-9cf2-5d1a2b1ec418 None None] MFA Rules not processed for user `53ac14aa523e40c09b1c144903552593`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:47.375274 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-9506a44c-ee5e-4ee2-9cf2-5d1a2b1ec418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:47.568302 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f54506-dfd2-4f33-a324-f1d8d1aeac35 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:47.581487 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-62f54506-dfd2-4f33-a324-f1d8d1aeac35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:47.598821 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1378/2766] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:47 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:31:47.616779 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506a44c-ee5e-4ee2-9cf2-5d1a2b1ec418 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:47.619858 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-9506a44c-ee5e-4ee2-9cf2-5d1a2b1ec418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:47.879281 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506a44c-ee5e-4ee2-9cf2-5d1a2b1ec418 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:47.896303 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3cb640-7cea-46d3-b6a4-233f7e017742 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:47.896993 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3cb640-7cea-46d3-b6a4-233f7e017742 service cinder] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:47.897289 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3cb640-7cea-46d3-b6a4-233f7e017742 service cinder] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:47.897567 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3cb640-7cea-46d3-b6a4-233f7e017742 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:47.913155 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f54506-dfd2-4f33-a324-f1d8d1aeac35 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:47.936088 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2147259-7f2b-4aaf-b7d0-a217ec3a68bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:47.937213 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2147259-7f2b-4aaf-b7d0-a217ec3a68bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:47.937668 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2147259-7f2b-4aaf-b7d0-a217ec3a68bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:47.938157 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2147259-7f2b-4aaf-b7d0-a217ec3a68bc admin admin] PATH_INFO: `/v3/projects/6e6a748dd458409a94f5f92eedd49310` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:47.944366 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3cb640-7cea-46d3-b6a4-233f7e017742 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:47.946181 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2147259-7f2b-4aaf-b7d0-a217ec3a68bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e6a748dd458409a94f5f92eedd49310)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:47.948458 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3cb640-7cea-46d3-b6a4-233f7e017742 service cinder] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:47.949687 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2147259-7f2b-4aaf-b7d0-a217ec3a68bc admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:47.977730 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1379/2767] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:31:47 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:31:48.223298 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d2147259-7f2b-4aaf-b7d0-a217ec3a68bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e6a748dd458409a94f5f92eedd49310', 'request_id': 'req-d2147259-7f2b-4aaf-b7d0-a217ec3a68bc'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:48.260168 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d2147259-7f2b-4aaf-b7d0-a217ec3a68bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e6a748dd458409a94f5f92eedd49310', 'request_id': 'req-d2147259-7f2b-4aaf-b7d0-a217ec3a68bc'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:48.284284 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d2147259-7f2b-4aaf-b7d0-a217ec3a68bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e6a748dd458409a94f5f92eedd49310', 'request_id': 'req-d2147259-7f2b-4aaf-b7d0-a217ec3a68bc'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:48.327151 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d2147259-7f2b-4aaf-b7d0-a217ec3a68bc admin admin] The token cache is being invalidate because project 6e6a748dd458409a94f5f92eedd49310 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:31:48.327750 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d2147259-7f2b-4aaf-b7d0-a217ec3a68bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:48.330660 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-d2147259-7f2b-4aaf-b7d0-a217ec3a68bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:48.340631 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1389/2768] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:31:47 2022] DELETE /identity/v3/projects/6e6a748dd458409a94f5f92eedd49310 => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:48.345772 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3cb640-7cea-46d3-b6a4-233f7e017742 service cinder] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:48.360929 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3cb640-7cea-46d3-b6a4-233f7e017742 service cinder] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:48.587666 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3b44b-787a-4487-ae7f-179d2df61a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:48.588506 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3b44b-787a-4487-ae7f-179d2df61a4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:48.588832 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3b44b-787a-4487-ae7f-179d2df61a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:48.589668 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3b44b-787a-4487-ae7f-179d2df61a4d admin admin] PATH_INFO: `/v3/users/2ba90d0eb9504b47b6e6bbd5c3ab7f88` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:48.593286 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc3b44b-787a-4487-ae7f-179d2df61a4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ba90d0eb9504b47b6e6bbd5c3ab7f88)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:48.595453 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc3b44b-787a-4487-ae7f-179d2df61a4d admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:48.768477 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:48.782942 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-0cc3b44b-787a-4487-ae7f-179d2df61a4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ba90d0eb9504b47b6e6bbd5c3ab7f88'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:48.832192 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-0cc3b44b-787a-4487-ae7f-179d2df61a4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ba90d0eb9504b47b6e6bbd5c3ab7f88'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:48.850442 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-0cc3b44b-787a-4487-ae7f-179d2df61a4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ba90d0eb9504b47b6e6bbd5c3ab7f88'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:48.851136 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-0cc3b44b-787a-4487-ae7f-179d2df61a4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ba90d0eb9504b47b6e6bbd5c3ab7f88'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:48.865084 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-0cc3b44b-787a-4487-ae7f-179d2df61a4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ba90d0eb9504b47b6e6bbd5c3ab7f88'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:48.897646 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1380/2769] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:31:48 2022] DELETE /identity/v3/users/2ba90d0eb9504b47b6e6bbd5c3ab7f88 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:49.230541 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2147259-7f2b-4aaf-b7d0-a217ec3a68bc admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:49.233939 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d2147259-7f2b-4aaf-b7d0-a217ec3a68bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:49.261814 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2147259-7f2b-4aaf-b7d0-a217ec3a68bc admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:49.289525 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:49.414152 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48eabaa-9e86-4979-91bd-b6e27f64fc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:49.415313 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48eabaa-9e86-4979-91bd-b6e27f64fc68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:49.418815 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48eabaa-9e86-4979-91bd-b6e27f64fc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:49.420415 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48eabaa-9e86-4979-91bd-b6e27f64fc68 admin admin] PATH_INFO: `/v3/users/fc84989363d948d094b3e1bb4d82e33b` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:49.424678 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48eabaa-9e86-4979-91bd-b6e27f64fc68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc84989363d948d094b3e1bb4d82e33b)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:49.429405 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48eabaa-9e86-4979-91bd-b6e27f64fc68 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:49.514467 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-b48eabaa-9e86-4979-91bd-b6e27f64fc68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc84989363d948d094b3e1bb4d82e33b'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:49.525471 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-b48eabaa-9e86-4979-91bd-b6e27f64fc68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc84989363d948d094b3e1bb4d82e33b'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:49.547056 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-b48eabaa-9e86-4979-91bd-b6e27f64fc68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc84989363d948d094b3e1bb4d82e33b'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:49.547420 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-b48eabaa-9e86-4979-91bd-b6e27f64fc68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc84989363d948d094b3e1bb4d82e33b'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:49.565687 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-b48eabaa-9e86-4979-91bd-b6e27f64fc68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc84989363d948d094b3e1bb4d82e33b'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:49.579611 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1390/2770] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:31:49 2022] DELETE /identity/v3/users/fc84989363d948d094b3e1bb4d82e33b => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:49.585581 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee28d5e-5990-4f27-9402-f040aec1dcc1 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:49.585870 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee28d5e-5990-4f27-9402-f040aec1dcc1 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:49.586148 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee28d5e-5990-4f27-9402-f040aec1dcc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:49.636160 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-5ee28d5e-5990-4f27-9402-f040aec1dcc1 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:49.638436 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-5ee28d5e-5990-4f27-9402-f040aec1dcc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:49.782344 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48eabaa-9e86-4979-91bd-b6e27f64fc68 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:49.785500 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b48eabaa-9e86-4979-91bd-b6e27f64fc68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:49.864828 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1381/2771] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:31:49.880277 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee28d5e-5990-4f27-9402-f040aec1dcc1 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:49.886584 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-5ee28d5e-5990-4f27-9402-f040aec1dcc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:49.960496 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48eabaa-9e86-4979-91bd-b6e27f64fc68 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:49.966480 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6270b8e5-7fb2-46e3-b821-832d8db64564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:49.967466 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270b8e5-7fb2-46e3-b821-832d8db64564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:49.968394 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270b8e5-7fb2-46e3-b821-832d8db64564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:49.968394 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270b8e5-7fb2-46e3-b821-832d8db64564 admin admin] PATH_INFO: `/v3/projects/3dc96e1d7ef349388cc282b24a067a4d` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:49.970209 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6270b8e5-7fb2-46e3-b821-832d8db64564 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dc96e1d7ef349388cc282b24a067a4d)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:49.972095 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6270b8e5-7fb2-46e3-b821-832d8db64564 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:50.003886 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee28d5e-5990-4f27-9402-f040aec1dcc1 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:50.013197 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdcebb7-19f2-4372-a0d5-542a61d23f8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:50.014192 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcebb7-19f2-4372-a0d5-542a61d23f8b service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:50.014682 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcebb7-19f2-4372-a0d5-542a61d23f8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:50.015123 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcebb7-19f2-4372-a0d5-542a61d23f8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:50.048243 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdcebb7-19f2-4372-a0d5-542a61d23f8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:50.052101 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdcebb7-19f2-4372-a0d5-542a61d23f8b service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:50.067287 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1382/2772] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:31:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:31:50.090297 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:50.110103 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-6270b8e5-7fb2-46e3-b821-832d8db64564 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dc96e1d7ef349388cc282b24a067a4d', 'request_id': 'req-6270b8e5-7fb2-46e3-b821-832d8db64564'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:50.113114 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3e9c2-7af5-42bd-91ab-9e7bf1262ec5 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:50.121103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3e9c2-7af5-42bd-91ab-9e7bf1262ec5 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:50.121587 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3e9c2-7af5-42bd-91ab-9e7bf1262ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:50.137765 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-6270b8e5-7fb2-46e3-b821-832d8db64564 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dc96e1d7ef349388cc282b24a067a4d', 'request_id': 'req-6270b8e5-7fb2-46e3-b821-832d8db64564'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:50.148477 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-6270b8e5-7fb2-46e3-b821-832d8db64564 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dc96e1d7ef349388cc282b24a067a4d', 'request_id': 'req-6270b8e5-7fb2-46e3-b821-832d8db64564'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:50.167544 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-6270b8e5-7fb2-46e3-b821-832d8db64564 admin admin] The token cache is being invalidate because project 3dc96e1d7ef349388cc282b24a067a4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:31:50.168227 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-6270b8e5-7fb2-46e3-b821-832d8db64564 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:50.169877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-6270b8e5-7fb2-46e3-b821-832d8db64564 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:50.172909 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1391/2773] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:31:49 2022] DELETE /identity/v3/projects/3dc96e1d7ef349388cc282b24a067a4d => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:50.182126 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1badd43-19c3-41e6-a58d-e7dac69cbf46 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:50.183272 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1badd43-19c3-41e6-a58d-e7dac69cbf46 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:50.183853 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1badd43-19c3-41e6-a58d-e7dac69cbf46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:50.192325 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-21a3e9c2-7af5-42bd-91ab-9e7bf1262ec5 None None] MFA Rules not processed for user `fcc680110f4840e78e78af03f039c2c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:50.194556 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-21a3e9c2-7af5-42bd-91ab-9e7bf1262ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:50.229085 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-d1badd43-19c3-41e6-a58d-e7dac69cbf46 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:50.231897 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d1badd43-19c3-41e6-a58d-e7dac69cbf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:50.273414 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:50.320340 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1383/2774] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:50 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:31:50.347873 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3e9c2-7af5-42bd-91ab-9e7bf1262ec5 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:50.349382 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-21a3e9c2-7af5-42bd-91ab-9e7bf1262ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:50.370231 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1392/2775] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:31:50.378274 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be905228-6b53-42ee-ad62-dde59f98f5d5 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:50.378927 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be905228-6b53-42ee-ad62-dde59f98f5d5 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:50.379463 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be905228-6b53-42ee-ad62-dde59f98f5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:50.423540 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-be905228-6b53-42ee-ad62-dde59f98f5d5 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:50.426009 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-be905228-6b53-42ee-ad62-dde59f98f5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:50.449324 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1393/2776] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:31:50.450431 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be905228-6b53-42ee-ad62-dde59f98f5d5 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:50.464330 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be905228-6b53-42ee-ad62-dde59f98f5d5 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:50.473009 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3e9c2-7af5-42bd-91ab-9e7bf1262ec5 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:50.476129 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539037e-52d8-42a3-9edd-e097aabf498f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:50.476965 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539037e-52d8-42a3-9edd-e097aabf498f admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:50.477328 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539037e-52d8-42a3-9edd-e097aabf498f admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:50.477750 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539037e-52d8-42a3-9edd-e097aabf498f admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:50.478680 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f539037e-52d8-42a3-9edd-e097aabf498f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:31:50.480882 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f539037e-52d8-42a3-9edd-e097aabf498f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:50.483375 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f539037e-52d8-42a3-9edd-e097aabf498f admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:50.483886 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97226089-04c9-43ad-9b96-28e4058fb164 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:50.484625 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97226089-04c9-43ad-9b96-28e4058fb164 service nova] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:50.485328 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97226089-04c9-43ad-9b96-28e4058fb164 service nova] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:50.485792 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97226089-04c9-43ad-9b96-28e4058fb164 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:50.487979 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-97226089-04c9-43ad-9b96-28e4058fb164 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:50.508320 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1394/2777] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:31:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:31:50.513292 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539037e-52d8-42a3-9edd-e097aabf498f admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:50.528529 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539037e-52d8-42a3-9edd-e097aabf498f admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:50.537298 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af5450-30e6-4200-9125-6bbac30cfafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:50.537951 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af5450-30e6-4200-9125-6bbac30cfafa admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:50.538224 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af5450-30e6-4200-9125-6bbac30cfafa admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:50.538620 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af5450-30e6-4200-9125-6bbac30cfafa admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:50.539370 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af5450-30e6-4200-9125-6bbac30cfafa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:50.541371 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af5450-30e6-4200-9125-6bbac30cfafa admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:50.594431 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1395/2778] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:31:50 2022] POST /identity/v3/projects => generated 361 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:31:50.596616 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af5450-30e6-4200-9125-6bbac30cfafa admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:50.615652 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97226089-04c9-43ad-9b96-28e4058fb164 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:50.618409 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97226089-04c9-43ad-9b96-28e4058fb164 service nova] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:50.632675 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1384/2779] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:31:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:31:50.644660 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97226089-04c9-43ad-9b96-28e4058fb164 service nova] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:50.647465 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-97226089-04c9-43ad-9b96-28e4058fb164 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:50.700616 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97226089-04c9-43ad-9b96-28e4058fb164 service nova] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:50.783030 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af5450-30e6-4200-9125-6bbac30cfafa admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:50.809691 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aba008-019c-4d4c-aac6-2a6697f61397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:50.811186 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aba008-019c-4d4c-aac6-2a6697f61397 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:50.811852 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aba008-019c-4d4c-aac6-2a6697f61397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:50.812548 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aba008-019c-4d4c-aac6-2a6697f61397 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:50.814675 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aba008-019c-4d4c-aac6-2a6697f61397 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:50.819062 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aba008-019c-4d4c-aac6-2a6697f61397 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:50.860306 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1396/2780] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:31:50 2022] POST /identity/v3/users => generated 281 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:31:50.865494 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aba008-019c-4d4c-aac6-2a6697f61397 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:50.891009 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aba008-019c-4d4c-aac6-2a6697f61397 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:50.891883 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3db847-4cd9-42aa-ac29-aeb05443c0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:50.892469 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3db847-4cd9-42aa-ac29-aeb05443c0b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:50.893429 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3db847-4cd9-42aa-ac29-aeb05443c0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:50.893678 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3db847-4cd9-42aa-ac29-aeb05443c0b7 admin admin] PATH_INFO: `/v3/projects/c2edf97087694f15a3dd8d9fd784e567` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:50.895934 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3db847-4cd9-42aa-ac29-aeb05443c0b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2edf97087694f15a3dd8d9fd784e567)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:50.899097 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3db847-4cd9-42aa-ac29-aeb05443c0b7 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:50.904615 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd29f61-575d-4860-b9b5-28dac5c058ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:50.906264 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd29f61-575d-4860-b9b5-28dac5c058ca admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:50.906264 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd29f61-575d-4860-b9b5-28dac5c058ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:50.906264 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd29f61-575d-4860-b9b5-28dac5c058ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:50.906858 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd29f61-575d-4860-b9b5-28dac5c058ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:50.908933 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd29f61-575d-4860-b9b5-28dac5c058ca admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:50.933492 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1397/2781] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:31:50.937513 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd29f61-575d-4860-b9b5-28dac5c058ca admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:50.952145 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:50.964984 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd29f61-575d-4860-b9b5-28dac5c058ca admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:50.977625 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb6cec-20f1-4e47-9cd6-462024b5e1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:50.978263 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb6cec-20f1-4e47-9cd6-462024b5e1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:50.978560 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb6cec-20f1-4e47-9cd6-462024b5e1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:50.982156 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb6cec-20f1-4e47-9cd6-462024b5e1a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:50.982518 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb6cec-20f1-4e47-9cd6-462024b5e1a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:50.983071 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:50.984002 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb6cec-20f1-4e47-9cd6-462024b5e1a8 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:51.013814 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1398/2782] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:31:51.015359 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb6cec-20f1-4e47-9cd6-462024b5e1a8 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:51.033145 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb6cec-20f1-4e47-9cd6-462024b5e1a8 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:51.041572 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-3c3db847-4cd9-42aa-ac29-aeb05443c0b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2edf97087694f15a3dd8d9fd784e567', 'request_id': 'req-3c3db847-4cd9-42aa-ac29-aeb05443c0b7'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:51.075535 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-3c3db847-4cd9-42aa-ac29-aeb05443c0b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2edf97087694f15a3dd8d9fd784e567', 'request_id': 'req-3c3db847-4cd9-42aa-ac29-aeb05443c0b7'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:51.092203 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-3c3db847-4cd9-42aa-ac29-aeb05443c0b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2edf97087694f15a3dd8d9fd784e567', 'request_id': 'req-3c3db847-4cd9-42aa-ac29-aeb05443c0b7'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:51.109849 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-3c3db847-4cd9-42aa-ac29-aeb05443c0b7 admin admin] The token cache is being invalidate because project c2edf97087694f15a3dd8d9fd784e567 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:31:51.110151 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-3c3db847-4cd9-42aa-ac29-aeb05443c0b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:51.110970 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-3c3db847-4cd9-42aa-ac29-aeb05443c0b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:51.113194 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1385/2783] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:31:50 2022] DELETE /identity/v3/projects/c2edf97087694f15a3dd8d9fd784e567 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:51.119656 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3db847-4cd9-42aa-ac29-aeb05443c0b7 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:51.123607 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-3c3db847-4cd9-42aa-ac29-aeb05443c0b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:51.160329 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8ab75-4a01-4f44-bea8-76485bc1978d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:51.161305 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8ab75-4a01-4f44-bea8-76485bc1978d admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:51.161792 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8ab75-4a01-4f44-bea8-76485bc1978d admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:51.162245 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8ab75-4a01-4f44-bea8-76485bc1978d admin admin] PATH_INFO: `/v3/projects/1a25a0f308ad48c898b6fb9fdaae8389/users/ce72765a834940d9a7ac43550037c1d4/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:51.192573 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8ab75-4a01-4f44-bea8-76485bc1978d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a25a0f308ad48c898b6fb9fdaae8389, user_id=ce72765a834940d9a7ac43550037c1d4, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:51.206498 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8ab75-4a01-4f44-bea8-76485bc1978d admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:51.238309 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1399/2784] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:31:51 2022] PUT /identity/v3/projects/1a25a0f308ad48c898b6fb9fdaae8389/users/ce72765a834940d9a7ac43550037c1d4/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:51.259942 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446f93c-5ffc-4a11-b4d9-1d5d64acab7a None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:51.260603 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446f93c-5ffc-4a11-b4d9-1d5d64acab7a None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:51.261487 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446f93c-5ffc-4a11-b4d9-1d5d64acab7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:51.279017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3db847-4cd9-42aa-ac29-aeb05443c0b7 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:51.336944 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-c446f93c-5ffc-4a11-b4d9-1d5d64acab7a None None] MFA Rules not processed for user `ce72765a834940d9a7ac43550037c1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:51.346651 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-c446f93c-5ffc-4a11-b4d9-1d5d64acab7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:51.377587 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e62e57-aaa4-46db-acd9-8e295eb5b50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:51.378664 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e62e57-aaa4-46db-acd9-8e295eb5b50b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:51.378966 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e62e57-aaa4-46db-acd9-8e295eb5b50b admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:51.379247 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e62e57-aaa4-46db-acd9-8e295eb5b50b admin admin] PATH_INFO: `/v3/users/53ac14aa523e40c09b1c144903552593` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:51.381281 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e62e57-aaa4-46db-acd9-8e295eb5b50b admin admin] RBAC: Authorizing `identity:delete_user(user_id=53ac14aa523e40c09b1c144903552593)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:51.384080 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e62e57-aaa4-46db-acd9-8e295eb5b50b admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:51.493866 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1400/2785] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:31:51.500808 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-27e62e57-aaa4-46db-acd9-8e295eb5b50b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53ac14aa523e40c09b1c144903552593'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:51.539706 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:51.554289 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-27e62e57-aaa4-46db-acd9-8e295eb5b50b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53ac14aa523e40c09b1c144903552593'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:51.574313 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446f93c-5ffc-4a11-b4d9-1d5d64acab7a None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:51.576535 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-c446f93c-5ffc-4a11-b4d9-1d5d64acab7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:51.579890 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-27e62e57-aaa4-46db-acd9-8e295eb5b50b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53ac14aa523e40c09b1c144903552593'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:51.582420 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-27e62e57-aaa4-46db-acd9-8e295eb5b50b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53ac14aa523e40c09b1c144903552593'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:51.597920 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-27e62e57-aaa4-46db-acd9-8e295eb5b50b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53ac14aa523e40c09b1c144903552593'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:51.620014 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1386/2786] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:31:51 2022] DELETE /identity/v3/users/53ac14aa523e40c09b1c144903552593 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:51.725547 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446f93c-5ffc-4a11-b4d9-1d5d64acab7a None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:51.777113 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:51.859636 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76fe84-b59f-479e-8cb5-9a78acb16c83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:51.861250 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76fe84-b59f-479e-8cb5-9a78acb16c83 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:51.861443 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76fe84-b59f-479e-8cb5-9a78acb16c83 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:51.861828 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76fe84-b59f-479e-8cb5-9a78acb16c83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:51.866099 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ba76fe84-b59f-479e-8cb5-9a78acb16c83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:51.983662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba76fe84-b59f-479e-8cb5-9a78acb16c83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:51.985504 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba76fe84-b59f-479e-8cb5-9a78acb16c83 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:52.003598 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1401/2787] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:31:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:31:52.031171 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e62e57-aaa4-46db-acd9-8e295eb5b50b admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:52.034889 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-27e62e57-aaa4-46db-acd9-8e295eb5b50b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:52.208672 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76fe84-b59f-479e-8cb5-9a78acb16c83 service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:52.210317 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ba76fe84-b59f-479e-8cb5-9a78acb16c83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:52.218391 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e62e57-aaa4-46db-acd9-8e295eb5b50b admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:52.229417 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f48fc-f484-4829-b275-ae741a58590f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:52.233500 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f48fc-f484-4829-b275-ae741a58590f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:52.234836 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f48fc-f484-4829-b275-ae741a58590f admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:52.235710 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f48fc-f484-4829-b275-ae741a58590f admin admin] PATH_INFO: `/v3/users/ce72765a834940d9a7ac43550037c1d4` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:52.238997 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f48fc-f484-4829-b275-ae741a58590f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce72765a834940d9a7ac43550037c1d4)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:52.246266 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76fe84-b59f-479e-8cb5-9a78acb16c83 service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:52.250806 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f48fc-f484-4829-b275-ae741a58590f admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:52.256190 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79938b-43e7-451b-b0f5-b1413e5258ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:52.257635 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79938b-43e7-451b-b0f5-b1413e5258ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:52.258299 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79938b-43e7-451b-b0f5-b1413e5258ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:52.258916 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79938b-43e7-451b-b0f5-b1413e5258ff admin admin] PATH_INFO: `/v3/projects/1f213eb68c874fa5a07568665c0044ca` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:52.261894 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79938b-43e7-451b-b0f5-b1413e5258ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f213eb68c874fa5a07568665c0044ca)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:52.267095 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79938b-43e7-451b-b0f5-b1413e5258ff admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:52.374273 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-720f48fc-f484-4829-b275-ae741a58590f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce72765a834940d9a7ac43550037c1d4'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:52.393755 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-7a79938b-43e7-451b-b0f5-b1413e5258ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f213eb68c874fa5a07568665c0044ca', 'request_id': 'req-7a79938b-43e7-451b-b0f5-b1413e5258ff'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:52.395929 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-720f48fc-f484-4829-b275-ae741a58590f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce72765a834940d9a7ac43550037c1d4'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:52.408736 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-720f48fc-f484-4829-b275-ae741a58590f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce72765a834940d9a7ac43550037c1d4'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:52.410318 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-720f48fc-f484-4829-b275-ae741a58590f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce72765a834940d9a7ac43550037c1d4'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:52.420693 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-7a79938b-43e7-451b-b0f5-b1413e5258ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f213eb68c874fa5a07568665c0044ca', 'request_id': 'req-7a79938b-43e7-451b-b0f5-b1413e5258ff'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:52.423431 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-720f48fc-f484-4829-b275-ae741a58590f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce72765a834940d9a7ac43550037c1d4'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:52.432299 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1387/2788] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:31:52 2022] DELETE /identity/v3/users/ce72765a834940d9a7ac43550037c1d4 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:52.439223 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6014f-925b-4fc5-9495-28eed02f39de None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:52.439719 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6014f-925b-4fc5-9495-28eed02f39de None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:52.441018 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6014f-925b-4fc5-9495-28eed02f39de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:52.442318 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-7a79938b-43e7-451b-b0f5-b1413e5258ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f213eb68c874fa5a07568665c0044ca', 'request_id': 'req-7a79938b-43e7-451b-b0f5-b1413e5258ff'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:52.472026 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-0ac6014f-925b-4fc5-9495-28eed02f39de None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:52.472749 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-7a79938b-43e7-451b-b0f5-b1413e5258ff admin admin] The token cache is being invalidate because project 1f213eb68c874fa5a07568665c0044ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:31:52.473549 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-7a79938b-43e7-451b-b0f5-b1413e5258ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:52.473799 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-0ac6014f-925b-4fc5-9495-28eed02f39de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:52.475369 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-7a79938b-43e7-451b-b0f5-b1413e5258ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:52.480379 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1402/2789] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:31:52 2022] DELETE /identity/v3/projects/1f213eb68c874fa5a07568665c0044ca => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:52.489151 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe11b76-6e4f-40a5-9e5b-bb2c355ef162 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:52.489896 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe11b76-6e4f-40a5-9e5b-bb2c355ef162 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:52.490485 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe11b76-6e4f-40a5-9e5b-bb2c355ef162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:52.531490 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-0fe11b76-6e4f-40a5-9e5b-bb2c355ef162 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:52.533892 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-0fe11b76-6e4f-40a5-9e5b-bb2c355ef162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:52.594799 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:52.626791 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1388/2790] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:31:52.637760 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6014f-925b-4fc5-9495-28eed02f39de None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:52.642704 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-0ac6014f-925b-4fc5-9495-28eed02f39de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:52.678451 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:52.711094 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1403/2791] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:31:52.711094 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c66e1f-5939-4743-b0df-ba31939b9b9d None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:52.711094 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c66e1f-5939-4743-b0df-ba31939b9b9d None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:52.711094 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c66e1f-5939-4743-b0df-ba31939b9b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:52.753078 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-e1c66e1f-5939-4743-b0df-ba31939b9b9d None None] MFA Rules not processed for user `b998c363b3704e9aa4564f39332159d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:52.754764 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-e1c66e1f-5939-4743-b0df-ba31939b9b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:52.763914 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6014f-925b-4fc5-9495-28eed02f39de None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:52.771187 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80bccb-bb41-41a2-91ab-8f37743b509e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:52.772533 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80bccb-bb41-41a2-91ab-8f37743b509e service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:52.773073 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80bccb-bb41-41a2-91ab-8f37743b509e service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:52.773516 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80bccb-bb41-41a2-91ab-8f37743b509e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:52.791309 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80bccb-bb41-41a2-91ab-8f37743b509e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:52.793755 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80bccb-bb41-41a2-91ab-8f37743b509e service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:52.807047 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1389/2792] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:31:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:31:52.809305 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe457640-ffd6-4527-8643-4c6c63512799 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:52.809749 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe457640-ffd6-4527-8643-4c6c63512799 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:52.810041 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe457640-ffd6-4527-8643-4c6c63512799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:52.836186 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-fe457640-ffd6-4527-8643-4c6c63512799 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:52.837573 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-fe457640-ffd6-4527-8643-4c6c63512799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:52.847853 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1390/2793] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:31:52.854717 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe457640-ffd6-4527-8643-4c6c63512799 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:52.866427 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1404/2794] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:31:52.883038 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe457640-ffd6-4527-8643-4c6c63512799 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:52.895663 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c89bf-ae60-408d-a9e7-a333f3f73bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:52.897897 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c89bf-ae60-408d-a9e7-a333f3f73bab admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:52.898476 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c89bf-ae60-408d-a9e7-a333f3f73bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:52.899287 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c89bf-ae60-408d-a9e7-a333f3f73bab admin admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:52.900574 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c89bf-ae60-408d-a9e7-a333f3f73bab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:31:52.901406 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c89bf-ae60-408d-a9e7-a333f3f73bab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:52.905481 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c89bf-ae60-408d-a9e7-a333f3f73bab admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:52.945825 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1391/2795] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:31:52.950550 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c66e1f-5939-4743-b0df-ba31939b9b9d None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:52.971326 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c66e1f-5939-4743-b0df-ba31939b9b9d None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:52.981547 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bfdb4-a05d-4d26-bd1b-959997e31018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:52.983163 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bfdb4-a05d-4d26-bd1b-959997e31018 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:52.984237 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bfdb4-a05d-4d26-bd1b-959997e31018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:52.985104 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bfdb4-a05d-4d26-bd1b-959997e31018 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:52.986854 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556bfdb4-a05d-4d26-bd1b-959997e31018 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:52.992781 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556bfdb4-a05d-4d26-bd1b-959997e31018 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:53.062991 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1405/2796] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:31:52 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:31:53.066240 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c89bf-ae60-408d-a9e7-a333f3f73bab admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:53.084580 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c89bf-ae60-408d-a9e7-a333f3f73bab admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:53.209572 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f20454-df54-4917-8e6b-e603cd1fc1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:53.212104 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f20454-df54-4917-8e6b-e603cd1fc1cd admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:53.212908 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f20454-df54-4917-8e6b-e603cd1fc1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:53.213273 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f20454-df54-4917-8e6b-e603cd1fc1cd admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:53.214723 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f20454-df54-4917-8e6b-e603cd1fc1cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:53.219225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f20454-df54-4917-8e6b-e603cd1fc1cd admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:53.264205 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1392/2797] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:31:53 2022] POST /identity/v3/users => generated 287 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:31:53.269139 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bfdb4-a05d-4d26-bd1b-959997e31018 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:53.307053 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bfdb4-a05d-4d26-bd1b-959997e31018 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:53.321339 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a435354-6050-4920-923d-66a866fb6959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:53.322524 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a435354-6050-4920-923d-66a866fb6959 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:53.322828 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a435354-6050-4920-923d-66a866fb6959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:53.323668 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a435354-6050-4920-923d-66a866fb6959 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:53.324376 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a435354-6050-4920-923d-66a866fb6959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:53.326199 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a435354-6050-4920-923d-66a866fb6959 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:53.342147 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f20454-df54-4917-8e6b-e603cd1fc1cd admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:53.344584 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-32f20454-df54-4917-8e6b-e603cd1fc1cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:53.360091 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1406/2798] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:31:53.361432 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a435354-6050-4920-923d-66a866fb6959 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:53.363824 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f20454-df54-4917-8e6b-e603cd1fc1cd admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:53.390351 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e5bbf-f639-44b7-842d-194c9e96231c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:53.391701 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a435354-6050-4920-923d-66a866fb6959 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:53.392230 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e5bbf-f639-44b7-842d-194c9e96231c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:53.393276 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e5bbf-f639-44b7-842d-194c9e96231c admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:53.394254 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e5bbf-f639-44b7-842d-194c9e96231c admin admin] PATH_INFO: `/v3/projects/1a25a0f308ad48c898b6fb9fdaae8389` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:53.398334 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cfb689-08cf-4c46-b012-47e843337341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:53.398736 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e5bbf-f639-44b7-842d-194c9e96231c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a25a0f308ad48c898b6fb9fdaae8389)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:53.399312 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfb689-08cf-4c46-b012-47e843337341 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:53.399597 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfb689-08cf-4c46-b012-47e843337341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:53.399873 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfb689-08cf-4c46-b012-47e843337341 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:53.400540 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cfb689-08cf-4c46-b012-47e843337341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:53.402826 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cfb689-08cf-4c46-b012-47e843337341 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:53.404925 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e5bbf-f639-44b7-842d-194c9e96231c admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:53.429719 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1407/2799] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:31:53.431004 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cfb689-08cf-4c46-b012-47e843337341 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:53.466796 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cfb689-08cf-4c46-b012-47e843337341 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:53.477850 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ded3e2-f42b-4ce8-bae8-20e826837afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:53.480047 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ded3e2-f42b-4ce8-bae8-20e826837afd admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:53.480825 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ded3e2-f42b-4ce8-bae8-20e826837afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:53.483634 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ded3e2-f42b-4ce8-bae8-20e826837afd admin admin] PATH_INFO: `/v3/projects/7ff8526c0d654b659c93c45eda50dae8/users/372eb491b04f4768bb8a3639b7b3f38d/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:53.518086 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ded3e2-f42b-4ce8-bae8-20e826837afd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff8526c0d654b659c93c45eda50dae8, user_id=372eb491b04f4768bb8a3639b7b3f38d, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:53.525595 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ded3e2-f42b-4ce8-bae8-20e826837afd admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:53.541013 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-214e5bbf-f639-44b7-842d-194c9e96231c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a25a0f308ad48c898b6fb9fdaae8389', 'request_id': 'req-214e5bbf-f639-44b7-842d-194c9e96231c'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:53.559802 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-214e5bbf-f639-44b7-842d-194c9e96231c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a25a0f308ad48c898b6fb9fdaae8389', 'request_id': 'req-214e5bbf-f639-44b7-842d-194c9e96231c'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:53.577214 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1408/2800] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:31:53 2022] PUT /identity/v3/projects/7ff8526c0d654b659c93c45eda50dae8/users/372eb491b04f4768bb8a3639b7b3f38d/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:31:53.581457 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e87d02-b1d4-4b89-9d43-41000457973c None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:53.581997 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e87d02-b1d4-4b89-9d43-41000457973c None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:53.582513 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e87d02-b1d4-4b89-9d43-41000457973c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:53.595393 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-214e5bbf-f639-44b7-842d-194c9e96231c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a25a0f308ad48c898b6fb9fdaae8389', 'request_id': 'req-214e5bbf-f639-44b7-842d-194c9e96231c'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:53.623723 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:53.633388 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-05e87d02-b1d4-4b89-9d43-41000457973c None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:53.636693 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-05e87d02-b1d4-4b89-9d43-41000457973c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:53.656773 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-214e5bbf-f639-44b7-842d-194c9e96231c admin admin] The token cache is being invalidate because project 1a25a0f308ad48c898b6fb9fdaae8389 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:31:53.657127 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-214e5bbf-f639-44b7-842d-194c9e96231c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:53.658892 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-214e5bbf-f639-44b7-842d-194c9e96231c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:31:53.661348 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1393/2801] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:31:53 2022] DELETE /identity/v3/projects/1a25a0f308ad48c898b6fb9fdaae8389 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:31:53.668888 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175155b-4ef7-4fed-a1cb-5ac3ddafda15 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:53.669208 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175155b-4ef7-4fed-a1cb-5ac3ddafda15 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:53.669492 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175155b-4ef7-4fed-a1cb-5ac3ddafda15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:53.726456 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-3175155b-4ef7-4fed-a1cb-5ac3ddafda15 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:53.726456 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-3175155b-4ef7-4fed-a1cb-5ac3ddafda15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:53.827302 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1409/2802] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:31:53.834463 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1394/2803] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:31:53.841432 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e87d02-b1d4-4b89-9d43-41000457973c None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:53.843052 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c39e88-03d2-4c26-bbe9-602b908f2183 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:53.843420 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c39e88-03d2-4c26-bbe9-602b908f2183 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:53.843772 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c39e88-03d2-4c26-bbe9-602b908f2183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:53.843945 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-05e87d02-b1d4-4b89-9d43-41000457973c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:53.876498 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-35c39e88-03d2-4c26-bbe9-602b908f2183 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:53.878908 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-35c39e88-03d2-4c26-bbe9-602b908f2183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:53.894007 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1395/2804] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:31:53.899939 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c39e88-03d2-4c26-bbe9-602b908f2183 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:53.918387 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c39e88-03d2-4c26-bbe9-602b908f2183 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:53.927299 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76766168-24ef-4224-807f-a67d1cdcb231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:53.928657 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76766168-24ef-4224-807f-a67d1cdcb231 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:53.929220 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76766168-24ef-4224-807f-a67d1cdcb231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:53.929708 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76766168-24ef-4224-807f-a67d1cdcb231 admin admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:53.931211 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76766168-24ef-4224-807f-a67d1cdcb231 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:31:53.931838 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76766168-24ef-4224-807f-a67d1cdcb231 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:53.935725 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76766168-24ef-4224-807f-a67d1cdcb231 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:53.945848 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:53.962623 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1396/2805] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:31:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:31:53.964629 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76766168-24ef-4224-807f-a67d1cdcb231 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:53.987671 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76766168-24ef-4224-807f-a67d1cdcb231 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:53.995816 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e87d02-b1d4-4b89-9d43-41000457973c None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:53.998945 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805bab06-4afc-402e-8163-fbe2b52c711b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:54.000477 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805bab06-4afc-402e-8163-fbe2b52c711b admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:54.001764 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805bab06-4afc-402e-8163-fbe2b52c711b admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:54.001986 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805bab06-4afc-402e-8163-fbe2b52c711b admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:54.003453 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805bab06-4afc-402e-8163-fbe2b52c711b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:54.007117 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b422ce-90dd-4988-95e3-07f3cbf77623 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:54.007527 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805bab06-4afc-402e-8163-fbe2b52c711b admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:54.008462 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b422ce-90dd-4988-95e3-07f3cbf77623 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:54.009049 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b422ce-90dd-4988-95e3-07f3cbf77623 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:54.009677 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b422ce-90dd-4988-95e3-07f3cbf77623 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:54.030959 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b422ce-90dd-4988-95e3-07f3cbf77623 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:54.033873 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b422ce-90dd-4988-95e3-07f3cbf77623 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:54.055266 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1410/2806] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:31:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:31:54.070821 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1397/2807] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:31:53 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:31:54.075892 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b422ce-90dd-4988-95e3-07f3cbf77623 service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:54.097554 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b422ce-90dd-4988-95e3-07f3cbf77623 service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:54.266770 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ef239-1b98-47d5-8210-2dcd9c3a5df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:54.267919 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ef239-1b98-47d5-8210-2dcd9c3a5df6 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:54.268426 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ef239-1b98-47d5-8210-2dcd9c3a5df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:54.268917 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ef239-1b98-47d5-8210-2dcd9c3a5df6 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:54.270279 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964ef239-1b98-47d5-8210-2dcd9c3a5df6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:54.275644 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964ef239-1b98-47d5-8210-2dcd9c3a5df6 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:54.329939 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1411/2808] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:31:54 2022] POST /identity/v3/users => generated 288 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:31:54.336291 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805bab06-4afc-402e-8163-fbe2b52c711b admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:54.364819 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805bab06-4afc-402e-8163-fbe2b52c711b admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:54.383613 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e7334-da1a-45e7-a4ac-a66f1127a98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:54.384844 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e7334-da1a-45e7-a4ac-a66f1127a98c admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:54.385408 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e7334-da1a-45e7-a4ac-a66f1127a98c admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:54.385954 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e7334-da1a-45e7-a4ac-a66f1127a98c admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:54.387233 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e7334-da1a-45e7-a4ac-a66f1127a98c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:54.390846 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e7334-da1a-45e7-a4ac-a66f1127a98c admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:54.410418 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1398/2809] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:31:54.415163 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ef239-1b98-47d5-8210-2dcd9c3a5df6 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:54.430590 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ef239-1b98-47d5-8210-2dcd9c3a5df6 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:54.437285 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7831a4-3a92-4779-986b-5b29fc57e340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:54.438808 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7831a4-3a92-4779-986b-5b29fc57e340 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:54.439350 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7831a4-3a92-4779-986b-5b29fc57e340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:54.439760 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7831a4-3a92-4779-986b-5b29fc57e340 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:54.440557 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7831a4-3a92-4779-986b-5b29fc57e340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:54.442462 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7831a4-3a92-4779-986b-5b29fc57e340 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:54.459097 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1412/2810] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:31:54.464503 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e7334-da1a-45e7-a4ac-a66f1127a98c admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:54.482746 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e7334-da1a-45e7-a4ac-a66f1127a98c admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:54.492288 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dd8899-f811-458a-b7ec-d90728f6a08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:54.494610 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd8899-f811-458a-b7ec-d90728f6a08b admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:54.495196 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd8899-f811-458a-b7ec-d90728f6a08b admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:54.495687 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd8899-f811-458a-b7ec-d90728f6a08b admin admin] PATH_INFO: `/v3/projects/0df21989661f47c6b1732769327d8541/users/ea25cb2d2d58435d8e5b4cc1858282e7/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:54.522943 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dd8899-f811-458a-b7ec-d90728f6a08b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0df21989661f47c6b1732769327d8541, user_id=ea25cb2d2d58435d8e5b4cc1858282e7, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:54.529716 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dd8899-f811-458a-b7ec-d90728f6a08b admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:54.569637 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1399/2811] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:31:54 2022] PUT /identity/v3/projects/0df21989661f47c6b1732769327d8541/users/ea25cb2d2d58435d8e5b4cc1858282e7/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:31:54.585527 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0fc1e-6011-4809-9f3c-9787a21b8330 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:54.585974 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0fc1e-6011-4809-9f3c-9787a21b8330 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:54.586451 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0fc1e-6011-4809-9f3c-9787a21b8330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:54.657214 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-21e0fc1e-6011-4809-9f3c-9787a21b8330 None None] MFA Rules not processed for user `ea25cb2d2d58435d8e5b4cc1858282e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:54.657214 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-21e0fc1e-6011-4809-9f3c-9787a21b8330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:54.907313 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1413/2812] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:31:54.924451 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dd8899-f811-458a-b7ec-d90728f6a08b admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:54.933548 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-e9dd8899-f811-458a-b7ec-d90728f6a08b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:55.113980 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dd8899-f811-458a-b7ec-d90728f6a08b admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:55.120626 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bba378-083f-4a99-9373-1c724a47a17d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:55.121587 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bba378-083f-4a99-9373-1c724a47a17d service cinder] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:55.122107 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bba378-083f-4a99-9373-1c724a47a17d service cinder] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:55.122703 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bba378-083f-4a99-9373-1c724a47a17d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:55.144341 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bba378-083f-4a99-9373-1c724a47a17d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:55.146982 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bba378-083f-4a99-9373-1c724a47a17d service cinder] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:55.163758 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1400/2813] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:31:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:31:55.419773 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c21027-771c-4a2d-9925-73b436c79ad9 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:55.420668 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c21027-771c-4a2d-9925-73b436c79ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:55.420951 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c21027-771c-4a2d-9925-73b436c79ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:55.474975 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-34c21027-771c-4a2d-9925-73b436c79ad9 None None] MFA Rules not processed for user `372eb491b04f4768bb8a3639b7b3f38d`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:55.482536 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-34c21027-771c-4a2d-9925-73b436c79ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:55.590889 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:55.650436 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1414/2814] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:31:55.668080 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bba378-083f-4a99-9373-1c724a47a17d service cinder] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:55.669694 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-d6bba378-083f-4a99-9373-1c724a47a17d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:55.692140 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bba378-083f-4a99-9373-1c724a47a17d service cinder] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:55.697066 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216b70e-219f-453a-b987-7b197bca6dbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:55.697707 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216b70e-219f-453a-b987-7b197bca6dbc service cinder] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:55.698615 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216b70e-219f-453a-b987-7b197bca6dbc service cinder] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:55.698894 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216b70e-219f-453a-b987-7b197bca6dbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:55.711073 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216b70e-219f-453a-b987-7b197bca6dbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:55.713109 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216b70e-219f-453a-b987-7b197bca6dbc service cinder] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:55.733023 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1401/2815] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:31:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:31:57.409456 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e323e9-5fbd-4209-922a-4c378906ce05 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:57.410196 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e323e9-5fbd-4209-922a-4c378906ce05 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:57.410196 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e323e9-5fbd-4209-922a-4c378906ce05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:57.431913 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-e5e323e9-5fbd-4209-922a-4c378906ce05 None None] MFA Rules not processed for user `372eb491b04f4768bb8a3639b7b3f38d`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:31:57.433817 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-e5e323e9-5fbd-4209-922a-4c378906ce05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:57.441266 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1415/2816] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:31:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:31:57.485253 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216b70e-219f-453a-b987-7b197bca6dbc service cinder] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:57.487641 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-5216b70e-219f-453a-b987-7b197bca6dbc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:57.506059 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:31:57.598618 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216b70e-219f-453a-b987-7b197bca6dbc service cinder] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:57.604861 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8da437-56c8-4eb8-8bba-fcd93c865ccc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c513a6c91a0240de87c7b51b07617827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:57.605068 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8da437-56c8-4eb8-8bba-fcd93c865ccc service glance] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:57.605320 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8da437-56c8-4eb8-8bba-fcd93c865ccc service glance] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:57.605600 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8da437-56c8-4eb8-8bba-fcd93c865ccc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:57.607632 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-cf8da437-56c8-4eb8-8bba-fcd93c865ccc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:57.719485 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8da437-56c8-4eb8-8bba-fcd93c865ccc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:57.722085 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8da437-56c8-4eb8-8bba-fcd93c865ccc service glance] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:57.744100 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1402/2817] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:31:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:31:58.533456 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e323e9-5fbd-4209-922a-4c378906ce05 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:31:58.657359 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e323e9-5fbd-4209-922a-4c378906ce05 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:31:58.661314 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec2ad4-09bd-43ae-b903-e534d0bc8575 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:31:58.662016 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec2ad4-09bd-43ae-b903-e534d0bc8575 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:31:58.662385 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec2ad4-09bd-43ae-b903-e534d0bc8575 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:31:58.662756 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec2ad4-09bd-43ae-b903-e534d0bc8575 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:31:58.664925 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-0dec2ad4-09bd-43ae-b903-e534d0bc8575 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:31:58.680988 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec2ad4-09bd-43ae-b903-e534d0bc8575 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:31:58.683071 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec2ad4-09bd-43ae-b903-e534d0bc8575 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:31:58.703913 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1416/2818] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:31:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:32:07.734426 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=50 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:32:08.696242 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=39 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:32:11.605835 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8da437-56c8-4eb8-8bba-fcd93c865ccc service glance] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:32:11.722655 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8da437-56c8-4eb8-8bba-fcd93c865ccc service glance] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:32:11.730005 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237789ac-2df3-4491-b9a0-e316a31e1af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:32:11.730813 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237789ac-2df3-4491-b9a0-e316a31e1af9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:32:11.731139 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237789ac-2df3-4491-b9a0-e316a31e1af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:32:11.731456 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237789ac-2df3-4491-b9a0-e316a31e1af9 admin admin] PATH_INFO: `/v3/users/ea25cb2d2d58435d8e5b4cc1858282e7` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:32:11.733225 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237789ac-2df3-4491-b9a0-e316a31e1af9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea25cb2d2d58435d8e5b4cc1858282e7)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:32:11.735309 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237789ac-2df3-4491-b9a0-e316a31e1af9 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:32:11.793255 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-237789ac-2df3-4491-b9a0-e316a31e1af9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea25cb2d2d58435d8e5b4cc1858282e7'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:32:11.807676 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-237789ac-2df3-4491-b9a0-e316a31e1af9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea25cb2d2d58435d8e5b4cc1858282e7'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:32:11.817269 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-237789ac-2df3-4491-b9a0-e316a31e1af9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea25cb2d2d58435d8e5b4cc1858282e7'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:32:11.817990 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-237789ac-2df3-4491-b9a0-e316a31e1af9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea25cb2d2d58435d8e5b4cc1858282e7'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:32:11.827888 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-237789ac-2df3-4491-b9a0-e316a31e1af9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea25cb2d2d58435d8e5b4cc1858282e7'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:32:11.835019 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1403/2819] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:32:11 2022] DELETE /identity/v3/users/ea25cb2d2d58435d8e5b4cc1858282e7 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:32:11.840560 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e91a4-7eb2-43c5-96ed-364c2ab66e4c None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:32:11.841468 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e91a4-7eb2-43c5-96ed-364c2ab66e4c None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:32:11.841657 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e91a4-7eb2-43c5-96ed-364c2ab66e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:32:11.863517 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-f18e91a4-7eb2-43c5-96ed-364c2ab66e4c None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:32:11.864773 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f18e91a4-7eb2-43c5-96ed-364c2ab66e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:32:11.936230 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1417/2820] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:32:11.948021 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237789ac-2df3-4491-b9a0-e316a31e1af9 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:32:11.950204 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-237789ac-2df3-4491-b9a0-e316a31e1af9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:32:12.024031 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237789ac-2df3-4491-b9a0-e316a31e1af9 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:32:12.027997 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d076e-11dd-4d13-8169-05e8e3c279ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:32:12.028681 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d076e-11dd-4d13-8169-05e8e3c279ee service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:32:12.029017 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d076e-11dd-4d13-8169-05e8e3c279ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:32:12.029472 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d076e-11dd-4d13-8169-05e8e3c279ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:32:12.041588 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d076e-11dd-4d13-8169-05e8e3c279ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:32:12.043417 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d076e-11dd-4d13-8169-05e8e3c279ee service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:32:12.055336 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1404/2821] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:32:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:32:12.579334 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e91a4-7eb2-43c5-96ed-364c2ab66e4c None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:32:12.582533 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f18e91a4-7eb2-43c5-96ed-364c2ab66e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:32:12.600518 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e91a4-7eb2-43c5-96ed-364c2ab66e4c None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:32:12.616701 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe865a-0a23-43a0-a5ca-9b616b5374c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:32:12.618059 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe865a-0a23-43a0-a5ca-9b616b5374c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:32:12.619048 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe865a-0a23-43a0-a5ca-9b616b5374c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:32:12.620650 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe865a-0a23-43a0-a5ca-9b616b5374c9 admin admin] PATH_INFO: `/v3/projects/0df21989661f47c6b1732769327d8541` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:32:12.623515 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe865a-0a23-43a0-a5ca-9b616b5374c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0df21989661f47c6b1732769327d8541)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:32:12.629922 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe865a-0a23-43a0-a5ca-9b616b5374c9 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:32:12.694631 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-43fe865a-0a23-43a0-a5ca-9b616b5374c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0df21989661f47c6b1732769327d8541', 'request_id': 'req-43fe865a-0a23-43a0-a5ca-9b616b5374c9'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:32:12.704877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-43fe865a-0a23-43a0-a5ca-9b616b5374c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0df21989661f47c6b1732769327d8541', 'request_id': 'req-43fe865a-0a23-43a0-a5ca-9b616b5374c9'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:32:12.712550 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-43fe865a-0a23-43a0-a5ca-9b616b5374c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0df21989661f47c6b1732769327d8541', 'request_id': 'req-43fe865a-0a23-43a0-a5ca-9b616b5374c9'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:32:12.726746 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-43fe865a-0a23-43a0-a5ca-9b616b5374c9 admin admin] The token cache is being invalidate because project 0df21989661f47c6b1732769327d8541 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:32:12.727094 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-43fe865a-0a23-43a0-a5ca-9b616b5374c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:32:12.727887 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-43fe865a-0a23-43a0-a5ca-9b616b5374c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:32:12.730070 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1418/2822] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:32:12 2022] DELETE /identity/v3/projects/0df21989661f47c6b1732769327d8541 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:32:12.735687 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a73b80-ef09-4e42-b68e-9e7493d7ea7c None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:32:12.736552 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a73b80-ef09-4e42-b68e-9e7493d7ea7c None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:32:12.736552 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a73b80-ef09-4e42-b68e-9e7493d7ea7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:32:12.758633 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-01a73b80-ef09-4e42-b68e-9e7493d7ea7c None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:32:12.759948 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-01a73b80-ef09-4e42-b68e-9e7493d7ea7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:32:12.781179 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:32:12.855351 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1405/2823] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:32:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:32:12.868741 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b27618-0858-4415-9f78-57fb49a45ca0 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:32:12.869935 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b27618-0858-4415-9f78-57fb49a45ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:32:12.870454 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b27618-0858-4415-9f78-57fb49a45ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:32:12.908098 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-b6b27618-0858-4415-9f78-57fb49a45ca0 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:32:12.910258 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-b6b27618-0858-4415-9f78-57fb49a45ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:32:12.929016 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1419/2824] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:32:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:32:12.930312 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a73b80-ef09-4e42-b68e-9e7493d7ea7c None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:32:12.940938 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a73b80-ef09-4e42-b68e-9e7493d7ea7c None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:32:12.946293 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97101d-2b6e-4d51-a3d8-0f3061b6cafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:32:12.946960 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97101d-2b6e-4d51-a3d8-0f3061b6cafd admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:32:12.947274 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97101d-2b6e-4d51-a3d8-0f3061b6cafd admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:32:12.947547 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97101d-2b6e-4d51-a3d8-0f3061b6cafd admin admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:32:12.948227 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b97101d-2b6e-4d51-a3d8-0f3061b6cafd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:32:12.948547 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b97101d-2b6e-4d51-a3d8-0f3061b6cafd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:32:12.950183 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b97101d-2b6e-4d51-a3d8-0f3061b6cafd admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:32:12.964956 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1406/2825] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:32:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:32:12.971031 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b27618-0858-4415-9f78-57fb49a45ca0 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:32:12.987845 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b27618-0858-4415-9f78-57fb49a45ca0 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:32:12.993963 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3741594-b1f8-4c1a-8865-7e5245febec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:32:12.994789 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3741594-b1f8-4c1a-8865-7e5245febec1 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:32:12.995167 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3741594-b1f8-4c1a-8865-7e5245febec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:32:12.995546 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3741594-b1f8-4c1a-8865-7e5245febec1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:32:12.996386 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3741594-b1f8-4c1a-8865-7e5245febec1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:32:12.998747 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3741594-b1f8-4c1a-8865-7e5245febec1 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:32:13.037481 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1420/2826] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:32:12 2022] POST /identity/v3/projects => generated 363 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:32:13.043569 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97101d-2b6e-4d51-a3d8-0f3061b6cafd admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:32:13.056949 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97101d-2b6e-4d51-a3d8-0f3061b6cafd admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:32:13.132762 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b05cb8-634e-4089-a477-8edacf700ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:32:13.133540 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b05cb8-634e-4089-a477-8edacf700ee2 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:32:13.133944 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b05cb8-634e-4089-a477-8edacf700ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:32:13.134253 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b05cb8-634e-4089-a477-8edacf700ee2 admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:32:13.135006 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b05cb8-634e-4089-a477-8edacf700ee2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:32:13.137278 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b05cb8-634e-4089-a477-8edacf700ee2 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:32:13.164868 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1407/2827] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:32:13 2022] POST /identity/v3/users => generated 282 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:32:13.170038 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3741594-b1f8-4c1a-8865-7e5245febec1 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:32:13.183534 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3741594-b1f8-4c1a-8865-7e5245febec1 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:32:13.189703 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3ca0b-f825-4ed0-965b-77f0fe56e6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:32:13.190734 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3ca0b-f825-4ed0-965b-77f0fe56e6dd admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:32:13.191212 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3ca0b-f825-4ed0-965b-77f0fe56e6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:32:13.191397 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3ca0b-f825-4ed0-965b-77f0fe56e6dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:32:13.192200 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb3ca0b-f825-4ed0-965b-77f0fe56e6dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:32:13.194562 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb3ca0b-f825-4ed0-965b-77f0fe56e6dd admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:32:13.213819 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1421/2828] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:32:13.218954 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b05cb8-634e-4089-a477-8edacf700ee2 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:32:13.238392 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b05cb8-634e-4089-a477-8edacf700ee2 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:32:13.247606 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8d284-3945-4a78-b513-70e0afeb18e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:32:13.248680 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8d284-3945-4a78-b513-70e0afeb18e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:32:13.249170 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8d284-3945-4a78-b513-70e0afeb18e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:32:13.249654 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8d284-3945-4a78-b513-70e0afeb18e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:32:13.250917 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8d284-3945-4a78-b513-70e0afeb18e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:32:13.254008 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8d284-3945-4a78-b513-70e0afeb18e2 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:32:13.283144 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1408/2829] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:32:13.286137 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3ca0b-f825-4ed0-965b-77f0fe56e6dd admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:32:13.299110 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3ca0b-f825-4ed0-965b-77f0fe56e6dd admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:32:13.304770 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6e013-b03d-47b3-8e46-f3b6e837d274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:32:13.305784 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6e013-b03d-47b3-8e46-f3b6e837d274 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:32:13.306188 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6e013-b03d-47b3-8e46-f3b6e837d274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:32:13.306919 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6e013-b03d-47b3-8e46-f3b6e837d274 admin admin] PATH_INFO: `/v3/projects/f99555525539436cbed5d9fb68f0d14e/users/8df3898be99443849a8b27b9d67a8180/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:32:13.336836 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae6e013-b03d-47b3-8e46-f3b6e837d274 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f99555525539436cbed5d9fb68f0d14e, user_id=8df3898be99443849a8b27b9d67a8180, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:32:13.341259 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae6e013-b03d-47b3-8e46-f3b6e837d274 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:32:13.363894 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1422/2830] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:32:13 2022] PUT /identity/v3/projects/f99555525539436cbed5d9fb68f0d14e/users/8df3898be99443849a8b27b9d67a8180/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:32:13.382353 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aafdbd-981b-421b-9f9c-d7378072be42 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:32:13.382890 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aafdbd-981b-421b-9f9c-d7378072be42 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:32:13.383375 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aafdbd-981b-421b-9f9c-d7378072be42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:32:13.438797 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-45aafdbd-981b-421b-9f9c-d7378072be42 None None] MFA Rules not processed for user `8df3898be99443849a8b27b9d67a8180`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:32:13.440141 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-45aafdbd-981b-421b-9f9c-d7378072be42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:32:13.569088 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1409/2831] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:32:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:32:13.589223 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6e013-b03d-47b3-8e46-f3b6e837d274 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:32:13.592354 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-eae6e013-b03d-47b3-8e46-f3b6e837d274 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:32:13.643945 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:32:13.719627 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6e013-b03d-47b3-8e46-f3b6e837d274 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:32:13.727121 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0513d-3567-4544-b1d0-47790eb897ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:32:13.728103 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0513d-3567-4544-b1d0-47790eb897ce service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:32:13.729270 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0513d-3567-4544-b1d0-47790eb897ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:32:13.729698 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0513d-3567-4544-b1d0-47790eb897ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:32:13.743564 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e0513d-3567-4544-b1d0-47790eb897ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:32:13.745628 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e0513d-3567-4544-b1d0-47790eb897ce service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:32:13.759092 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1423/2832] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:32:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:32:14.933149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7aed6-4b35-489e-bd11-4be8cf67bd6a None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:32:14.933757 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7aed6-4b35-489e-bd11-4be8cf67bd6a None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:32:14.934074 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7aed6-4b35-489e-bd11-4be8cf67bd6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:32:14.957739 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-8ff7aed6-4b35-489e-bd11-4be8cf67bd6a None None] MFA Rules not processed for user `372eb491b04f4768bb8a3639b7b3f38d`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:32:14.959213 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-8ff7aed6-4b35-489e-bd11-4be8cf67bd6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:32:14.982310 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:32:15.052210 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1410/2833] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:32:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:32:15.888315 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0513d-3567-4544-b1d0-47790eb897ce service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:32:15.890759 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-60e0513d-3567-4544-b1d0-47790eb897ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:32:16.046673 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0513d-3567-4544-b1d0-47790eb897ce service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:32:16.054045 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2019b-fb6d-4bbc-80d6-eda44390c105 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e866f134f64644bf33e3adecf207c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:32:16.055490 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2019b-fb6d-4bbc-80d6-eda44390c105 service placement] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:32:16.057083 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2019b-fb6d-4bbc-80d6-eda44390c105 service placement] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:32:16.057713 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2019b-fb6d-4bbc-80d6-eda44390c105 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:32:16.060823 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-adc2019b-fb6d-4bbc-80d6-eda44390c105 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:32:16.095445 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2019b-fb6d-4bbc-80d6-eda44390c105 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:32:16.100065 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2019b-fb6d-4bbc-80d6-eda44390c105 service placement] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:32:16.123212 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1424/2834] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:32:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:32:18.746439 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7aed6-4b35-489e-bd11-4be8cf67bd6a None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:32:18.749570 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-8ff7aed6-4b35-489e-bd11-4be8cf67bd6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:32:18.867946 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7aed6-4b35-489e-bd11-4be8cf67bd6a None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:32:18.873742 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e151ae0c-409a-4c28-a04f-298288d501b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:32:18.874956 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151ae0c-409a-4c28-a04f-298288d501b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:32:18.875470 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151ae0c-409a-4c28-a04f-298288d501b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:32:18.875961 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151ae0c-409a-4c28-a04f-298288d501b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:32:18.879102 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-e151ae0c-409a-4c28-a04f-298288d501b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:32:18.891646 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e151ae0c-409a-4c28-a04f-298288d501b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:32:18.893188 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e151ae0c-409a-4c28-a04f-298288d501b3 service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:32:18.904016 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1411/2835] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:32:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:32:26.115164 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=49 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:32:28.906818 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=43 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:32:30.381261 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2019b-fb6d-4bbc-80d6-eda44390c105 service placement] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:32:30.382818 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-adc2019b-fb6d-4bbc-80d6-eda44390c105 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:32:30.396293 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2019b-fb6d-4bbc-80d6-eda44390c105 service placement] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:32:30.401070 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef653ac-5b45-4f27-876b-4bbea0f72301 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:32:30.401702 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef653ac-5b45-4f27-876b-4bbea0f72301 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:32:30.402009 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef653ac-5b45-4f27-876b-4bbea0f72301 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:32:30.402254 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef653ac-5b45-4f27-876b-4bbea0f72301 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:32:30.404261 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-eef653ac-5b45-4f27-876b-4bbea0f72301 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:32:30.488772 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef653ac-5b45-4f27-876b-4bbea0f72301 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:32:30.490599 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef653ac-5b45-4f27-876b-4bbea0f72301 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:32:30.502815 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1425/2836] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:32:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:32:33.068159 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e151ae0c-409a-4c28-a04f-298288d501b3 service neutron] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:32:33.070612 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-e151ae0c-409a-4c28-a04f-298288d501b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:32:33.269809 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e151ae0c-409a-4c28-a04f-298288d501b3 service neutron] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:32:33.283877 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e0723-9dc8-4a0d-ad0f-cd568004dc0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:32:33.285022 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e0723-9dc8-4a0d-ad0f-cd568004dc0f service nova] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:32:33.285590 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e0723-9dc8-4a0d-ad0f-cd568004dc0f service nova] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:32:33.286303 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e0723-9dc8-4a0d-ad0f-cd568004dc0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:32:33.292681 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-769e0723-9dc8-4a0d-ad0f-cd568004dc0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:32:33.327390 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e0723-9dc8-4a0d-ad0f-cd568004dc0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:32:33.331274 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e0723-9dc8-4a0d-ad0f-cd568004dc0f service nova] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:32:33.377991 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1412/2837] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:32:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:32:36.172395 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef653ac-5b45-4f27-876b-4bbea0f72301 service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:32:36.203813 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef653ac-5b45-4f27-876b-4bbea0f72301 service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:32:36.212257 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e911fe-11ca-428e-b170-c62d8fc819c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:32:36.212911 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e911fe-11ca-428e-b170-c62d8fc819c6 service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:32:36.213186 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e911fe-11ca-428e-b170-c62d8fc819c6 service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:32:36.213580 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e911fe-11ca-428e-b170-c62d8fc819c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:32:36.227563 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d6e911fe-11ca-428e-b170-c62d8fc819c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:32:36.250690 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e911fe-11ca-428e-b170-c62d8fc819c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:32:36.253539 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e911fe-11ca-428e-b170-c62d8fc819c6 service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:32:36.286453 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1426/2838] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:32:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:32:39.351532 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9e85c-f8be-4a41-8be0-655a0b89f77a None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:32:39.352119 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9e85c-f8be-4a41-8be0-655a0b89f77a None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:32:39.352119 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9e85c-f8be-4a41-8be0-655a0b89f77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:32:39.412875 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-29c9e85c-f8be-4a41-8be0-655a0b89f77a None None] MFA Rules not processed for user `bbd7a1d5a8d04e3798ffcab27bad936b`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:32:39.414150 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-29c9e85c-f8be-4a41-8be0-655a0b89f77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:32:39.496644 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1413/2839] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Sep 21 12:32:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:32:39.553050 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e911fe-11ca-428e-b170-c62d8fc819c6 service nova] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:32:39.556102 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d6e911fe-11ca-428e-b170-c62d8fc819c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:32:39.730185 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e911fe-11ca-428e-b170-c62d8fc819c6 service nova] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:32:39.735700 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e55646-4e65-4e2b-a6bb-1bf4390e5b05 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc2bab11b264196859802907b93ac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:32:39.736327 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e55646-4e65-4e2b-a6bb-1bf4390e5b05 service swift] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:32:39.736607 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e55646-4e65-4e2b-a6bb-1bf4390e5b05 service swift] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:32:39.736890 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e55646-4e65-4e2b-a6bb-1bf4390e5b05 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:32:39.747248 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e55646-4e65-4e2b-a6bb-1bf4390e5b05 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:32:39.748877 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e55646-4e65-4e2b-a6bb-1bf4390e5b05 service swift] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:32:39.758675 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1427/2840] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Sep 21 12:32:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 12:32:49.492560 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=74 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:32:49.754422 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=77 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:32:50.935580 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9e85c-f8be-4a41-8be0-655a0b89f77a None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:32:51.075803 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9e85c-f8be-4a41-8be0-655a0b89f77a None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:32:51.086565 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c480e-2719-4f95-a1a8-3d4dfc27eff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:32:51.088425 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c480e-2719-4f95-a1a8-3d4dfc27eff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:32:51.089107 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c480e-2719-4f95-a1a8-3d4dfc27eff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:32:51.089823 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c480e-2719-4f95-a1a8-3d4dfc27eff8 admin admin] PATH_INFO: `/v3/users/8df3898be99443849a8b27b9d67a8180` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:32:51.092768 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7c480e-2719-4f95-a1a8-3d4dfc27eff8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8df3898be99443849a8b27b9d67a8180)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:32:51.096359 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7c480e-2719-4f95-a1a8-3d4dfc27eff8 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:32:51.176558 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-ca7c480e-2719-4f95-a1a8-3d4dfc27eff8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8df3898be99443849a8b27b9d67a8180'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:32:51.195165 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-ca7c480e-2719-4f95-a1a8-3d4dfc27eff8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8df3898be99443849a8b27b9d67a8180'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:32:51.210039 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-ca7c480e-2719-4f95-a1a8-3d4dfc27eff8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8df3898be99443849a8b27b9d67a8180'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:32:51.211277 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-ca7c480e-2719-4f95-a1a8-3d4dfc27eff8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8df3898be99443849a8b27b9d67a8180'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:32:51.221964 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-ca7c480e-2719-4f95-a1a8-3d4dfc27eff8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8df3898be99443849a8b27b9d67a8180'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:32:51.230406 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1414/2841] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:32:50 2022] DELETE /identity/v3/users/8df3898be99443849a8b27b9d67a8180 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:32:51.236526 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44901e-048a-400b-86b7-8bb9717347d6 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:32:51.237757 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44901e-048a-400b-86b7-8bb9717347d6 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:32:51.238258 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44901e-048a-400b-86b7-8bb9717347d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:32:51.275012 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-bc44901e-048a-400b-86b7-8bb9717347d6 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:32:51.277467 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-bc44901e-048a-400b-86b7-8bb9717347d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:32:51.384710 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1428/2842] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:32:51.395946 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c480e-2719-4f95-a1a8-3d4dfc27eff8 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:32:51.399176 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-ca7c480e-2719-4f95-a1a8-3d4dfc27eff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:32:51.494424 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c480e-2719-4f95-a1a8-3d4dfc27eff8 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:32:51.498955 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840f1bb-61ad-48e1-96dc-6ec9c993d9b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:32:51.499697 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840f1bb-61ad-48e1-96dc-6ec9c993d9b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:32:51.500026 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840f1bb-61ad-48e1-96dc-6ec9c993d9b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:32:51.500396 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840f1bb-61ad-48e1-96dc-6ec9c993d9b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:32:51.514197 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6840f1bb-61ad-48e1-96dc-6ec9c993d9b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:32:51.516235 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6840f1bb-61ad-48e1-96dc-6ec9c993d9b8 service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:32:51.537070 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1415/2843] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:32:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:32:52.040197 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44901e-048a-400b-86b7-8bb9717347d6 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:32:52.041337 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-bc44901e-048a-400b-86b7-8bb9717347d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:32:52.062098 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44901e-048a-400b-86b7-8bb9717347d6 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:32:52.067336 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec3343-01f1-4919-a701-5b69c3b4ad64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:32:52.068013 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec3343-01f1-4919-a701-5b69c3b4ad64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:32:52.068313 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec3343-01f1-4919-a701-5b69c3b4ad64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:32:52.068589 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec3343-01f1-4919-a701-5b69c3b4ad64 admin admin] PATH_INFO: `/v3/projects/f99555525539436cbed5d9fb68f0d14e` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:32:52.069929 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec3343-01f1-4919-a701-5b69c3b4ad64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f99555525539436cbed5d9fb68f0d14e)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:32:52.073134 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec3343-01f1-4919-a701-5b69c3b4ad64 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:32:52.138460 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-79ec3343-01f1-4919-a701-5b69c3b4ad64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f99555525539436cbed5d9fb68f0d14e', 'request_id': 'req-79ec3343-01f1-4919-a701-5b69c3b4ad64'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:32:52.148843 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-79ec3343-01f1-4919-a701-5b69c3b4ad64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f99555525539436cbed5d9fb68f0d14e', 'request_id': 'req-79ec3343-01f1-4919-a701-5b69c3b4ad64'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:32:52.158795 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-79ec3343-01f1-4919-a701-5b69c3b4ad64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f99555525539436cbed5d9fb68f0d14e', 'request_id': 'req-79ec3343-01f1-4919-a701-5b69c3b4ad64'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:32:52.177588 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-79ec3343-01f1-4919-a701-5b69c3b4ad64 admin admin] The token cache is being invalidate because project f99555525539436cbed5d9fb68f0d14e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:32:52.177965 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-79ec3343-01f1-4919-a701-5b69c3b4ad64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:32:52.178750 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-79ec3343-01f1-4919-a701-5b69c3b4ad64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:32:52.181485 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1429/2844] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:32:52 2022] DELETE /identity/v3/projects/f99555525539436cbed5d9fb68f0d14e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:32:52.186682 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883a64e-a3c7-43c2-9dc2-69836a0e2604 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:32:52.187261 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883a64e-a3c7-43c2-9dc2-69836a0e2604 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:32:52.187769 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883a64e-a3c7-43c2-9dc2-69836a0e2604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:32:52.210927 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-8883a64e-a3c7-43c2-9dc2-69836a0e2604 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:32:52.212336 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-8883a64e-a3c7-43c2-9dc2-69836a0e2604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:32:52.233229 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:32:52.290821 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1416/2845] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:32:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:32:52.369118 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c9d5f-cbac-4041-be36-443320c77c13 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:32:52.369678 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c9d5f-cbac-4041-be36-443320c77c13 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:32:52.369875 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c9d5f-cbac-4041-be36-443320c77c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:32:52.395909 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-bd8c9d5f-cbac-4041-be36-443320c77c13 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:32:52.397642 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-bd8c9d5f-cbac-4041-be36-443320c77c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:32:52.407339 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1430/2846] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:32:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:32:52.411321 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883a64e-a3c7-43c2-9dc2-69836a0e2604 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:32:52.423718 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883a64e-a3c7-43c2-9dc2-69836a0e2604 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:32:52.429155 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09608416-5f82-4f2b-9cee-5b34925b0ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:32:52.429790 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09608416-5f82-4f2b-9cee-5b34925b0ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:32:52.430202 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09608416-5f82-4f2b-9cee-5b34925b0ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:32:52.430566 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09608416-5f82-4f2b-9cee-5b34925b0ca7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:32:52.431296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09608416-5f82-4f2b-9cee-5b34925b0ca7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:32:52.431611 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09608416-5f82-4f2b-9cee-5b34925b0ca7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:32:52.433394 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09608416-5f82-4f2b-9cee-5b34925b0ca7 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:32:52.448369 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1417/2847] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:32:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:32:52.452634 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c9d5f-cbac-4041-be36-443320c77c13 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:32:52.468480 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c9d5f-cbac-4041-be36-443320c77c13 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:32:52.474176 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc9586c-80e5-4d93-8726-772628cc4912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:32:52.474851 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9586c-80e5-4d93-8726-772628cc4912 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:32:52.475128 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9586c-80e5-4d93-8726-772628cc4912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:32:52.475397 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9586c-80e5-4d93-8726-772628cc4912 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:32:52.476039 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc9586c-80e5-4d93-8726-772628cc4912 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:32:52.478064 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc9586c-80e5-4d93-8726-772628cc4912 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:32:52.513235 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1431/2848] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:32:52 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:32:52.517597 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09608416-5f82-4f2b-9cee-5b34925b0ca7 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:32:52.530807 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09608416-5f82-4f2b-9cee-5b34925b0ca7 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:32:52.614843 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada1937-dbd4-4eaa-985e-ab13f564aaf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:32:52.615812 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada1937-dbd4-4eaa-985e-ab13f564aaf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:32:52.616286 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada1937-dbd4-4eaa-985e-ab13f564aaf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:32:52.616556 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada1937-dbd4-4eaa-985e-ab13f564aaf5 admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:32:52.617243 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cada1937-dbd4-4eaa-985e-ab13f564aaf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:32:52.619810 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cada1937-dbd4-4eaa-985e-ab13f564aaf5 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:32:52.651286 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1418/2849] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:32:52 2022] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:32:52.652872 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc9586c-80e5-4d93-8726-772628cc4912 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:32:52.666642 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc9586c-80e5-4d93-8726-772628cc4912 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:32:52.672140 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540cf354-efc3-45d8-8da9-ecdb4e90f57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:32:52.672647 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cf354-efc3-45d8-8da9-ecdb4e90f57d admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:32:52.672924 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cf354-efc3-45d8-8da9-ecdb4e90f57d admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:32:52.673202 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cf354-efc3-45d8-8da9-ecdb4e90f57d admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:32:52.673863 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540cf354-efc3-45d8-8da9-ecdb4e90f57d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:32:52.675679 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540cf354-efc3-45d8-8da9-ecdb4e90f57d admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:32:52.691129 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1432/2850] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:32:52.692488 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada1937-dbd4-4eaa-985e-ab13f564aaf5 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:32:52.705725 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada1937-dbd4-4eaa-985e-ab13f564aaf5 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:32:52.711412 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88309f-ec93-4a8d-91a5-b945424fdad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:32:52.712070 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88309f-ec93-4a8d-91a5-b945424fdad1 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:32:52.712379 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88309f-ec93-4a8d-91a5-b945424fdad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:32:52.712660 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88309f-ec93-4a8d-91a5-b945424fdad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:32:52.713357 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88309f-ec93-4a8d-91a5-b945424fdad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:32:52.715075 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88309f-ec93-4a8d-91a5-b945424fdad1 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:32:52.728855 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1419/2851] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:32:52.733958 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540cf354-efc3-45d8-8da9-ecdb4e90f57d admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:32:52.750604 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540cf354-efc3-45d8-8da9-ecdb4e90f57d admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:32:52.758696 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6373a-8ea4-45e6-af57-a817e3b1bc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:32:52.759861 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6373a-8ea4-45e6-af57-a817e3b1bc03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:32:52.760370 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6373a-8ea4-45e6-af57-a817e3b1bc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:32:52.760875 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6373a-8ea4-45e6-af57-a817e3b1bc03 admin admin] PATH_INFO: `/v3/projects/5d821f884b184eca9c05bb67cce66bc3/users/dabf3589a0104097a8365b44b4753105/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:32:52.792251 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6373a-8ea4-45e6-af57-a817e3b1bc03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d821f884b184eca9c05bb67cce66bc3, user_id=dabf3589a0104097a8365b44b4753105, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:32:52.798170 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6373a-8ea4-45e6-af57-a817e3b1bc03 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:32:52.824770 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1433/2852] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:32:52 2022] PUT /identity/v3/projects/5d821f884b184eca9c05bb67cce66bc3/users/dabf3589a0104097a8365b44b4753105/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:32:52.830218 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b2c97-2953-4271-bc7d-dfcbc4259013 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:32:52.830681 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b2c97-2953-4271-bc7d-dfcbc4259013 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:32:52.831114 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b2c97-2953-4271-bc7d-dfcbc4259013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:32:52.870774 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-093b2c97-2953-4271-bc7d-dfcbc4259013 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:32:52.873697 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-093b2c97-2953-4271-bc7d-dfcbc4259013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:32:52.982543 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1420/2853] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:32:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:32:52.998739 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6373a-8ea4-45e6-af57-a817e3b1bc03 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:32:53.002344 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-19b6373a-8ea4-45e6-af57-a817e3b1bc03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:32:53.044469 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:32:53.113796 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6373a-8ea4-45e6-af57-a817e3b1bc03 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:32:53.120527 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412a27f-3ec9-46a8-81bd-c7e948a9bb8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:32:53.121235 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412a27f-3ec9-46a8-81bd-c7e948a9bb8c service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:32:53.121501 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412a27f-3ec9-46a8-81bd-c7e948a9bb8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:32:53.121779 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412a27f-3ec9-46a8-81bd-c7e948a9bb8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:32:53.137551 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7412a27f-3ec9-46a8-81bd-c7e948a9bb8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:32:53.139880 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7412a27f-3ec9-46a8-81bd-c7e948a9bb8c service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:32:53.172367 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1434/2854] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:32:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:32:54.306468 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8878aa9-1366-46f9-a61a-90c1bce16b5a None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:32:54.307354 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8878aa9-1366-46f9-a61a-90c1bce16b5a None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:32:54.307354 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8878aa9-1366-46f9-a61a-90c1bce16b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:32:54.363093 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-d8878aa9-1366-46f9-a61a-90c1bce16b5a None None] MFA Rules not processed for user `dabf3589a0104097a8365b44b4753105`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:32:54.364509 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-d8878aa9-1366-46f9-a61a-90c1bce16b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:32:54.402342 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:32:54.523240 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1421/2855] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:32:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:32:54.536740 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412a27f-3ec9-46a8-81bd-c7e948a9bb8c service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:32:54.546121 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7412a27f-3ec9-46a8-81bd-c7e948a9bb8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:32:54.700907 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412a27f-3ec9-46a8-81bd-c7e948a9bb8c service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:32:54.708125 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07114db9-5c47-47bf-a72a-33424265c05d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:32:54.709397 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07114db9-5c47-47bf-a72a-33424265c05d service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:32:54.709851 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07114db9-5c47-47bf-a72a-33424265c05d service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:32:54.710309 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07114db9-5c47-47bf-a72a-33424265c05d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:32:54.729229 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07114db9-5c47-47bf-a72a-33424265c05d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:32:54.732242 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07114db9-5c47-47bf-a72a-33424265c05d service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:32:54.765320 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1435/2856] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:32:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:32:56.496898 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a735773-aec1-44e5-aa9a-780574302ccf None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:32:56.498283 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a735773-aec1-44e5-aa9a-780574302ccf None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:32:56.499350 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a735773-aec1-44e5-aa9a-780574302ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:32:56.529944 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-6a735773-aec1-44e5-aa9a-780574302ccf None None] MFA Rules not processed for user `dabf3589a0104097a8365b44b4753105`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:32:56.531256 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-6a735773-aec1-44e5-aa9a-780574302ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:32:56.540595 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1422/2857] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:32:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:32:57.023096 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07114db9-5c47-47bf-a72a-33424265c05d service cinder] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:32:57.025681 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-07114db9-5c47-47bf-a72a-33424265c05d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:32:57.043182 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07114db9-5c47-47bf-a72a-33424265c05d service cinder] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:32:57.047789 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9504e-3afc-4e1c-ba62-eba728aaa617 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:32:57.048631 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9504e-3afc-4e1c-ba62-eba728aaa617 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:32:57.048913 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9504e-3afc-4e1c-ba62-eba728aaa617 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:32:57.049192 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9504e-3afc-4e1c-ba62-eba728aaa617 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:32:57.054739 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2df9504e-3afc-4e1c-ba62-eba728aaa617 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:32:57.067532 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df9504e-3afc-4e1c-ba62-eba728aaa617 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:32:57.068999 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df9504e-3afc-4e1c-ba62-eba728aaa617 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:32:57.080119 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1436/2858] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:32:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:32:59.141967 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e9a0c-35d8-47bf-9349-95936de22aa9 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:32:59.143467 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e9a0c-35d8-47bf-9349-95936de22aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:32:59.144244 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e9a0c-35d8-47bf-9349-95936de22aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:32:59.181372 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-875e9a0c-35d8-47bf-9349-95936de22aa9 None None] MFA Rules not processed for user `bbd7a1d5a8d04e3798ffcab27bad936b`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:32:59.184708 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-875e9a0c-35d8-47bf-9349-95936de22aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:32:59.272668 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1423/2859] 10.222.0.60 () {58 vars in 967 bytes} [Wed Sep 21 12:32:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:32:59.290814 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9504e-3afc-4e1c-ba62-eba728aaa617 service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:32:59.293017 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2df9504e-3afc-4e1c-ba62-eba728aaa617 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:32:59.390080 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9504e-3afc-4e1c-ba62-eba728aaa617 service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:32:59.397287 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739ddf5-df56-4570-9bd9-0cc010c0a64d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc2bab11b264196859802907b93ac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:32:59.397844 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739ddf5-df56-4570-9bd9-0cc010c0a64d service swift] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:32:59.398126 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739ddf5-df56-4570-9bd9-0cc010c0a64d service swift] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:32:59.398452 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739ddf5-df56-4570-9bd9-0cc010c0a64d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:32:59.409185 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0739ddf5-df56-4570-9bd9-0cc010c0a64d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:32:59.410884 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0739ddf5-df56-4570-9bd9-0cc010c0a64d service swift] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:32:59.420815 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1437/2860] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Sep 21 12:32:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 12:33:01.744111 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e9a0c-35d8-47bf-9349-95936de22aa9 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:33:01.745855 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-875e9a0c-35d8-47bf-9349-95936de22aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:33:01.764847 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e9a0c-35d8-47bf-9349-95936de22aa9 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:33:01.769833 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b84003-ddf9-4de2-8ebc-a3241aca184d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:33:01.770522 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b84003-ddf9-4de2-8ebc-a3241aca184d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:33:01.770805 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b84003-ddf9-4de2-8ebc-a3241aca184d admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:33:01.771079 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b84003-ddf9-4de2-8ebc-a3241aca184d admin admin] PATH_INFO: `/v3/users/372eb491b04f4768bb8a3639b7b3f38d` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:33:01.772588 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b84003-ddf9-4de2-8ebc-a3241aca184d admin admin] RBAC: Authorizing `identity:delete_user(user_id=372eb491b04f4768bb8a3639b7b3f38d)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:33:01.775587 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b84003-ddf9-4de2-8ebc-a3241aca184d admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:33:01.830912 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-a1b84003-ddf9-4de2-8ebc-a3241aca184d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '372eb491b04f4768bb8a3639b7b3f38d'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:33:01.844438 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-a1b84003-ddf9-4de2-8ebc-a3241aca184d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '372eb491b04f4768bb8a3639b7b3f38d'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:33:01.853942 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-a1b84003-ddf9-4de2-8ebc-a3241aca184d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '372eb491b04f4768bb8a3639b7b3f38d'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:33:01.854736 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-a1b84003-ddf9-4de2-8ebc-a3241aca184d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '372eb491b04f4768bb8a3639b7b3f38d'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:33:01.863347 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-a1b84003-ddf9-4de2-8ebc-a3241aca184d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '372eb491b04f4768bb8a3639b7b3f38d'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:33:01.869980 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1424/2861] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:33:01 2022] DELETE /identity/v3/users/372eb491b04f4768bb8a3639b7b3f38d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:33:02.069851 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739ddf5-df56-4570-9bd9-0cc010c0a64d service swift] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:33:02.092891 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739ddf5-df56-4570-9bd9-0cc010c0a64d service swift] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:33:02.144133 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:33:02.164289 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900074aa-9c28-4fe0-9f0b-8dd5ad57c6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:33:02.165166 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900074aa-9c28-4fe0-9f0b-8dd5ad57c6a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:33:02.165643 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900074aa-9c28-4fe0-9f0b-8dd5ad57c6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:33:02.166100 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900074aa-9c28-4fe0-9f0b-8dd5ad57c6a9 admin admin] PATH_INFO: `/v3/projects/7ff8526c0d654b659c93c45eda50dae8` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:33:02.167497 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900074aa-9c28-4fe0-9f0b-8dd5ad57c6a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ff8526c0d654b659c93c45eda50dae8)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:33:02.169541 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900074aa-9c28-4fe0-9f0b-8dd5ad57c6a9 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:33:02.229480 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-900074aa-9c28-4fe0-9f0b-8dd5ad57c6a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ff8526c0d654b659c93c45eda50dae8', 'request_id': 'req-900074aa-9c28-4fe0-9f0b-8dd5ad57c6a9'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:33:02.243035 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-900074aa-9c28-4fe0-9f0b-8dd5ad57c6a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ff8526c0d654b659c93c45eda50dae8', 'request_id': 'req-900074aa-9c28-4fe0-9f0b-8dd5ad57c6a9'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:33:02.250880 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-900074aa-9c28-4fe0-9f0b-8dd5ad57c6a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ff8526c0d654b659c93c45eda50dae8', 'request_id': 'req-900074aa-9c28-4fe0-9f0b-8dd5ad57c6a9'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:33:02.265951 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-900074aa-9c28-4fe0-9f0b-8dd5ad57c6a9 admin admin] The token cache is being invalidate because project 7ff8526c0d654b659c93c45eda50dae8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:33:02.266516 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-900074aa-9c28-4fe0-9f0b-8dd5ad57c6a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:33:02.267588 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-900074aa-9c28-4fe0-9f0b-8dd5ad57c6a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:33:02.270178 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1438/2862] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:33:02 2022] DELETE /identity/v3/projects/7ff8526c0d654b659c93c45eda50dae8 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:33:02.275867 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855aa6f7-554f-4ab4-b5ab-a74490aeb90d None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:33:02.276201 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855aa6f7-554f-4ab4-b5ab-a74490aeb90d None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:33:02.276532 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855aa6f7-554f-4ab4-b5ab-a74490aeb90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:33:02.298451 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-855aa6f7-554f-4ab4-b5ab-a74490aeb90d None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:33:02.299718 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-855aa6f7-554f-4ab4-b5ab-a74490aeb90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:33:02.327418 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:33:02.380799 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1425/2863] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:33:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:33:02.389428 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18693b07-a690-4052-815a-4fba723178ff None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:33:02.389766 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18693b07-a690-4052-815a-4fba723178ff None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:33:02.390079 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18693b07-a690-4052-815a-4fba723178ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:33:02.413256 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-18693b07-a690-4052-815a-4fba723178ff None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:33:02.415104 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-18693b07-a690-4052-815a-4fba723178ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:33:02.426989 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1439/2864] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:33:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:33:02.431643 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855aa6f7-554f-4ab4-b5ab-a74490aeb90d None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:33:02.442491 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855aa6f7-554f-4ab4-b5ab-a74490aeb90d None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:33:02.447524 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc9d06-4ecd-41b6-9458-73a792ac5029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:33:02.448309 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc9d06-4ecd-41b6-9458-73a792ac5029 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:33:02.448594 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc9d06-4ecd-41b6-9458-73a792ac5029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:33:02.448869 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc9d06-4ecd-41b6-9458-73a792ac5029 admin admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:33:02.449531 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc9d06-4ecd-41b6-9458-73a792ac5029 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:33:02.449869 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc9d06-4ecd-41b6-9458-73a792ac5029 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:33:02.451583 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc9d06-4ecd-41b6-9458-73a792ac5029 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:33:02.465531 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1426/2865] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:33:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:33:02.471819 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18693b07-a690-4052-815a-4fba723178ff None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:33:02.482391 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18693b07-a690-4052-815a-4fba723178ff None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:33:02.487346 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7875c-db90-428b-b2e3-12c8359d06f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:33:02.487975 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7875c-db90-428b-b2e3-12c8359d06f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:33:02.488254 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7875c-db90-428b-b2e3-12c8359d06f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:33:02.488686 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7875c-db90-428b-b2e3-12c8359d06f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:33:02.489376 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a7875c-db90-428b-b2e3-12c8359d06f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:33:02.491470 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a7875c-db90-428b-b2e3-12c8359d06f5 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:33:02.525642 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1440/2866] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:33:02 2022] POST /identity/v3/projects => generated 391 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:33:02.529948 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc9d06-4ecd-41b6-9458-73a792ac5029 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:33:02.543015 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc9d06-4ecd-41b6-9458-73a792ac5029 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:33:02.625717 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832fadbd-0f83-4ea1-b9c5-4f3638fb342e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:33:02.626619 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fadbd-0f83-4ea1-b9c5-4f3638fb342e admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:33:02.626938 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fadbd-0f83-4ea1-b9c5-4f3638fb342e admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:33:02.627246 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fadbd-0f83-4ea1-b9c5-4f3638fb342e admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:33:02.627940 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832fadbd-0f83-4ea1-b9c5-4f3638fb342e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:33:02.630388 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832fadbd-0f83-4ea1-b9c5-4f3638fb342e admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:33:02.663925 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1427/2867] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:33:02 2022] POST /identity/v3/users => generated 296 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:33:02.666534 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7875c-db90-428b-b2e3-12c8359d06f5 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:33:02.678543 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7875c-db90-428b-b2e3-12c8359d06f5 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:33:02.683650 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e13952-a5ee-475a-ac7c-30468d33e40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:33:02.684281 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e13952-a5ee-475a-ac7c-30468d33e40c admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:33:02.684717 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e13952-a5ee-475a-ac7c-30468d33e40c admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:33:02.684994 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e13952-a5ee-475a-ac7c-30468d33e40c admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:33:02.685661 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e13952-a5ee-475a-ac7c-30468d33e40c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:33:02.687375 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e13952-a5ee-475a-ac7c-30468d33e40c admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:33:02.700250 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1441/2868] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:33:02.706971 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832fadbd-0f83-4ea1-b9c5-4f3638fb342e admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:33:02.718937 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832fadbd-0f83-4ea1-b9c5-4f3638fb342e admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:33:02.724267 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb5c05-c3fe-4e1b-8250-544b46879014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:33:02.724891 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb5c05-c3fe-4e1b-8250-544b46879014 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:33:02.725179 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb5c05-c3fe-4e1b-8250-544b46879014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:33:02.725452 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb5c05-c3fe-4e1b-8250-544b46879014 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:33:02.726106 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb5c05-c3fe-4e1b-8250-544b46879014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:33:02.728514 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb5c05-c3fe-4e1b-8250-544b46879014 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:33:02.747469 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1428/2869] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:33:02.755110 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e13952-a5ee-475a-ac7c-30468d33e40c admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:33:02.766747 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e13952-a5ee-475a-ac7c-30468d33e40c admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:33:02.771643 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104b963-62ad-4a3d-9b59-050536bf7de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:33:02.772319 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104b963-62ad-4a3d-9b59-050536bf7de9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:33:02.772596 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104b963-62ad-4a3d-9b59-050536bf7de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:33:02.772879 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104b963-62ad-4a3d-9b59-050536bf7de9 admin admin] PATH_INFO: `/v3/projects/84b36290ec764420be12a51320bb59e1/users/d90eee87994b4206bf677f90ce9b68cb/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:33:02.790141 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104b963-62ad-4a3d-9b59-050536bf7de9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84b36290ec764420be12a51320bb59e1, user_id=d90eee87994b4206bf677f90ce9b68cb, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:33:02.792846 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104b963-62ad-4a3d-9b59-050536bf7de9 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:33:02.816028 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1442/2870] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:33:02 2022] PUT /identity/v3/projects/84b36290ec764420be12a51320bb59e1/users/d90eee87994b4206bf677f90ce9b68cb/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:33:02.835130 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970ae7f-d15e-405d-9cc6-b085813737a4 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:33:02.835629 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970ae7f-d15e-405d-9cc6-b085813737a4 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:33:02.836247 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970ae7f-d15e-405d-9cc6-b085813737a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:33:02.882256 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-3970ae7f-d15e-405d-9cc6-b085813737a4 None None] MFA Rules not processed for user `d90eee87994b4206bf677f90ce9b68cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:33:02.883464 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-3970ae7f-d15e-405d-9cc6-b085813737a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:33:02.960095 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1429/2871] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:33:02 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:33:02.973120 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104b963-62ad-4a3d-9b59-050536bf7de9 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:33:02.974963 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-7104b963-62ad-4a3d-9b59-050536bf7de9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:33:03.042690 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104b963-62ad-4a3d-9b59-050536bf7de9 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:33:03.047075 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f938d-0c27-4ff6-ad00-93f1f1b6d24e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:33:03.047714 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f938d-0c27-4ff6-ad00-93f1f1b6d24e service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:33:03.047989 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f938d-0c27-4ff6-ad00-93f1f1b6d24e service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:33:03.048258 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f938d-0c27-4ff6-ad00-93f1f1b6d24e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:33:03.058041 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f938d-0c27-4ff6-ad00-93f1f1b6d24e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:33:03.059755 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f938d-0c27-4ff6-ad00-93f1f1b6d24e service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:33:03.071375 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1443/2872] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:33:02 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:33:12.956887 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=86,keystone:INSERT=3 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:33:13.065683 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=85,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:33:13.792271 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970ae7f-d15e-405d-9cc6-b085813737a4 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:33:13.888931 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970ae7f-d15e-405d-9cc6-b085813737a4 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:33:13.896210 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce6a9c-23f7-4047-a861-5483dea51b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:33:13.897319 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce6a9c-23f7-4047-a861-5483dea51b3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:33:13.897815 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce6a9c-23f7-4047-a861-5483dea51b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:33:13.898268 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce6a9c-23f7-4047-a861-5483dea51b3a admin admin] PATH_INFO: `/v3/users/d90eee87994b4206bf677f90ce9b68cb` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:33:13.900685 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce6a9c-23f7-4047-a861-5483dea51b3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d90eee87994b4206bf677f90ce9b68cb)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:33:13.904634 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce6a9c-23f7-4047-a861-5483dea51b3a admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:33:13.978497 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-9dce6a9c-23f7-4047-a861-5483dea51b3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd90eee87994b4206bf677f90ce9b68cb'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:33:13.993616 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-9dce6a9c-23f7-4047-a861-5483dea51b3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd90eee87994b4206bf677f90ce9b68cb'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:33:14.003400 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-9dce6a9c-23f7-4047-a861-5483dea51b3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd90eee87994b4206bf677f90ce9b68cb'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:33:14.004612 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-9dce6a9c-23f7-4047-a861-5483dea51b3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd90eee87994b4206bf677f90ce9b68cb'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:33:14.018096 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-9dce6a9c-23f7-4047-a861-5483dea51b3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd90eee87994b4206bf677f90ce9b68cb'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:33:14.025518 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1430/2873] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:33:13 2022] DELETE /identity/v3/users/d90eee87994b4206bf677f90ce9b68cb => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:33:14.031461 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3bf15-4e60-46ee-8701-897096a312b1 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:33:14.031880 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3bf15-4e60-46ee-8701-897096a312b1 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:33:14.032200 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3bf15-4e60-46ee-8701-897096a312b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:33:14.058153 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-70a3bf15-4e60-46ee-8701-897096a312b1 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:33:14.059680 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-70a3bf15-4e60-46ee-8701-897096a312b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:33:14.139722 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1444/2874] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:33:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:33:14.151109 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce6a9c-23f7-4047-a861-5483dea51b3a admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:33:14.152891 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-9dce6a9c-23f7-4047-a861-5483dea51b3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:33:14.224760 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce6a9c-23f7-4047-a861-5483dea51b3a admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:33:14.229603 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e367379-9835-4065-944c-68c8a62966f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:33:14.230229 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e367379-9835-4065-944c-68c8a62966f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:33:14.230537 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e367379-9835-4065-944c-68c8a62966f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:33:14.230809 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e367379-9835-4065-944c-68c8a62966f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:33:14.242862 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e367379-9835-4065-944c-68c8a62966f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:33:14.244466 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e367379-9835-4065-944c-68c8a62966f0 service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:33:14.255712 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1431/2875] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:33:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:33:14.681369 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a3bf15-4e60-46ee-8701-897096a312b1 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:33:14.683461 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-70a3bf15-4e60-46ee-8701-897096a312b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:33:14.704030 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a3bf15-4e60-46ee-8701-897096a312b1 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:33:14.711553 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48b502-8749-436d-8e29-ea7aa8e6a469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:33:14.712385 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48b502-8749-436d-8e29-ea7aa8e6a469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:33:14.712561 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48b502-8749-436d-8e29-ea7aa8e6a469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:33:14.712850 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48b502-8749-436d-8e29-ea7aa8e6a469 admin admin] PATH_INFO: `/v3/projects/84b36290ec764420be12a51320bb59e1` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:33:14.714597 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48b502-8749-436d-8e29-ea7aa8e6a469 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84b36290ec764420be12a51320bb59e1)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:33:14.717632 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48b502-8749-436d-8e29-ea7aa8e6a469 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:33:14.777078 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-dc48b502-8749-436d-8e29-ea7aa8e6a469 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84b36290ec764420be12a51320bb59e1', 'request_id': 'req-dc48b502-8749-436d-8e29-ea7aa8e6a469'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:33:14.786053 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-dc48b502-8749-436d-8e29-ea7aa8e6a469 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84b36290ec764420be12a51320bb59e1', 'request_id': 'req-dc48b502-8749-436d-8e29-ea7aa8e6a469'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:33:14.794043 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-dc48b502-8749-436d-8e29-ea7aa8e6a469 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84b36290ec764420be12a51320bb59e1', 'request_id': 'req-dc48b502-8749-436d-8e29-ea7aa8e6a469'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:33:14.809941 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-dc48b502-8749-436d-8e29-ea7aa8e6a469 admin admin] The token cache is being invalidate because project 84b36290ec764420be12a51320bb59e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:33:14.810279 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-dc48b502-8749-436d-8e29-ea7aa8e6a469 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:33:14.810982 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-dc48b502-8749-436d-8e29-ea7aa8e6a469 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:33:14.812534 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1445/2876] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:33:14 2022] DELETE /identity/v3/projects/84b36290ec764420be12a51320bb59e1 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:33:14.817977 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe439e31-4918-49a5-ac97-036770c26f51 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:33:14.818325 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe439e31-4918-49a5-ac97-036770c26f51 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:33:14.818754 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe439e31-4918-49a5-ac97-036770c26f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:33:14.843643 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-fe439e31-4918-49a5-ac97-036770c26f51 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:33:14.844952 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-fe439e31-4918-49a5-ac97-036770c26f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:33:14.867388 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:33:14.951623 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1432/2877] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:33:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:33:14.963244 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3e479-58a4-450c-869f-bbdff9da4786 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:33:14.963940 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3e479-58a4-450c-869f-bbdff9da4786 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:33:14.964693 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3e479-58a4-450c-869f-bbdff9da4786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:33:15.001213 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-ebe3e479-58a4-450c-869f-bbdff9da4786 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:33:15.002518 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ebe3e479-58a4-450c-869f-bbdff9da4786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:33:15.011707 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1446/2878] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:33:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:33:15.016692 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe439e31-4918-49a5-ac97-036770c26f51 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:33:15.030621 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe439e31-4918-49a5-ac97-036770c26f51 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:33:15.035760 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349298e2-8247-4ed3-978c-a3b0992e0a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:33:15.036400 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349298e2-8247-4ed3-978c-a3b0992e0a5f admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:33:15.036681 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349298e2-8247-4ed3-978c-a3b0992e0a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:33:15.036956 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349298e2-8247-4ed3-978c-a3b0992e0a5f admin admin] PATH_INFO: `/v3/domains` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:33:15.037646 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349298e2-8247-4ed3-978c-a3b0992e0a5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81377) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:33:15.037982 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349298e2-8247-4ed3-978c-a3b0992e0a5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:33:15.040612 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349298e2-8247-4ed3-978c-a3b0992e0a5f admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:33:15.055385 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1433/2879] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 21 12:33:15.061576 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3e479-58a4-450c-869f-bbdff9da4786 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:33:15.071648 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3e479-58a4-450c-869f-bbdff9da4786 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:33:15.076932 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581bdfb-577e-4649-8082-4e7023e8734e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:33:15.077625 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581bdfb-577e-4649-8082-4e7023e8734e admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:33:15.077948 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581bdfb-577e-4649-8082-4e7023e8734e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:33:15.078278 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581bdfb-577e-4649-8082-4e7023e8734e admin admin] PATH_INFO: `/v3/projects` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:33:15.079008 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f581bdfb-577e-4649-8082-4e7023e8734e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:33:15.080989 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f581bdfb-577e-4649-8082-4e7023e8734e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:33:15.113811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1447/2880] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:33:15 2022] POST /identity/v3/projects => generated 397 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:33:15.120643 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349298e2-8247-4ed3-978c-a3b0992e0a5f admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:33:15.132579 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349298e2-8247-4ed3-978c-a3b0992e0a5f admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:33:15.203806 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3933e8-8e92-496a-8c2e-0f37f6dc7f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:33:15.204330 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3933e8-8e92-496a-8c2e-0f37f6dc7f79 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:33:15.204609 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3933e8-8e92-496a-8c2e-0f37f6dc7f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:33:15.204879 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3933e8-8e92-496a-8c2e-0f37f6dc7f79 admin admin] PATH_INFO: `/v3/users` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:33:15.205526 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3933e8-8e92-496a-8c2e-0f37f6dc7f79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:33:15.207573 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3933e8-8e92-496a-8c2e-0f37f6dc7f79 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:33:15.231781 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1434/2881] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:33:15 2022] POST /identity/v3/users => generated 299 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:33:15.238022 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581bdfb-577e-4649-8082-4e7023e8734e admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:33:15.250678 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581bdfb-577e-4649-8082-4e7023e8734e admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:33:15.255735 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abbefa-940f-4854-b453-2f72fc1a5743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:33:15.256356 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abbefa-940f-4854-b453-2f72fc1a5743 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:33:15.256624 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abbefa-940f-4854-b453-2f72fc1a5743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:33:15.256893 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abbefa-940f-4854-b453-2f72fc1a5743 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:33:15.258114 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86abbefa-940f-4854-b453-2f72fc1a5743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:33:15.259758 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86abbefa-940f-4854-b453-2f72fc1a5743 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:33:15.270626 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1448/2882] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:33:15.277577 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3933e8-8e92-496a-8c2e-0f37f6dc7f79 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:33:15.289314 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3933e8-8e92-496a-8c2e-0f37f6dc7f79 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:33:15.294260 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eceb515-7340-4f28-a563-6d3cf4d6873c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:33:15.294926 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eceb515-7340-4f28-a563-6d3cf4d6873c admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:33:15.295204 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eceb515-7340-4f28-a563-6d3cf4d6873c admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:33:15.295474 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eceb515-7340-4f28-a563-6d3cf4d6873c admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:33:15.296139 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eceb515-7340-4f28-a563-6d3cf4d6873c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:33:15.297767 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eceb515-7340-4f28-a563-6d3cf4d6873c admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:33:15.311494 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1435/2883] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:33:15.316315 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abbefa-940f-4854-b453-2f72fc1a5743 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:33:15.336335 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abbefa-940f-4854-b453-2f72fc1a5743 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:33:15.345008 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3902b5-2085-45d7-b1b0-7e5d3d6f675d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:33:15.346173 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3902b5-2085-45d7-b1b0-7e5d3d6f675d admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:33:15.346712 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3902b5-2085-45d7-b1b0-7e5d3d6f675d admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:33:15.347206 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3902b5-2085-45d7-b1b0-7e5d3d6f675d admin admin] PATH_INFO: `/v3/projects/a75af3ad8b8c4c2793054a8c66fb959e/users/a8bd34df3aee48c294002dee8cabcf9c/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:33:15.376323 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3902b5-2085-45d7-b1b0-7e5d3d6f675d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a75af3ad8b8c4c2793054a8c66fb959e, user_id=a8bd34df3aee48c294002dee8cabcf9c, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:33:15.381641 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3902b5-2085-45d7-b1b0-7e5d3d6f675d admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:33:15.400707 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1449/2884] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:33:15 2022] PUT /identity/v3/projects/a75af3ad8b8c4c2793054a8c66fb959e/users/a8bd34df3aee48c294002dee8cabcf9c/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:33:15.471989 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b38f9-31f6-4293-81fe-34133f10291e None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:33:15.472238 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b38f9-31f6-4293-81fe-34133f10291e None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:33:15.472522 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b38f9-31f6-4293-81fe-34133f10291e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:33:15.509296 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-871b38f9-31f6-4293-81fe-34133f10291e None None] MFA Rules not processed for user `a8bd34df3aee48c294002dee8cabcf9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:33:15.510846 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-871b38f9-31f6-4293-81fe-34133f10291e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:33:15.593424 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1436/2885] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:33:15 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:33:15.606118 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3902b5-2085-45d7-b1b0-7e5d3d6f675d admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:33:15.607954 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-fe3902b5-2085-45d7-b1b0-7e5d3d6f675d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:33:15.639473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:33:15.687669 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3902b5-2085-45d7-b1b0-7e5d3d6f675d admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:33:15.691535 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b397481-f63f-487a-8447-13e43095d768 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b44dd2471684d358018f36ec0afc063', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:33:15.692135 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b397481-f63f-487a-8447-13e43095d768 service cinder] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:33:15.692409 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b397481-f63f-487a-8447-13e43095d768 service cinder] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:33:15.692793 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b397481-f63f-487a-8447-13e43095d768 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:33:15.703383 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b397481-f63f-487a-8447-13e43095d768 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:33:15.705181 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b397481-f63f-487a-8447-13e43095d768 service cinder] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:33:15.717015 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1450/2886] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:33:15 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:33:21.130851 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b38f9-31f6-4293-81fe-34133f10291e None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:33:21.154429 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:33:21.209236 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b38f9-31f6-4293-81fe-34133f10291e None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:33:21.214629 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3061e0-2567-4de8-945e-de386c344e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:33:21.215290 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3061e0-2567-4de8-945e-de386c344e54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:33:21.215570 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3061e0-2567-4de8-945e-de386c344e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:33:21.215840 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3061e0-2567-4de8-945e-de386c344e54 admin admin] PATH_INFO: `/v3/users/a8bd34df3aee48c294002dee8cabcf9c` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:33:21.217047 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3061e0-2567-4de8-945e-de386c344e54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8bd34df3aee48c294002dee8cabcf9c)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:33:21.219042 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3061e0-2567-4de8-945e-de386c344e54 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:33:21.285164 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-ac3061e0-2567-4de8-945e-de386c344e54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8bd34df3aee48c294002dee8cabcf9c'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:33:21.300522 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-ac3061e0-2567-4de8-945e-de386c344e54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8bd34df3aee48c294002dee8cabcf9c'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:33:21.309186 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-ac3061e0-2567-4de8-945e-de386c344e54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8bd34df3aee48c294002dee8cabcf9c'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:33:21.309857 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-ac3061e0-2567-4de8-945e-de386c344e54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8bd34df3aee48c294002dee8cabcf9c'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:33:21.317807 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-ac3061e0-2567-4de8-945e-de386c344e54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8bd34df3aee48c294002dee8cabcf9c'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:33:21.325879 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1437/2887] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:33:21 2022] DELETE /identity/v3/users/a8bd34df3aee48c294002dee8cabcf9c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:33:21.331080 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c39524-a0c2-4084-ac90-381d6f7dfe6e None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:33:21.331681 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c39524-a0c2-4084-ac90-381d6f7dfe6e None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:33:21.331832 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c39524-a0c2-4084-ac90-381d6f7dfe6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:33:21.354802 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-d5c39524-a0c2-4084-ac90-381d6f7dfe6e None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:33:21.356069 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d5c39524-a0c2-4084-ac90-381d6f7dfe6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:33:21.452771 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1451/2888] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:33:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:33:21.464618 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3061e0-2567-4de8-945e-de386c344e54 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:33:21.466462 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-ac3061e0-2567-4de8-945e-de386c344e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:33:21.540077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3061e0-2567-4de8-945e-de386c344e54 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:33:21.543883 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b672f17-81e2-49b1-a1fe-47eeacf2d2ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:33:21.544507 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b672f17-81e2-49b1-a1fe-47eeacf2d2ed service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:33:21.544787 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b672f17-81e2-49b1-a1fe-47eeacf2d2ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:33:21.545059 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b672f17-81e2-49b1-a1fe-47eeacf2d2ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:33:21.556849 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b672f17-81e2-49b1-a1fe-47eeacf2d2ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:33:21.558335 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b672f17-81e2-49b1-a1fe-47eeacf2d2ed service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:33:21.569327 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1438/2889] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:33:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:33:21.901065 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c39524-a0c2-4084-ac90-381d6f7dfe6e None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:33:21.903664 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d5c39524-a0c2-4084-ac90-381d6f7dfe6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:33:21.923588 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c39524-a0c2-4084-ac90-381d6f7dfe6e None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:33:21.931208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21461ff9-006e-428d-97dc-7bf34611189a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:33:21.932746 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21461ff9-006e-428d-97dc-7bf34611189a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:33:21.933239 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21461ff9-006e-428d-97dc-7bf34611189a admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:33:21.933780 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21461ff9-006e-428d-97dc-7bf34611189a admin admin] PATH_INFO: `/v3/projects/a75af3ad8b8c4c2793054a8c66fb959e` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:33:21.936325 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21461ff9-006e-428d-97dc-7bf34611189a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a75af3ad8b8c4c2793054a8c66fb959e)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:33:21.940138 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21461ff9-006e-428d-97dc-7bf34611189a admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:33:22.016655 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-21461ff9-006e-428d-97dc-7bf34611189a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a75af3ad8b8c4c2793054a8c66fb959e', 'request_id': 'req-21461ff9-006e-428d-97dc-7bf34611189a'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:33:22.026955 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-21461ff9-006e-428d-97dc-7bf34611189a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a75af3ad8b8c4c2793054a8c66fb959e', 'request_id': 'req-21461ff9-006e-428d-97dc-7bf34611189a'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:33:22.034022 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-21461ff9-006e-428d-97dc-7bf34611189a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a75af3ad8b8c4c2793054a8c66fb959e', 'request_id': 'req-21461ff9-006e-428d-97dc-7bf34611189a'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:33:22.048085 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-21461ff9-006e-428d-97dc-7bf34611189a admin admin] The token cache is being invalidate because project a75af3ad8b8c4c2793054a8c66fb959e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:33:22.048400 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-21461ff9-006e-428d-97dc-7bf34611189a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:33:22.049088 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-21461ff9-006e-428d-97dc-7bf34611189a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:33:22.050697 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1452/2890] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:33:21 2022] DELETE /identity/v3/projects/a75af3ad8b8c4c2793054a8c66fb959e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:33:31.564445 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:33:32.044596 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:33:33.196882 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb99a0-c38e-46eb-8df4-776ad70a327a None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:33:33.197573 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb99a0-c38e-46eb-8df4-776ad70a327a None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:33:33.197573 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb99a0-c38e-46eb-8df4-776ad70a327a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:33:33.222850 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-99cb99a0-c38e-46eb-8df4-776ad70a327a None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:33:33.224871 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-99cb99a0-c38e-46eb-8df4-776ad70a327a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:33:33.305219 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1439/2891] 10.222.0.76 () {58 vars in 1016 bytes} [Wed Sep 21 12:33:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:33:33.331143 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21461ff9-006e-428d-97dc-7bf34611189a admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:33:33.333061 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-21461ff9-006e-428d-97dc-7bf34611189a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:33:33.422174 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21461ff9-006e-428d-97dc-7bf34611189a admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:33:33.428020 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c401cdf-92cf-4b01-977e-9076b40ea1ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:33:33.429198 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c401cdf-92cf-4b01-977e-9076b40ea1ee service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:33:33.429473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c401cdf-92cf-4b01-977e-9076b40ea1ee service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:33:33.429747 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c401cdf-92cf-4b01-977e-9076b40ea1ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:33:33.439038 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c401cdf-92cf-4b01-977e-9076b40ea1ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:33:33.440687 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c401cdf-92cf-4b01-977e-9076b40ea1ee service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:33:33.453494 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1453/2892] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:33:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:33:37.312435 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fd6ff-d567-474a-9b69-a12dedab0f4b None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:33:37.313047 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fd6ff-d567-474a-9b69-a12dedab0f4b None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:33:37.313047 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fd6ff-d567-474a-9b69-a12dedab0f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:33:37.334993 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-994fd6ff-d567-474a-9b69-a12dedab0f4b None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:33:37.336266 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-994fd6ff-d567-474a-9b69-a12dedab0f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:33:37.345377 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1440/2893] 10.222.0.76 () {58 vars in 1016 bytes} [Wed Sep 21 12:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:33:37.365797 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c401cdf-92cf-4b01-977e-9076b40ea1ee service nova] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:33:37.367861 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-1c401cdf-92cf-4b01-977e-9076b40ea1ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:33:37.383809 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c401cdf-92cf-4b01-977e-9076b40ea1ee service nova] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:33:37.389603 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559d9f8-8390-48ba-9a31-f2949b3f3901 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:33:37.390228 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559d9f8-8390-48ba-9a31-f2949b3f3901 service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:33:37.390554 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559d9f8-8390-48ba-9a31-f2949b3f3901 service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:33:37.390826 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559d9f8-8390-48ba-9a31-f2949b3f3901 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:33:37.401467 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d559d9f8-8390-48ba-9a31-f2949b3f3901 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:33:37.403220 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d559d9f8-8390-48ba-9a31-f2949b3f3901 service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:33:37.414908 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1454/2894] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:33:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:33:40.605971 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd449e94-2555-4c1f-89d5-ba0f1ea39f77 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:33:40.606890 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd449e94-2555-4c1f-89d5-ba0f1ea39f77 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:33:40.607083 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd449e94-2555-4c1f-89d5-ba0f1ea39f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:33:40.628762 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-bd449e94-2555-4c1f-89d5-ba0f1ea39f77 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:33:40.630033 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-bd449e94-2555-4c1f-89d5-ba0f1ea39f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:33:40.638869 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1441/2895] 10.222.0.76 () {58 vars in 1016 bytes} [Wed Sep 21 12:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:33:40.664290 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559d9f8-8390-48ba-9a31-f2949b3f3901 service nova] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:33:40.680632 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559d9f8-8390-48ba-9a31-f2949b3f3901 service nova] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:33:40.691045 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf3084-7aff-4113-80b2-39f19a625707 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:33:40.692096 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf3084-7aff-4113-80b2-39f19a625707 service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:33:40.692595 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf3084-7aff-4113-80b2-39f19a625707 service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:33:40.693080 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf3084-7aff-4113-80b2-39f19a625707 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:33:40.709045 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf3084-7aff-4113-80b2-39f19a625707 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:33:40.712616 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf3084-7aff-4113-80b2-39f19a625707 service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:33:40.731972 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1455/2896] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:33:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:33:44.753288 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5734726-82ff-4da0-a425-e7361f6bcc5b None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:33:44.754102 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5734726-82ff-4da0-a425-e7361f6bcc5b None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:33:44.754102 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5734726-82ff-4da0-a425-e7361f6bcc5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:33:44.779455 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-d5734726-82ff-4da0-a425-e7361f6bcc5b None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:33:44.781604 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-d5734726-82ff-4da0-a425-e7361f6bcc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:33:44.796394 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1442/2897] 10.222.0.76 () {58 vars in 1016 bytes} [Wed Sep 21 12:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:33:44.818674 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf3084-7aff-4113-80b2-39f19a625707 service nova] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:33:44.841129 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf3084-7aff-4113-80b2-39f19a625707 service nova] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:33:44.851752 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589376ab-23b9-4e4c-88b1-a7b440bfe460 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:33:44.852811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589376ab-23b9-4e4c-88b1-a7b440bfe460 service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:33:44.853303 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589376ab-23b9-4e4c-88b1-a7b440bfe460 service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:33:44.853801 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589376ab-23b9-4e4c-88b1-a7b440bfe460 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:33:44.870606 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589376ab-23b9-4e4c-88b1-a7b440bfe460 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:33:44.873705 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589376ab-23b9-4e4c-88b1-a7b440bfe460 service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:33:44.895338 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1456/2898] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:33:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:33:48.982903 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc2eb7-7a08-4ecb-964c-1df5c04fa180 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:33:48.983572 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc2eb7-7a08-4ecb-964c-1df5c04fa180 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:33:48.983572 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc2eb7-7a08-4ecb-964c-1df5c04fa180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:33:49.008261 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-f6bc2eb7-7a08-4ecb-964c-1df5c04fa180 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:33:49.009560 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-f6bc2eb7-7a08-4ecb-964c-1df5c04fa180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:33:49.018330 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1443/2899] 10.222.0.76 () {58 vars in 1016 bytes} [Wed Sep 21 12:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:33:49.042303 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589376ab-23b9-4e4c-88b1-a7b440bfe460 service nova] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:33:49.055455 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589376ab-23b9-4e4c-88b1-a7b440bfe460 service nova] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:33:49.061625 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1cc064-6607-4d7d-b01a-d3b7621b8b64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:33:49.062421 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1cc064-6607-4d7d-b01a-d3b7621b8b64 service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:33:49.062759 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1cc064-6607-4d7d-b01a-d3b7621b8b64 service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:33:49.063073 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1cc064-6607-4d7d-b01a-d3b7621b8b64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:33:49.073566 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1cc064-6607-4d7d-b01a-d3b7621b8b64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:33:49.075447 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1cc064-6607-4d7d-b01a-d3b7621b8b64 service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:33:49.087116 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1457/2900] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:33:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:33:53.216646 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb682ac-04f0-4512-8ed2-98e72d0ede7b None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:33:53.217349 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb682ac-04f0-4512-8ed2-98e72d0ede7b None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:33:53.217349 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb682ac-04f0-4512-8ed2-98e72d0ede7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:33:53.242552 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-5eb682ac-04f0-4512-8ed2-98e72d0ede7b None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:33:53.243861 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-5eb682ac-04f0-4512-8ed2-98e72d0ede7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:33:53.252405 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1444/2901] 10.222.0.76 () {58 vars in 1016 bytes} [Wed Sep 21 12:33:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:33:53.276898 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1cc064-6607-4d7d-b01a-d3b7621b8b64 service nova] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:33:53.290545 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1cc064-6607-4d7d-b01a-d3b7621b8b64 service nova] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:33:53.296997 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a92db-3be8-48b9-a0d2-8ee761dcc6f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:33:53.297670 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a92db-3be8-48b9-a0d2-8ee761dcc6f8 service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:33:53.298004 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a92db-3be8-48b9-a0d2-8ee761dcc6f8 service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:33:53.298333 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a92db-3be8-48b9-a0d2-8ee761dcc6f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:33:53.310123 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a92db-3be8-48b9-a0d2-8ee761dcc6f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:33:53.312361 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a92db-3be8-48b9-a0d2-8ee761dcc6f8 service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:33:53.324173 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1458/2902] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:33:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:34:03.235747 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=42 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:34:03.319248 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=64 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:34:08.884338 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f460b9f-e137-415a-a728-4121e93859ab None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:34:08.884995 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f460b9f-e137-415a-a728-4121e93859ab None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:34:08.884995 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f460b9f-e137-415a-a728-4121e93859ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:34:08.905995 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-2f460b9f-e137-415a-a728-4121e93859ab None None] MFA Rules not processed for user `dabf3589a0104097a8365b44b4753105`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:34:08.907282 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-2f460b9f-e137-415a-a728-4121e93859ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:34:08.975408 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1445/2903] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:34:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:34:09.245547 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a92db-3be8-48b9-a0d2-8ee761dcc6f8 service nova] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:34:09.247273 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-c02a92db-3be8-48b9-a0d2-8ee761dcc6f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:34:09.319506 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a92db-3be8-48b9-a0d2-8ee761dcc6f8 service nova] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:34:09.323440 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62464690-42ff-4275-92b5-7f9318472ed7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:34:09.324072 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62464690-42ff-4275-92b5-7f9318472ed7 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:34:09.324354 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62464690-42ff-4275-92b5-7f9318472ed7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:34:09.324633 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62464690-42ff-4275-92b5-7f9318472ed7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:34:09.327124 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-62464690-42ff-4275-92b5-7f9318472ed7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:34:09.338192 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62464690-42ff-4275-92b5-7f9318472ed7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:34:09.339717 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62464690-42ff-4275-92b5-7f9318472ed7 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:34:09.350379 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1459/2904] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:34:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:34:18.966035 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=25 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:34:19.345075 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=26 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:34:19.605422 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f460b9f-e137-415a-a728-4121e93859ab None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:34:19.621142 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f460b9f-e137-415a-a728-4121e93859ab None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:34:19.633524 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55170ce0-945f-467e-848b-1e10b957d992 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:34:19.634158 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55170ce0-945f-467e-848b-1e10b957d992 service nova] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:34:19.634478 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55170ce0-945f-467e-848b-1e10b957d992 service nova] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:34:19.634748 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55170ce0-945f-467e-848b-1e10b957d992 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:34:19.636594 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-55170ce0-945f-467e-848b-1e10b957d992 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:34:19.654531 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55170ce0-945f-467e-848b-1e10b957d992 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:34:19.656420 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55170ce0-945f-467e-848b-1e10b957d992 service nova] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:34:19.671304 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1446/2905] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:34:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:34:24.741423 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45bd15-bb35-493e-8770-0b53b7386100 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:34:24.742233 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45bd15-bb35-493e-8770-0b53b7386100 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:34:24.742233 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45bd15-bb35-493e-8770-0b53b7386100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:34:24.763194 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-ec45bd15-bb35-493e-8770-0b53b7386100 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:34:24.764453 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ec45bd15-bb35-493e-8770-0b53b7386100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:34:24.772835 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1460/2906] 10.222.0.76 () {58 vars in 1016 bytes} [Wed Sep 21 12:34:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:34:24.794635 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55170ce0-945f-467e-848b-1e10b957d992 service nova] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:34:24.807864 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55170ce0-945f-467e-848b-1e10b957d992 service nova] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:34:24.814143 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca0831-8a11-40f6-8fd7-aac37d99f583 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:34:24.814957 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca0831-8a11-40f6-8fd7-aac37d99f583 service nova] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:34:24.815274 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca0831-8a11-40f6-8fd7-aac37d99f583 service nova] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:34:24.815593 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca0831-8a11-40f6-8fd7-aac37d99f583 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:34:24.825871 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca0831-8a11-40f6-8fd7-aac37d99f583 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:34:24.827526 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca0831-8a11-40f6-8fd7-aac37d99f583 service nova] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:34:24.839049 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1447/2907] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:34:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:34:28.059834 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1ae4a-a7c8-4da7-8d90-d500cbf4c6cd None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:34:28.060515 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1ae4a-a7c8-4da7-8d90-d500cbf4c6cd None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:34:28.060515 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1ae4a-a7c8-4da7-8d90-d500cbf4c6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:34:28.083776 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-8ab1ae4a-a7c8-4da7-8d90-d500cbf4c6cd None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:34:28.085022 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-8ab1ae4a-a7c8-4da7-8d90-d500cbf4c6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:34:28.094111 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1461/2908] 10.222.0.76 () {58 vars in 1016 bytes} [Wed Sep 21 12:34:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:34:28.115641 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca0831-8a11-40f6-8fd7-aac37d99f583 service nova] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:34:28.128096 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca0831-8a11-40f6-8fd7-aac37d99f583 service nova] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:34:28.134449 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581aa42e-7495-4d27-b190-31bc46ce4951 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:34:28.135078 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581aa42e-7495-4d27-b190-31bc46ce4951 service nova] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:34:28.135357 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581aa42e-7495-4d27-b190-31bc46ce4951 service nova] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:34:28.135630 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581aa42e-7495-4d27-b190-31bc46ce4951 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:34:28.145830 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581aa42e-7495-4d27-b190-31bc46ce4951 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:34:28.147499 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581aa42e-7495-4d27-b190-31bc46ce4951 service nova] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:34:28.159221 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1448/2909] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:34:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:34:31.194934 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3904ffd-d2d6-4e10-a07f-8bc90f04ba0b None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:34:31.195606 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3904ffd-d2d6-4e10-a07f-8bc90f04ba0b None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:34:31.195606 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3904ffd-d2d6-4e10-a07f-8bc90f04ba0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:34:31.218657 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-d3904ffd-d2d6-4e10-a07f-8bc90f04ba0b None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:34:31.220000 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d3904ffd-d2d6-4e10-a07f-8bc90f04ba0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:34:31.229290 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1462/2910] 10.222.0.76 () {58 vars in 1016 bytes} [Wed Sep 21 12:34:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:34:31.251617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581aa42e-7495-4d27-b190-31bc46ce4951 service nova] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:34:31.265217 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581aa42e-7495-4d27-b190-31bc46ce4951 service nova] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:34:31.272339 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efce61-c1ab-4ec9-8f3b-2b645a0eaa2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:34:31.272874 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efce61-c1ab-4ec9-8f3b-2b645a0eaa2f service nova] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:34:31.273163 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efce61-c1ab-4ec9-8f3b-2b645a0eaa2f service nova] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:34:31.273431 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efce61-c1ab-4ec9-8f3b-2b645a0eaa2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:34:31.283174 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56efce61-c1ab-4ec9-8f3b-2b645a0eaa2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:34:31.284783 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56efce61-c1ab-4ec9-8f3b-2b645a0eaa2f service nova] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:34:31.296118 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1449/2911] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:34:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:34:34.383132 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e10ba-b5cf-4198-9e96-7ea162af56f4 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:34:34.383923 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e10ba-b5cf-4198-9e96-7ea162af56f4 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:34:34.383923 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e10ba-b5cf-4198-9e96-7ea162af56f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:34:34.407613 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-ec8e10ba-b5cf-4198-9e96-7ea162af56f4 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:34:34.408885 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-ec8e10ba-b5cf-4198-9e96-7ea162af56f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:34:34.418575 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1463/2912] 10.222.0.76 () {58 vars in 1016 bytes} [Wed Sep 21 12:34:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:34:34.444488 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efce61-c1ab-4ec9-8f3b-2b645a0eaa2f service nova] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:34:34.457149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efce61-c1ab-4ec9-8f3b-2b645a0eaa2f service nova] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:34:34.463467 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c4c5a-8341-4f67-b122-300968f444e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:34:34.464242 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c4c5a-8341-4f67-b122-300968f444e0 service nova] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:34:34.464561 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c4c5a-8341-4f67-b122-300968f444e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:34:34.464871 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c4c5a-8341-4f67-b122-300968f444e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:34:34.475842 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c4c5a-8341-4f67-b122-300968f444e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:34:34.477718 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c4c5a-8341-4f67-b122-300968f444e0 service nova] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:34:34.490257 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1450/2913] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:34:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:34:38.611398 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d2979-d1dc-454b-b92d-859a23e49d56 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:34:38.612333 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d2979-d1dc-454b-b92d-859a23e49d56 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:34:38.612333 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d2979-d1dc-454b-b92d-859a23e49d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:34:38.634726 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-883d2979-d1dc-454b-b92d-859a23e49d56 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:34:38.635984 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-883d2979-d1dc-454b-b92d-859a23e49d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:34:38.645041 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1464/2914] 10.222.0.76 () {58 vars in 1016 bytes} [Wed Sep 21 12:34:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:34:38.671992 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c4c5a-8341-4f67-b122-300968f444e0 service nova] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:34:38.686748 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c4c5a-8341-4f67-b122-300968f444e0 service nova] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:34:38.693993 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2afb85-393e-4337-bf0c-2c140c0d244d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:34:38.694654 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2afb85-393e-4337-bf0c-2c140c0d244d service nova] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:34:38.694938 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2afb85-393e-4337-bf0c-2c140c0d244d service nova] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:34:38.695211 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2afb85-393e-4337-bf0c-2c140c0d244d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:34:38.704617 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2afb85-393e-4337-bf0c-2c140c0d244d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:34:38.706236 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2afb85-393e-4337-bf0c-2c140c0d244d service nova] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:34:38.717334 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1451/2915] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:34:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:34:48.628758 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=15 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:34:48.712279 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=36 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:35:10.242918 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d2979-d1dc-454b-b92d-859a23e49d56 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:35:10.244919 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-883d2979-d1dc-454b-b92d-859a23e49d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:35:10.258183 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d2979-d1dc-454b-b92d-859a23e49d56 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:35:10.263615 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb6efc-f8a3-4a89-8fde-0041edd627fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:35:10.264281 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb6efc-f8a3-4a89-8fde-0041edd627fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:35:10.264565 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb6efc-f8a3-4a89-8fde-0041edd627fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:35:10.264834 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb6efc-f8a3-4a89-8fde-0041edd627fc admin admin] PATH_INFO: `/v3/users/dabf3589a0104097a8365b44b4753105` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:35:10.266105 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eb6efc-f8a3-4a89-8fde-0041edd627fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=dabf3589a0104097a8365b44b4753105)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:35:10.268021 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eb6efc-f8a3-4a89-8fde-0041edd627fc admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:35:10.329195 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f1eb6efc-f8a3-4a89-8fde-0041edd627fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dabf3589a0104097a8365b44b4753105'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:35:10.341008 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f1eb6efc-f8a3-4a89-8fde-0041edd627fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dabf3589a0104097a8365b44b4753105'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:35:10.367327 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f1eb6efc-f8a3-4a89-8fde-0041edd627fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dabf3589a0104097a8365b44b4753105'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:35:10.368244 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f1eb6efc-f8a3-4a89-8fde-0041edd627fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dabf3589a0104097a8365b44b4753105'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:35:10.381220 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f1eb6efc-f8a3-4a89-8fde-0041edd627fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dabf3589a0104097a8365b44b4753105'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:35:10.392390 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1465/2916] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:35:10 2022] DELETE /identity/v3/users/dabf3589a0104097a8365b44b4753105 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:35:10.608789 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2afb85-393e-4337-bf0c-2c140c0d244d service nova] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:35:10.629971 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2afb85-393e-4337-bf0c-2c140c0d244d service nova] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:35:10.707609 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a8f84-4375-484b-87d0-41b129979a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:35:10.708362 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a8f84-4375-484b-87d0-41b129979a86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:35:10.708730 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a8f84-4375-484b-87d0-41b129979a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:35:10.709200 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a8f84-4375-484b-87d0-41b129979a86 admin admin] PATH_INFO: `/v3/projects/5d821f884b184eca9c05bb67cce66bc3` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:35:10.710756 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a8f84-4375-484b-87d0-41b129979a86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d821f884b184eca9c05bb67cce66bc3)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:35:10.712802 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a8f84-4375-484b-87d0-41b129979a86 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:35:10.782562 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-e41a8f84-4375-484b-87d0-41b129979a86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d821f884b184eca9c05bb67cce66bc3', 'request_id': 'req-e41a8f84-4375-484b-87d0-41b129979a86'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:35:10.792167 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-e41a8f84-4375-484b-87d0-41b129979a86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d821f884b184eca9c05bb67cce66bc3', 'request_id': 'req-e41a8f84-4375-484b-87d0-41b129979a86'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:35:10.799169 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-e41a8f84-4375-484b-87d0-41b129979a86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d821f884b184eca9c05bb67cce66bc3', 'request_id': 'req-e41a8f84-4375-484b-87d0-41b129979a86'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:35:10.812613 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-e41a8f84-4375-484b-87d0-41b129979a86 admin admin] The token cache is being invalidate because project 5d821f884b184eca9c05bb67cce66bc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81377) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:35:10.812956 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-e41a8f84-4375-484b-87d0-41b129979a86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:35:10.813834 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-e41a8f84-4375-484b-87d0-41b129979a86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:35:10.816447 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1452/2917] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:35:10 2022] DELETE /identity/v3/projects/5d821f884b184eca9c05bb67cce66bc3 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:35:10.822503 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b418c75-c52c-4c64-a690-ea6223d5a1e2 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:35:10.822965 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b418c75-c52c-4c64-a690-ea6223d5a1e2 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:35:10.823457 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b418c75-c52c-4c64-a690-ea6223d5a1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:35:10.849294 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-4b418c75-c52c-4c64-a690-ea6223d5a1e2 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:35:10.850636 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-4b418c75-c52c-4c64-a690-ea6223d5a1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:35:10.925298 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1466/2918] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:35:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:35:10.936870 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a81f8-805b-4126-97a9-fa3f74b000d8 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:35:10.937316 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a81f8-805b-4126-97a9-fa3f74b000d8 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:35:10.937757 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a81f8-805b-4126-97a9-fa3f74b000d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:35:10.972263 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-1b3a81f8-805b-4126-97a9-fa3f74b000d8 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:35:10.974477 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-1b3a81f8-805b-4126-97a9-fa3f74b000d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:35:10.988911 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1453/2919] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:35:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:35:10.994735 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b418c75-c52c-4c64-a690-ea6223d5a1e2 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:35:11.006780 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b418c75-c52c-4c64-a690-ea6223d5a1e2 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:35:11.012454 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47577fca-8ace-4bef-9a30-fe6aa5c1f29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:35:11.013156 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47577fca-8ace-4bef-9a30-fe6aa5c1f29e admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:35:11.013482 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47577fca-8ace-4bef-9a30-fe6aa5c1f29e admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:35:11.013800 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47577fca-8ace-4bef-9a30-fe6aa5c1f29e admin admin] PATH_INFO: `/v3/domains` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:35:11.014637 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47577fca-8ace-4bef-9a30-fe6aa5c1f29e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81378) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 21 12:35:11.015011 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47577fca-8ace-4bef-9a30-fe6aa5c1f29e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:35:11.016893 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47577fca-8ace-4bef-9a30-fe6aa5c1f29e admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:35:11.031694 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1467/2920] 10.222.0.60 () {58 vars in 1153 bytes} [Wed Sep 21 12:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 21 12:35:11.039581 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a81f8-805b-4126-97a9-fa3f74b000d8 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:35:11.056378 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a81f8-805b-4126-97a9-fa3f74b000d8 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:35:11.062461 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f7a61-992f-4542-9823-e42582a43e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:35:11.063119 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f7a61-992f-4542-9823-e42582a43e52 admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:35:11.063404 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f7a61-992f-4542-9823-e42582a43e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:35:11.063720 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f7a61-992f-4542-9823-e42582a43e52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:35:11.064373 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f7a61-992f-4542-9823-e42582a43e52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:35:11.066963 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f7a61-992f-4542-9823-e42582a43e52 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:35:11.105885 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1454/2921] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:35:11 2022] POST /identity/v3/projects => generated 381 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:35:11.111619 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47577fca-8ace-4bef-9a30-fe6aa5c1f29e admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:35:11.124484 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47577fca-8ace-4bef-9a30-fe6aa5c1f29e admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:35:11.198636 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b7209-4f90-40ac-a3c7-252903325622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:35:11.199343 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b7209-4f90-40ac-a3c7-252903325622 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:35:11.199627 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b7209-4f90-40ac-a3c7-252903325622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:35:11.199944 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b7209-4f90-40ac-a3c7-252903325622 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:35:11.200686 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09b7209-4f90-40ac-a3c7-252903325622 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:35:11.202804 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09b7209-4f90-40ac-a3c7-252903325622 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:35:11.213085 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:35:11.232003 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1468/2922] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:35:11 2022] POST /identity/v3/users => generated 291 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 21 12:35:11.236579 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f7a61-992f-4542-9823-e42582a43e52 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:35:11.249186 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f7a61-992f-4542-9823-e42582a43e52 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:35:11.255096 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a4a3e-f738-4860-8e9e-74eeb6c7a1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:35:11.255875 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a4a3e-f738-4860-8e9e-74eeb6c7a1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:35:11.256488 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a4a3e-f738-4860-8e9e-74eeb6c7a1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:35:11.256987 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a4a3e-f738-4860-8e9e-74eeb6c7a1a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:35:11.257767 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a4a3e-f738-4860-8e9e-74eeb6c7a1a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:35:11.259735 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a4a3e-f738-4860-8e9e-74eeb6c7a1a8 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:35:11.271698 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1455/2923] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:35:11.276656 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b7209-4f90-40ac-a3c7-252903325622 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:35:11.294305 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b7209-4f90-40ac-a3c7-252903325622 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:35:11.305712 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c3b14-400f-4ab9-80cc-ea2601a92212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:35:11.306379 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c3b14-400f-4ab9-80cc-ea2601a92212 admin admin] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:35:11.306667 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c3b14-400f-4ab9-80cc-ea2601a92212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:35:11.306938 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c3b14-400f-4ab9-80cc-ea2601a92212 admin admin] PATH_INFO: `/v3/roles` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:35:11.307597 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c3b14-400f-4ab9-80cc-ea2601a92212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:35:11.309230 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c3b14-400f-4ab9-80cc-ea2601a92212 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:35:11.322107 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1469/2924] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:35:11.327442 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a4a3e-f738-4860-8e9e-74eeb6c7a1a8 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:35:11.338035 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a4a3e-f738-4860-8e9e-74eeb6c7a1a8 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:35:11.343226 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f2e1b-2533-440c-945f-fdfb09143326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:35:11.343794 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f2e1b-2533-440c-945f-fdfb09143326 admin admin] REQUEST_METHOD: `PUT` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:35:11.344072 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f2e1b-2533-440c-945f-fdfb09143326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:35:11.344338 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f2e1b-2533-440c-945f-fdfb09143326 admin admin] PATH_INFO: `/v3/projects/c380018464db4bc89702ada14ffc8740/users/eda5880172f64decbab6c27c9026eab4/roles/9712f7b332bf484689b3706721ab6311` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:35:11.361156 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f2e1b-2533-440c-945f-fdfb09143326 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c380018464db4bc89702ada14ffc8740, user_id=eda5880172f64decbab6c27c9026eab4, role_id=9712f7b332bf484689b3706721ab6311)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:35:11.364465 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f2e1b-2533-440c-945f-fdfb09143326 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:35:11.380582 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1456/2925] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:35:11 2022] PUT /identity/v3/projects/c380018464db4bc89702ada14ffc8740/users/eda5880172f64decbab6c27c9026eab4/roles/9712f7b332bf484689b3706721ab6311 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:35:11.386208 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e46ba-a6ba-49f2-ac00-c4cac5f6e551 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:35:11.386662 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e46ba-a6ba-49f2-ac00-c4cac5f6e551 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:35:11.387049 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e46ba-a6ba-49f2-ac00-c4cac5f6e551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:35:11.408852 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-d57e46ba-a6ba-49f2-ac00-c4cac5f6e551 None None] MFA Rules not processed for user `5ede9eacb91d469ab92c14848276a5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:35:11.410112 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d57e46ba-a6ba-49f2-ac00-c4cac5f6e551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:35:11.478621 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1470/2926] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:35:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:35:11.489173 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f2e1b-2533-440c-945f-fdfb09143326 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:35:11.491042 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-be3f2e1b-2533-440c-945f-fdfb09143326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:35:11.534869 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:35:11.584506 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f2e1b-2533-440c-945f-fdfb09143326 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:35:11.589606 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f5e6f-32c9-4351-b0e0-35f6440b1b70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:35:11.590445 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f5e6f-32c9-4351-b0e0-35f6440b1b70 service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:35:11.590856 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f5e6f-32c9-4351-b0e0-35f6440b1b70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:35:11.591230 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f5e6f-32c9-4351-b0e0-35f6440b1b70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:35:11.603871 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f5e6f-32c9-4351-b0e0-35f6440b1b70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:35:11.605584 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f5e6f-32c9-4351-b0e0-35f6440b1b70 service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:35:11.618285 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1457/2927] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:35:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:35:17.636926 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e61fa0-7efd-47ee-b954-77c753faba15 None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:35:17.637486 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e61fa0-7efd-47ee-b954-77c753faba15 None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:35:17.637906 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e61fa0-7efd-47ee-b954-77c753faba15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:35:17.673731 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-d5e61fa0-7efd-47ee-b954-77c753faba15 None None] MFA Rules not processed for user `eda5880172f64decbab6c27c9026eab4`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:35:17.675538 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-d5e61fa0-7efd-47ee-b954-77c753faba15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:35:17.759875 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1471/2928] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:35:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:35:17.766749 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f5e6f-32c9-4351-b0e0-35f6440b1b70 service neutron] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:35:17.786133 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f5e6f-32c9-4351-b0e0-35f6440b1b70 service neutron] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:35:17.794453 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8168ff8-eab4-4ea3-a53b-29def26bcecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:35:17.795521 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8168ff8-eab4-4ea3-a53b-29def26bcecb admin admin] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:35:17.796027 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8168ff8-eab4-4ea3-a53b-29def26bcecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:35:17.796534 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8168ff8-eab4-4ea3-a53b-29def26bcecb admin admin] PATH_INFO: `/v3/projects` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:35:17.797712 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8168ff8-eab4-4ea3-a53b-29def26bcecb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:35:17.802117 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8168ff8-eab4-4ea3-a53b-29def26bcecb admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:35:17.856679 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1458/2929] 10.222.0.60 () {60 vars in 1153 bytes} [Wed Sep 21 12:35:17 2022] POST /identity/v3/projects => generated 385 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:35:17.863027 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e61fa0-7efd-47ee-b954-77c753faba15 None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:35:17.875325 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e61fa0-7efd-47ee-b954-77c753faba15 None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:35:17.966271 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea149b-3d58-4efc-ba25-fc637f398328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:35:17.967056 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea149b-3d58-4efc-ba25-fc637f398328 admin admin] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:35:17.967338 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea149b-3d58-4efc-ba25-fc637f398328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:35:17.967619 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea149b-3d58-4efc-ba25-fc637f398328 admin admin] PATH_INFO: `/v3/users` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:35:17.968298 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ea149b-3d58-4efc-ba25-fc637f398328 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:35:17.970569 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ea149b-3d58-4efc-ba25-fc637f398328 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:35:17.990968 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:35:18.005945 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1472/2930] 10.222.0.60 () {60 vars in 1144 bytes} [Wed Sep 21 12:35:17 2022] POST /identity/v3/users => generated 299 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 21 12:35:18.007471 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8168ff8-eab4-4ea3-a53b-29def26bcecb admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:35:18.018863 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8168ff8-eab4-4ea3-a53b-29def26bcecb admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:35:18.024114 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18056e3d-e230-46e5-802c-dde806505f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:35:18.024779 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18056e3d-e230-46e5-802c-dde806505f95 admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:35:18.025189 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18056e3d-e230-46e5-802c-dde806505f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:35:18.025400 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18056e3d-e230-46e5-802c-dde806505f95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:35:18.025978 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18056e3d-e230-46e5-802c-dde806505f95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:35:18.027768 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18056e3d-e230-46e5-802c-dde806505f95 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:35:18.040735 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1459/2931] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 21 12:35:18.045412 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea149b-3d58-4efc-ba25-fc637f398328 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:35:18.056734 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea149b-3d58-4efc-ba25-fc637f398328 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:35:18.061631 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97759a5e-29c2-4884-907a-78c415bb4920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:35:18.062314 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97759a5e-29c2-4884-907a-78c415bb4920 admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:35:18.062623 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97759a5e-29c2-4884-907a-78c415bb4920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:35:18.062897 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97759a5e-29c2-4884-907a-78c415bb4920 admin admin] PATH_INFO: `/v3/projects/1393279e19db450e96aed728bfcaca1c/users/538558b8e980428c9318a8aa41d7bdbc/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:35:18.080091 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97759a5e-29c2-4884-907a-78c415bb4920 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1393279e19db450e96aed728bfcaca1c, user_id=538558b8e980428c9318a8aa41d7bdbc, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:35:18.082874 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97759a5e-29c2-4884-907a-78c415bb4920 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:35:18.098554 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1473/2932] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:35:18 2022] PUT /identity/v3/projects/1393279e19db450e96aed728bfcaca1c/users/538558b8e980428c9318a8aa41d7bdbc/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:35:18.102814 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18056e3d-e230-46e5-802c-dde806505f95 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:35:18.114467 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18056e3d-e230-46e5-802c-dde806505f95 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:35:18.186460 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf7b07-b123-47f2-b813-2440da1abadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:35:18.187096 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf7b07-b123-47f2-b813-2440da1abadc admin admin] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:35:18.187373 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf7b07-b123-47f2-b813-2440da1abadc admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:35:18.187645 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf7b07-b123-47f2-b813-2440da1abadc admin admin] PATH_INFO: `/v3/roles` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:35:18.188310 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf7b07-b123-47f2-b813-2440da1abadc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:35:18.189982 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf7b07-b123-47f2-b813-2440da1abadc admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:35:18.201715 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1460/2933] 10.222.0.60 () {58 vars in 1122 bytes} [Wed Sep 21 12:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 21 12:35:18.207108 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97759a5e-29c2-4884-907a-78c415bb4920 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:35:18.222956 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97759a5e-29c2-4884-907a-78c415bb4920 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:35:18.228074 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ff64b-3948-4ff3-94c0-9b773224d15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:35:18.228761 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ff64b-3948-4ff3-94c0-9b773224d15a admin admin] REQUEST_METHOD: `PUT` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:35:18.229046 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ff64b-3948-4ff3-94c0-9b773224d15a admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:35:18.229320 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ff64b-3948-4ff3-94c0-9b773224d15a admin admin] PATH_INFO: `/v3/projects/1393279e19db450e96aed728bfcaca1c/users/538558b8e980428c9318a8aa41d7bdbc/roles/72c80b472acb462ebadd86463efe91f7` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:35:18.231843 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ff64b-3948-4ff3-94c0-9b773224d15a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1393279e19db450e96aed728bfcaca1c, user_id=538558b8e980428c9318a8aa41d7bdbc, role_id=72c80b472acb462ebadd86463efe91f7)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:35:18.234581 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ff64b-3948-4ff3-94c0-9b773224d15a admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:35:18.248698 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1474/2934] 10.222.0.60 () {60 vars in 1483 bytes} [Wed Sep 21 12:35:18 2022] PUT /identity/v3/projects/1393279e19db450e96aed728bfcaca1c/users/538558b8e980428c9318a8aa41d7bdbc/roles/72c80b472acb462ebadd86463efe91f7 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:35:25.475868 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584db1a-f6e4-48d7-acda-f0fa678fb793 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:35:25.476696 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584db1a-f6e4-48d7-acda-f0fa678fb793 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:35:25.476855 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584db1a-f6e4-48d7-acda-f0fa678fb793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:35:25.527603 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-4584db1a-f6e4-48d7-acda-f0fa678fb793 None None] MFA Rules not processed for user `538558b8e980428c9318a8aa41d7bdbc`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:35:25.528985 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-4584db1a-f6e4-48d7-acda-f0fa678fb793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:35:25.652055 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1461/2935] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:35:25 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:35:25.667471 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ff64b-3948-4ff3-94c0-9b773224d15a admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:35:25.669572 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-247ff64b-3948-4ff3-94c0-9b773224d15a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:35:25.784209 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ff64b-3948-4ff3-94c0-9b773224d15a admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:35:25.788693 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcbbd06-fc43-44a4-9931-93082fb1eaae service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c513a6c91a0240de87c7b51b07617827', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:35:25.789474 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbbd06-fc43-44a4-9931-93082fb1eaae service glance] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:35:25.789928 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbbd06-fc43-44a4-9931-93082fb1eaae service glance] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:35:25.790301 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbbd06-fc43-44a4-9931-93082fb1eaae service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:35:25.880245 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcbbd06-fc43-44a4-9931-93082fb1eaae service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:35:25.883604 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcbbd06-fc43-44a4-9931-93082fb1eaae service glance] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:35:25.905116 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1475/2936] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:35:25 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:35:26.155609 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13388fb1-b489-45b3-89d5-62fba8c3fcac None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:35:26.155891 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13388fb1-b489-45b3-89d5-62fba8c3fcac None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:35:26.156176 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13388fb1-b489-45b3-89d5-62fba8c3fcac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:35:26.180211 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-13388fb1-b489-45b3-89d5-62fba8c3fcac None None] MFA Rules not processed for user `bbd7a1d5a8d04e3798ffcab27bad936b`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:35:26.181728 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-13388fb1-b489-45b3-89d5-62fba8c3fcac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:35:26.198897 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:35:26.258507 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1462/2937] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Sep 21 12:35:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:35:26.340161 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcbbd06-fc43-44a4-9931-93082fb1eaae service glance] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:35:26.342638 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-2dcbbd06-fc43-44a4-9931-93082fb1eaae service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:35:26.421424 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13388fb1-b489-45b3-89d5-62fba8c3fcac None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:35:26.422937 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-13388fb1-b489-45b3-89d5-62fba8c3fcac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:35:26.479547 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:35:26.499152 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcbbd06-fc43-44a4-9931-93082fb1eaae service glance] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:35:26.506773 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad8809-12ec-4b43-a558-98e9f36b09ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc2bab11b264196859802907b93ac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:35:26.507677 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad8809-12ec-4b43-a558-98e9f36b09ee service swift] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:35:26.508140 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad8809-12ec-4b43-a558-98e9f36b09ee service swift] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:35:26.508415 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad8809-12ec-4b43-a558-98e9f36b09ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:35:26.520748 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fad8809-12ec-4b43-a558-98e9f36b09ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:35:26.525802 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fad8809-12ec-4b43-a558-98e9f36b09ee service swift] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:35:26.546873 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13388fb1-b489-45b3-89d5-62fba8c3fcac None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:35:26.551557 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6abe5-22ed-466c-898f-68e1ead571ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:35:26.552513 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6abe5-22ed-466c-898f-68e1ead571ae service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:35:26.553110 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1476/2938] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Sep 21 12:35:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 12:35:26.560772 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6abe5-22ed-466c-898f-68e1ead571ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:35:26.561319 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6abe5-22ed-466c-898f-68e1ead571ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:35:26.563886 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-1ab6abe5-22ed-466c-898f-68e1ead571ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:35:26.582598 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6abe5-22ed-466c-898f-68e1ead571ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:35:26.584574 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6abe5-22ed-466c-898f-68e1ead571ae service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:35:26.623318 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1463/2939] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:35:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:35:26.784287 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad8809-12ec-4b43-a558-98e9f36b09ee service swift] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:35:26.799851 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad8809-12ec-4b43-a558-98e9f36b09ee service swift] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:35:26.826771 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cbd05f-fdc2-485f-80d3-433cc25d74e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:35:26.827413 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbd05f-fdc2-485f-80d3-433cc25d74e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:35:26.827851 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbd05f-fdc2-485f-80d3-433cc25d74e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:35:26.828123 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbd05f-fdc2-485f-80d3-433cc25d74e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:35:26.833256 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-13cbd05f-fdc2-485f-80d3-433cc25d74e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:35:27.024212 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cbd05f-fdc2-485f-80d3-433cc25d74e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:35:27.026115 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cbd05f-fdc2-485f-80d3-433cc25d74e3 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:35:27.042560 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1477/2940] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:35:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:35:28.558585 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6abe5-22ed-466c-898f-68e1ead571ae service neutron] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:35:28.561855 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-1ab6abe5-22ed-466c-898f-68e1ead571ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:35:28.773226 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6abe5-22ed-466c-898f-68e1ead571ae service neutron] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:35:28.782103 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ab9cc-9032-41ca-80d6-dede7312b4a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e866f134f64644bf33e3adecf207c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:35:28.783299 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ab9cc-9032-41ca-80d6-dede7312b4a9 service placement] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:35:28.783612 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ab9cc-9032-41ca-80d6-dede7312b4a9 service placement] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:35:28.783888 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ab9cc-9032-41ca-80d6-dede7312b4a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:35:28.785945 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-7a2ab9cc-9032-41ca-80d6-dede7312b4a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:35:28.801250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ab9cc-9032-41ca-80d6-dede7312b4a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:35:28.803025 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ab9cc-9032-41ca-80d6-dede7312b4a9 service placement] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:35:28.820419 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1464/2941] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:35:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:35:37.036995 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=41 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:35:38.816370 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=75 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:35:39.265604 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85769f-4156-4ddd-8774-6fc1fcb5670a None None] REQUEST_METHOD: `POST` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:35:39.266448 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85769f-4156-4ddd-8774-6fc1fcb5670a None None] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:35:39.266448 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85769f-4156-4ddd-8774-6fc1fcb5670a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:35:39.290142 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.auth.core [None req-0f85769f-4156-4ddd-8774-6fc1fcb5670a None None] MFA Rules not processed for user `eda5880172f64decbab6c27c9026eab4`. Rule list: `[]` (Enabled: `True`). {{(pid=81378) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:35:39.291453 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-0f85769f-4156-4ddd-8774-6fc1fcb5670a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:35:39.298946 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1478/2942] 10.222.0.60 () {58 vars in 958 bytes} [Wed Sep 21 12:35:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:35:41.880223 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e792ad-fd9d-4883-955c-107420b27430 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:35:41.881112 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e792ad-fd9d-4883-955c-107420b27430 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:35:41.881112 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e792ad-fd9d-4883-955c-107420b27430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:35:41.905678 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-14e792ad-fd9d-4883-955c-107420b27430 None None] MFA Rules not processed for user `bbd7a1d5a8d04e3798ffcab27bad936b`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:35:41.906989 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-14e792ad-fd9d-4883-955c-107420b27430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:35:41.915112 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1465/2943] 10.222.0.60 () {58 vars in 1009 bytes} [Wed Sep 21 12:35:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 21 12:35:41.934181 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f85769f-4156-4ddd-8774-6fc1fcb5670a None None] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:35:41.947548 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f85769f-4156-4ddd-8774-6fc1fcb5670a None None] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:35:41.953832 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bea9f0-35e4-4ea9-aa0f-d4dd2ca75f88 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc2bab11b264196859802907b93ac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:35:41.954608 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bea9f0-35e4-4ea9-aa0f-d4dd2ca75f88 service swift] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:35:41.955066 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bea9f0-35e4-4ea9-aa0f-d4dd2ca75f88 service swift] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:35:41.955476 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bea9f0-35e4-4ea9-aa0f-d4dd2ca75f88 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:35:41.982657 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bea9f0-35e4-4ea9-aa0f-d4dd2ca75f88 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:35:41.984970 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bea9f0-35e4-4ea9-aa0f-d4dd2ca75f88 service swift] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:35:42.001332 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1479/2944] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Sep 21 12:35:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 12:35:51.899102 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=3 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:35:51.995389 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=9 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:36:07.859688 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e792ad-fd9d-4883-955c-107420b27430 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:36:07.872918 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e792ad-fd9d-4883-955c-107420b27430 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:36:07.877837 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768aa80-5979-40d3-af9a-1ec29381baf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:36:07.878548 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768aa80-5979-40d3-af9a-1ec29381baf3 service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:36:07.878833 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768aa80-5979-40d3-af9a-1ec29381baf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:36:07.879109 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768aa80-5979-40d3-af9a-1ec29381baf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:36:07.892355 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4768aa80-5979-40d3-af9a-1ec29381baf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:36:07.894104 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4768aa80-5979-40d3-af9a-1ec29381baf3 service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:36:07.905628 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1466/2945] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:36:07 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:36:17.900668 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=6 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:37:17.021149 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bea9f0-35e4-4ea9-aa0f-d4dd2ca75f88 service swift] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:37:17.032318 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bea9f0-35e4-4ea9-aa0f-d4dd2ca75f88 service swift] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:37:17.036297 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410054cc-4eeb-43bf-af53-b8e161069d2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:37:17.036918 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410054cc-4eeb-43bf-af53-b8e161069d2f service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:37:17.037195 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410054cc-4eeb-43bf-af53-b8e161069d2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:37:17.037465 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410054cc-4eeb-43bf-af53-b8e161069d2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:37:17.039551 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-410054cc-4eeb-43bf-af53-b8e161069d2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:37:17.111840 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410054cc-4eeb-43bf-af53-b8e161069d2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:37:17.113629 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410054cc-4eeb-43bf-af53-b8e161069d2f service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:37:17.124970 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1480/2946] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:37:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:37:18.428524 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768aa80-5979-40d3-af9a-1ec29381baf3 service neutron] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:37:18.439000 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768aa80-5979-40d3-af9a-1ec29381baf3 service neutron] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:37:18.442883 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8dbd9-1b79-44c8-a1d3-113ed7b78748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:37:18.443504 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8dbd9-1b79-44c8-a1d3-113ed7b78748 service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:37:18.443783 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8dbd9-1b79-44c8-a1d3-113ed7b78748 service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:37:18.444056 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8dbd9-1b79-44c8-a1d3-113ed7b78748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:37:18.445974 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-67e8dbd9-1b79-44c8-a1d3-113ed7b78748 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:37:18.461560 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8dbd9-1b79-44c8-a1d3-113ed7b78748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:37:18.463237 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8dbd9-1b79-44c8-a1d3-113ed7b78748 service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:37:18.478849 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1467/2947] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:37:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:37:19.484640 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410054cc-4eeb-43bf-af53-b8e161069d2f service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:37:19.494913 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410054cc-4eeb-43bf-af53-b8e161069d2f service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:37:19.499446 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91188ca4-0bcc-4cb5-8296-66d2f2346e57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:37:19.500239 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91188ca4-0bcc-4cb5-8296-66d2f2346e57 service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:37:19.500622 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91188ca4-0bcc-4cb5-8296-66d2f2346e57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:37:19.500995 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91188ca4-0bcc-4cb5-8296-66d2f2346e57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:37:19.503132 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-91188ca4-0bcc-4cb5-8296-66d2f2346e57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:37:19.514089 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91188ca4-0bcc-4cb5-8296-66d2f2346e57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:37:19.515629 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91188ca4-0bcc-4cb5-8296-66d2f2346e57 service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:37:19.526111 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1481/2948] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:37:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:37:19.721245 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8dbd9-1b79-44c8-a1d3-113ed7b78748 service neutron] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:37:19.731801 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8dbd9-1b79-44c8-a1d3-113ed7b78748 service neutron] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:37:19.736401 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988c25a-6957-4171-8fab-b27e1a69e52f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:37:19.737235 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988c25a-6957-4171-8fab-b27e1a69e52f service neutron] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:37:19.737567 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988c25a-6957-4171-8fab-b27e1a69e52f service neutron] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:37:19.738046 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988c25a-6957-4171-8fab-b27e1a69e52f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:37:19.741351 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-f988c25a-6957-4171-8fab-b27e1a69e52f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:37:19.763886 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988c25a-6957-4171-8fab-b27e1a69e52f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:37:19.765945 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988c25a-6957-4171-8fab-b27e1a69e52f service neutron] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:37:19.780952 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1468/2949] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:37:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 21 12:37:23.392549 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91188ca4-0bcc-4cb5-8296-66d2f2346e57 service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:37:23.402436 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91188ca4-0bcc-4cb5-8296-66d2f2346e57 service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:37:23.406491 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc24f8-c644-4741-b4d6-a22187aad12b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab0521c25c2d4417944efa4745588f1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:37:23.407107 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc24f8-c644-4741-b4d6-a22187aad12b service neutron] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:37:23.407386 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc24f8-c644-4741-b4d6-a22187aad12b service neutron] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:37:23.407664 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc24f8-c644-4741-b4d6-a22187aad12b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:37:23.409631 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-75dc24f8-c644-4741-b4d6-a22187aad12b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:37:23.488171 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc24f8-c644-4741-b4d6-a22187aad12b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:37:23.490113 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc24f8-c644-4741-b4d6-a22187aad12b service neutron] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:37:23.503954 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1482/2950] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:37:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:37:28.475206 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988c25a-6957-4171-8fab-b27e1a69e52f service neutron] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:37:28.477253 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-f988c25a-6957-4171-8fab-b27e1a69e52f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:37:28.495560 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988c25a-6957-4171-8fab-b27e1a69e52f service neutron] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:37:28.504277 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6dce9-c635-4cf6-a186-1e98918e6a70 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e866f134f64644bf33e3adecf207c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:37:28.505092 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6dce9-c635-4cf6-a186-1e98918e6a70 service placement] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:37:28.505554 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6dce9-c635-4cf6-a186-1e98918e6a70 service placement] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:37:28.506015 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6dce9-c635-4cf6-a186-1e98918e6a70 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:37:28.509171 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-baa6dce9-c635-4cf6-a186-1e98918e6a70 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:37:28.526555 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa6dce9-c635-4cf6-a186-1e98918e6a70 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:37:28.530250 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa6dce9-c635-4cf6-a186-1e98918e6a70 service placement] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:37:28.546485 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1469/2951] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:37:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:37:32.892824 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc24f8-c644-4741-b4d6-a22187aad12b service neutron] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:37:32.914768 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc24f8-c644-4741-b4d6-a22187aad12b service neutron] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:37:32.920847 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c92764-cff0-4c76-9372-2f0391a7d828 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e866f134f64644bf33e3adecf207c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:37:32.921749 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c92764-cff0-4c76-9372-2f0391a7d828 service placement] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:37:32.922210 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c92764-cff0-4c76-9372-2f0391a7d828 service placement] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:37:32.922700 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c92764-cff0-4c76-9372-2f0391a7d828 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:37:32.925433 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-14c92764-cff0-4c76-9372-2f0391a7d828 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:37:32.940264 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c92764-cff0-4c76-9372-2f0391a7d828 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:37:32.942212 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c92764-cff0-4c76-9372-2f0391a7d828 service placement] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:37:32.957665 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1483/2952] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:37:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:37:32.983611 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6dce9-c635-4cf6-a186-1e98918e6a70 service placement] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:37:32.986947 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-baa6dce9-c635-4cf6-a186-1e98918e6a70 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:37:33.010291 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6dce9-c635-4cf6-a186-1e98918e6a70 service placement] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:37:33.017943 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e09da-413c-4c3d-995c-8b7d00070eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:37:33.018944 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e09da-413c-4c3d-995c-8b7d00070eb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:37:33.019406 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e09da-413c-4c3d-995c-8b7d00070eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:37:33.019868 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e09da-413c-4c3d-995c-8b7d00070eb2 admin admin] PATH_INFO: `/v3/users/b998c363b3704e9aa4564f39332159d8` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:37:33.021400 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4e09da-413c-4c3d-995c-8b7d00070eb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b998c363b3704e9aa4564f39332159d8)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:37:33.025014 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4e09da-413c-4c3d-995c-8b7d00070eb2 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:37:33.095992 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-3a4e09da-413c-4c3d-995c-8b7d00070eb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b998c363b3704e9aa4564f39332159d8'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:37:33.115649 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-3a4e09da-413c-4c3d-995c-8b7d00070eb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b998c363b3704e9aa4564f39332159d8'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:37:33.126999 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-3a4e09da-413c-4c3d-995c-8b7d00070eb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b998c363b3704e9aa4564f39332159d8'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:37:33.127770 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-3a4e09da-413c-4c3d-995c-8b7d00070eb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b998c363b3704e9aa4564f39332159d8'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:37:33.138219 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-3a4e09da-413c-4c3d-995c-8b7d00070eb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b998c363b3704e9aa4564f39332159d8'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:37:33.147088 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1470/2953] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:37:32 2022] DELETE /identity/v3/users/b998c363b3704e9aa4564f39332159d8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:37:33.573040 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c92764-cff0-4c76-9372-2f0391a7d828 service placement] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:37:33.588379 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c92764-cff0-4c76-9372-2f0391a7d828 service placement] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:37:33.672735 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5578a8f-900f-4869-a728-515f34d7b516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:37:33.673836 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5578a8f-900f-4869-a728-515f34d7b516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:37:33.674337 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5578a8f-900f-4869-a728-515f34d7b516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:37:33.674862 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5578a8f-900f-4869-a728-515f34d7b516 admin admin] PATH_INFO: `/v3/projects/fc379ee46ca6403c8057355b5675927f` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:37:33.676988 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5578a8f-900f-4869-a728-515f34d7b516 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc379ee46ca6403c8057355b5675927f)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:37:33.680688 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5578a8f-900f-4869-a728-515f34d7b516 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:37:33.696674 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=100 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:37:33.753705 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f5578a8f-900f-4869-a728-515f34d7b516 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc379ee46ca6403c8057355b5675927f', 'request_id': 'req-f5578a8f-900f-4869-a728-515f34d7b516'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:37:33.766920 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f5578a8f-900f-4869-a728-515f34d7b516 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc379ee46ca6403c8057355b5675927f', 'request_id': 'req-f5578a8f-900f-4869-a728-515f34d7b516'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:37:33.775010 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f5578a8f-900f-4869-a728-515f34d7b516 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc379ee46ca6403c8057355b5675927f', 'request_id': 'req-f5578a8f-900f-4869-a728-515f34d7b516'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:37:33.789301 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f5578a8f-900f-4869-a728-515f34d7b516 admin admin] The token cache is being invalidate because project fc379ee46ca6403c8057355b5675927f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:37:33.789644 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f5578a8f-900f-4869-a728-515f34d7b516 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:37:33.790610 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-f5578a8f-900f-4869-a728-515f34d7b516 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:37:33.792337 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1484/2954] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:37:33 2022] DELETE /identity/v3/projects/fc379ee46ca6403c8057355b5675927f => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:37:33.797326 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e09da-413c-4c3d-995c-8b7d00070eb2 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:37:33.799057 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-3a4e09da-413c-4c3d-995c-8b7d00070eb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:37:33.816882 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e09da-413c-4c3d-995c-8b7d00070eb2 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:37:33.891693 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5aa82-90fd-444c-970d-622321df8dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:37:33.892374 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5aa82-90fd-444c-970d-622321df8dc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:37:33.892690 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5aa82-90fd-444c-970d-622321df8dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:37:33.893001 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5aa82-90fd-444c-970d-622321df8dc2 admin admin] PATH_INFO: `/v3/users/fcc680110f4840e78e78af03f039c2c5` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:37:33.894489 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5aa82-90fd-444c-970d-622321df8dc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcc680110f4840e78e78af03f039c2c5)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:37:33.896605 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5aa82-90fd-444c-970d-622321df8dc2 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:37:33.943409 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:37:33.958554 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-0be5aa82-90fd-444c-970d-622321df8dc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcc680110f4840e78e78af03f039c2c5'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:37:33.974968 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-0be5aa82-90fd-444c-970d-622321df8dc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcc680110f4840e78e78af03f039c2c5'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:37:33.985268 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-0be5aa82-90fd-444c-970d-622321df8dc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcc680110f4840e78e78af03f039c2c5'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:37:33.986545 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-0be5aa82-90fd-444c-970d-622321df8dc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcc680110f4840e78e78af03f039c2c5'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:37:33.995641 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-0be5aa82-90fd-444c-970d-622321df8dc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcc680110f4840e78e78af03f039c2c5'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:37:34.003414 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1471/2955] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:37:33 2022] DELETE /identity/v3/users/fcc680110f4840e78e78af03f039c2c5 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:37:34.223872 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5578a8f-900f-4869-a728-515f34d7b516 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:37:34.225503 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-f5578a8f-900f-4869-a728-515f34d7b516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:37:34.242149 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5578a8f-900f-4869-a728-515f34d7b516 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:37:34.321045 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e77d84-0e9b-4387-867e-f30a078da4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:37:34.322101 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e77d84-0e9b-4387-867e-f30a078da4a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:37:34.322637 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e77d84-0e9b-4387-867e-f30a078da4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:37:34.323126 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e77d84-0e9b-4387-867e-f30a078da4a8 admin admin] PATH_INFO: `/v3/projects/d2c2cd45525649d593b2bc3774dc4976` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:37:34.325224 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e77d84-0e9b-4387-867e-f30a078da4a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2c2cd45525649d593b2bc3774dc4976)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:37:34.328528 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e77d84-0e9b-4387-867e-f30a078da4a8 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:37:34.385130 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-c9e77d84-0e9b-4387-867e-f30a078da4a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2c2cd45525649d593b2bc3774dc4976', 'request_id': 'req-c9e77d84-0e9b-4387-867e-f30a078da4a8'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:37:34.394204 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-c9e77d84-0e9b-4387-867e-f30a078da4a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2c2cd45525649d593b2bc3774dc4976', 'request_id': 'req-c9e77d84-0e9b-4387-867e-f30a078da4a8'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:37:34.400903 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-c9e77d84-0e9b-4387-867e-f30a078da4a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2c2cd45525649d593b2bc3774dc4976', 'request_id': 'req-c9e77d84-0e9b-4387-867e-f30a078da4a8'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:37:34.414143 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-c9e77d84-0e9b-4387-867e-f30a078da4a8 admin admin] The token cache is being invalidate because project d2c2cd45525649d593b2bc3774dc4976 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:37:34.414461 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-c9e77d84-0e9b-4387-867e-f30a078da4a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:37:34.415193 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-c9e77d84-0e9b-4387-867e-f30a078da4a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:37:34.416766 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1485/2956] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:37:34 2022] DELETE /identity/v3/projects/d2c2cd45525649d593b2bc3774dc4976 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:37:43.999574 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=16,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:37:44.410526 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=72,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:38:47.352030 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5aa82-90fd-444c-970d-622321df8dc2 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:38:47.354543 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-0be5aa82-90fd-444c-970d-622321df8dc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:38:47.685887 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5aa82-90fd-444c-970d-622321df8dc2 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:38:47.827582 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b66e9-ee32-45bd-aff6-1b0ccaf0dd0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:38:47.829727 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b66e9-ee32-45bd-aff6-1b0ccaf0dd0d service nova] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:38:47.829727 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b66e9-ee32-45bd-aff6-1b0ccaf0dd0d service nova] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:38:47.829727 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b66e9-ee32-45bd-aff6-1b0ccaf0dd0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:38:47.832794 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-520b66e9-ee32-45bd-aff6-1b0ccaf0dd0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:38:47.856990 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b66e9-ee32-45bd-aff6-1b0ccaf0dd0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:38:47.860006 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b66e9-ee32-45bd-aff6-1b0ccaf0dd0d service nova] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:38:47.882497 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1472/2957] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:38:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:38:54.606811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e77d84-0e9b-4387-867e-f30a078da4a8 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:38:54.608557 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-c9e77d84-0e9b-4387-867e-f30a078da4a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:38:54.657929 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e77d84-0e9b-4387-867e-f30a078da4a8 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:38:54.664272 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d870b15-890a-4e00-be1b-e3c86a72f8f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cb4001f94b8439180ca2a93d3b279b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:38:54.664913 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d870b15-890a-4e00-be1b-e3c86a72f8f9 service nova] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:38:54.665194 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d870b15-890a-4e00-be1b-e3c86a72f8f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:38:54.665473 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d870b15-890a-4e00-be1b-e3c86a72f8f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:38:54.667981 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-0d870b15-890a-4e00-be1b-e3c86a72f8f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:38:54.681767 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d870b15-890a-4e00-be1b-e3c86a72f8f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:38:54.683917 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d870b15-890a-4e00-be1b-e3c86a72f8f9 service nova] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:38:54.696626 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1486/2958] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:38:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:38:55.631205 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d7185-e1f7-4fb4-8f9a-1a1ecf74bbb3 None None] REQUEST_METHOD: `POST` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:38:55.631825 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d7185-e1f7-4fb4-8f9a-1a1ecf74bbb3 None None] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:38:55.631979 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d7185-e1f7-4fb4-8f9a-1a1ecf74bbb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:38:55.654723 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.auth.core [None req-c50d7185-e1f7-4fb4-8f9a-1a1ecf74bbb3 None None] MFA Rules not processed for user `bbd7a1d5a8d04e3798ffcab27bad936b`. Rule list: `[]` (Enabled: `True`). {{(pid=81377) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 21 12:38:55.655998 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-c50d7185-e1f7-4fb4-8f9a-1a1ecf74bbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:38:55.692503 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=100 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:38:55.728775 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1473/2959] 10.222.0.60 () {58 vars in 967 bytes} [Wed Sep 21 12:38:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 21 12:38:55.778118 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d870b15-890a-4e00-be1b-e3c86a72f8f9 service nova] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:38:55.779851 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-0d870b15-890a-4e00-be1b-e3c86a72f8f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:38:55.861874 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d870b15-890a-4e00-be1b-e3c86a72f8f9 service nova] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:38:55.867396 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e4493-8c28-4b63-b1c9-efcda2831011 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbc2bab11b264196859802907b93ac37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:38:55.868029 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e4493-8c28-4b63-b1c9-efcda2831011 service swift] REQUEST_METHOD: `GET` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:38:55.868311 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e4493-8c28-4b63-b1c9-efcda2831011 service swift] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:38:55.868589 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e4493-8c28-4b63-b1c9-efcda2831011 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:38:55.878811 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e4493-8c28-4b63-b1c9-efcda2831011 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:38:55.880438 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e4493-8c28-4b63-b1c9-efcda2831011 service swift] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:38:55.891088 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1487/2960] 10.222.0.60 () {60 vars in 1384 bytes} [Wed Sep 21 12:38:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 21 12:39:04.685272 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d7185-e1f7-4fb4-8f9a-1a1ecf74bbb3 None None] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:39:04.687595 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-c50d7185-e1f7-4fb4-8f9a-1a1ecf74bbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:39:04.837039 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d7185-e1f7-4fb4-8f9a-1a1ecf74bbb3 None None] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:39:04.848554 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca7661-9154-4953-b831-ec5d375a6226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:39:04.849661 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca7661-9154-4953-b831-ec5d375a6226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:39:04.850156 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca7661-9154-4953-b831-ec5d375a6226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:39:04.850698 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca7661-9154-4953-b831-ec5d375a6226 admin admin] PATH_INFO: `/v3/users/eda5880172f64decbab6c27c9026eab4` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:39:04.852874 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca7661-9154-4953-b831-ec5d375a6226 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eda5880172f64decbab6c27c9026eab4)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:39:04.857431 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca7661-9154-4953-b831-ec5d375a6226 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:39:04.938337 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-67ca7661-9154-4953-b831-ec5d375a6226 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eda5880172f64decbab6c27c9026eab4'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:39:04.953618 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-67ca7661-9154-4953-b831-ec5d375a6226 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eda5880172f64decbab6c27c9026eab4'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:39:04.963700 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-67ca7661-9154-4953-b831-ec5d375a6226 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eda5880172f64decbab6c27c9026eab4'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:39:04.965112 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-67ca7661-9154-4953-b831-ec5d375a6226 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eda5880172f64decbab6c27c9026eab4'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:39:04.974301 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-67ca7661-9154-4953-b831-ec5d375a6226 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eda5880172f64decbab6c27c9026eab4'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:39:04.981626 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1474/2961] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:39:04 2022] DELETE /identity/v3/users/eda5880172f64decbab6c27c9026eab4 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:39:05.228301 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e4493-8c28-4b63-b1c9-efcda2831011 service swift] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:39:05.255250 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e4493-8c28-4b63-b1c9-efcda2831011 service swift] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:39:05.339485 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf926f-f160-42ba-b3f5-1f90b05e2817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:39:05.340131 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf926f-f160-42ba-b3f5-1f90b05e2817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:39:05.340406 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf926f-f160-42ba-b3f5-1f90b05e2817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:39:05.340672 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf926f-f160-42ba-b3f5-1f90b05e2817 admin admin] PATH_INFO: `/v3/projects/c380018464db4bc89702ada14ffc8740` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:39:05.341855 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf926f-f160-42ba-b3f5-1f90b05e2817 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c380018464db4bc89702ada14ffc8740)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:39:05.343934 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf926f-f160-42ba-b3f5-1f90b05e2817 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:39:05.406819 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-13bf926f-f160-42ba-b3f5-1f90b05e2817 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c380018464db4bc89702ada14ffc8740', 'request_id': 'req-13bf926f-f160-42ba-b3f5-1f90b05e2817'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:39:05.412231 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:39:05.416622 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-13bf926f-f160-42ba-b3f5-1f90b05e2817 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c380018464db4bc89702ada14ffc8740', 'request_id': 'req-13bf926f-f160-42ba-b3f5-1f90b05e2817'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:39:05.426798 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-13bf926f-f160-42ba-b3f5-1f90b05e2817 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c380018464db4bc89702ada14ffc8740', 'request_id': 'req-13bf926f-f160-42ba-b3f5-1f90b05e2817'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:39:05.441911 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-13bf926f-f160-42ba-b3f5-1f90b05e2817 admin admin] The token cache is being invalidate because project c380018464db4bc89702ada14ffc8740 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:39:05.442203 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-13bf926f-f160-42ba-b3f5-1f90b05e2817 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:39:05.442929 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-13bf926f-f160-42ba-b3f5-1f90b05e2817 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:39:05.444469 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1488/2962] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:39:05 2022] DELETE /identity/v3/projects/c380018464db4bc89702ada14ffc8740 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 21 12:39:05.449653 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca7661-9154-4953-b831-ec5d375a6226 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:39:05.451508 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-67ca7661-9154-4953-b831-ec5d375a6226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:39:05.465161 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca7661-9154-4953-b831-ec5d375a6226 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:39:05.498114 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:39:05.533568 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e8d6c-9171-49de-9d66-a3e92107bb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:39:05.534214 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e8d6c-9171-49de-9d66-a3e92107bb46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:39:05.534524 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e8d6c-9171-49de-9d66-a3e92107bb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:39:05.534796 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e8d6c-9171-49de-9d66-a3e92107bb46 admin admin] PATH_INFO: `/v3/users/538558b8e980428c9318a8aa41d7bdbc` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:39:05.536077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926e8d6c-9171-49de-9d66-a3e92107bb46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=538558b8e980428c9318a8aa41d7bdbc)` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:39:05.538149 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926e8d6c-9171-49de-9d66-a3e92107bb46 admin admin] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:39:05.618988 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-926e8d6c-9171-49de-9d66-a3e92107bb46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '538558b8e980428c9318a8aa41d7bdbc'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:39:05.641771 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-926e8d6c-9171-49de-9d66-a3e92107bb46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '538558b8e980428c9318a8aa41d7bdbc'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:39:05.656033 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-926e8d6c-9171-49de-9d66-a3e92107bb46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '538558b8e980428c9318a8aa41d7bdbc'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:39:05.657143 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-926e8d6c-9171-49de-9d66-a3e92107bb46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '538558b8e980428c9318a8aa41d7bdbc'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:39:05.671211 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.notifications [None req-926e8d6c-9171-49de-9d66-a3e92107bb46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '538558b8e980428c9318a8aa41d7bdbc'} {{(pid=81377) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:39:05.683077 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1475/2963] 10.222.0.60 () {58 vars in 1224 bytes} [Wed Sep 21 12:39:05 2022] DELETE /identity/v3/users/538558b8e980428c9318a8aa41d7bdbc => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:39:05.938479 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf926f-f160-42ba-b3f5-1f90b05e2817 admin admin] Authenticating user token {{(pid=81378) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:39:05.941789 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.fernet_utils [None req-13bf926f-f160-42ba-b3f5-1f90b05e2817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81378) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:39:05.966597 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf926f-f160-42ba-b3f5-1f90b05e2817 admin admin] Validating token access rules against request {{(pid=81378) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:39:06.058389 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1251a9-c587-4579-90f6-4e5835b34d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ede9eacb91d469ab92c14848276a5bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1600cabcba2e4465b53f5a73f9b91b11', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81378) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:39:06.059061 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1251a9-c587-4579-90f6-4e5835b34d57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:39:06.059340 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1251a9-c587-4579-90f6-4e5835b34d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:39:06.059625 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1251a9-c587-4579-90f6-4e5835b34d57 admin admin] PATH_INFO: `/v3/projects/1393279e19db450e96aed728bfcaca1c` {{(pid=81378) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:39:06.060958 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1251a9-c587-4579-90f6-4e5835b34d57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1393279e19db450e96aed728bfcaca1c)` {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:39:06.063245 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1251a9-c587-4579-90f6-4e5835b34d57 admin admin] RBAC: Authorization granted {{(pid=81378) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:39:06.126557 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-4c1251a9-c587-4579-90f6-4e5835b34d57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1393279e19db450e96aed728bfcaca1c', 'request_id': 'req-4c1251a9-c587-4579-90f6-4e5835b34d57'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:39:06.135118 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-4c1251a9-c587-4579-90f6-4e5835b34d57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1393279e19db450e96aed728bfcaca1c', 'request_id': 'req-4c1251a9-c587-4579-90f6-4e5835b34d57'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:39:06.143016 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-4c1251a9-c587-4579-90f6-4e5835b34d57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1393279e19db450e96aed728bfcaca1c', 'request_id': 'req-4c1251a9-c587-4579-90f6-4e5835b34d57'} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:39:06.157289 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-4c1251a9-c587-4579-90f6-4e5835b34d57 admin admin] The token cache is being invalidate because project 1393279e19db450e96aed728bfcaca1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81378) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 21 12:39:06.157577 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-4c1251a9-c587-4579-90f6-4e5835b34d57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:39:06.158354 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG keystone.notifications [None req-4c1251a9-c587-4579-90f6-4e5835b34d57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81378) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 21 12:39:06.160427 dv-cinder-858678-1-smb devstack@keystone.service[81378]: [pid: 81378|app: 0|req: 1489/2964] 10.222.0.60 () {58 vars in 1233 bytes} [Wed Sep 21 12:39:05 2022] DELETE /identity/v3/projects/1393279e19db450e96aed728bfcaca1c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 21 12:39:15.675621 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=39,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:39:16.152693 dv-cinder-858678-1-smb devstack@keystone.service[81378]: DEBUG dbcounter [-] [81378] Writing DB stats keystone:SELECT=57,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81378) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 21 12:40:44.150741 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e8d6c-9171-49de-9d66-a3e92107bb46 admin admin] Authenticating user token {{(pid=81377) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 21 12:40:44.152310 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-926e8d6c-9171-49de-9d66-a3e92107bb46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:40:44.259048 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e8d6c-9171-49de-9d66-a3e92107bb46 admin admin] Validating token access rules against request {{(pid=81377) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 21 12:40:44.330581 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb908d2-7ffa-4cf2-ab89-173f8544d63a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74e866f134f64644bf33e3adecf207c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0abcc6f2ce14825bfc26e6210889c21', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81377) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 21 12:40:44.331230 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb908d2-7ffa-4cf2-ab89-173f8544d63a service placement] REQUEST_METHOD: `GET` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 21 12:40:44.331503 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb908d2-7ffa-4cf2-ab89-173f8544d63a service placement] SCRIPT_NAME: `/identity` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 21 12:40:44.331773 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb908d2-7ffa-4cf2-ab89-173f8544d63a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81377) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 21 12:40:44.333759 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.fernet_utils [None req-7bb908d2-7ffa-4cf2-ab89-173f8544d63a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81377) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 21 12:40:44.346797 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb908d2-7ffa-4cf2-ab89-173f8544d63a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 21 12:40:44.348628 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb908d2-7ffa-4cf2-ab89-173f8544d63a service placement] RBAC: Authorization granted {{(pid=81377) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 21 12:40:44.360777 dv-cinder-858678-1-smb devstack@keystone.service[81377]: [pid: 81377|app: 0|req: 1476/2965] 10.222.0.60 () {60 vars in 1365 bytes} [Wed Sep 21 12:40:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 21 12:40:54.355592 dv-cinder-858678-1-smb devstack@keystone.service[81377]: DEBUG dbcounter [-] [81377] Writing DB stats keystone:SELECT=67 {{(pid=81377) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}